Releasing a Drupal site? Check robots.txt! | Guaka!
Drupal: robots.txt vs language path prefix - YouTube
How to Fix the Problems with Drupal's Default Robots.txt File | Volacci
Send correct cache headers in 8.x version [#2979171] | Drupal.org
robots.txt served by drupal for sites employing robotstxt.module · Issue #111 · perusio/drupal-with-nginx · GitHub
Un informático en el lado del mal: Descubrir usuarios de Drupal con FOCA y ZAP Proxy
How to Create a Private, Online Drupal Environment - OSTraining
How to Disable Search Engine Crawlers on your Acquia Cloud Drupal 8 Development Servers
Actually exclude user register, login, logout, and password pages from search results in robots.txt (current rules are broken) [#3123285] | Drupal .org