This guide explains the significance of the robots.txt file for Drupal installations. It explains the function of the robots.txt file from a search engine optimisation perspective, and also how to configure the file correctly on your website.
tags:
robot.txt,
SEO 
