The Blogger has added new feature of updating robots.txt file.This file instructs to search engine what is allow or disallow to search engine, By default path of file is main directory.Type your blog URL / robots.txt and you will see the contents of robots.txt file, if this is not exists in main directory then all search engine consider that robots.txt file is not exists on server.
Steps to edit File -:
1. Type your Blog URL / robots.txt in Internet browser. ( eg. www.example.com/robots.txt )
2. For backup of robots.txt, copy the existing contents and save in notepad file for your future reference.
3. Login in Blogger Account.
4. Go in Settings > Search Preferences
5. See Label Custom robots.txt , choose yes to update robots.txt file.
Steps to edit File -:
1. Type your Blog URL / robots.txt in Internet browser. ( eg. www.example.com/robots.txt )
2. For backup of robots.txt, copy the existing contents and save in notepad file for your future reference.
3. Login in Blogger Account.
4. Go in Settings > Search Preferences
5. See Label Custom robots.txt , choose yes to update robots.txt file.
6. Open the sitemap generator which will generates the contents of robots.txt file for blogger, the sitemap generator or robots file content generator only generates the robots.txt file contents for blogger or blogger custom domain.
Robots.txt Content Generator or Sitemap generator URL -: http://ctrlq.org/blogger/
7. Copy this Area and paste in search preferences in custom robots.txt and save changes.
8. Type your blog URL / robots.txt to check updated robots.txt contents.
Note : Please change only robots.txt file if you are aware about usage of it.
