How To Install A Robots.txt (text) File

How To Install A Robots.txt File

The robots.txt file is a set of instructions for visiting search engine robots, also known as spiders that crawl your website pages and index the content of your web site. The robots.txt file can help the search engine robots find there way around your website. It acts like a road map for your website. Not all spiders (robots) take notice of this file but it is useful to have on your website.The URL location of your robots.txt file should look like this...

http://www.internet-marketing-academy.net/robots.txt

Always make sure that you place all types of sitemaps in the root directory of your website.

You can create a robots.txt file very easily by typing these two lines below...

User-agent: *
Disallow:

into notepad on your computer. All you have to now is call the file "robots" and save the file as a simple .txt document

It will look like this if you open it in Microsoft Frontpage...

Just two lines of code.

what it looks like in notepad...

Only two lines of code.

All you have to do now is upload the file to your website.

WELL DONE!!!

YOU HAVE JUST CREATED YOUR FIRST robots.txt FILE !!!