Where is the robots.txt file?

Discussion in 'General Web Coding' started by jag5311, Oct 21, 2003.

  1. jag5311

    jag5311 Perch

    I am just curious, because I wanted to see if googlebot is hitting my site.

    Thanks
    Bryan
  2. Yash

    Yash Bass

    You are suppose to create that file. It can be used to set rules for the bots I believe
  3. jag5311

    jag5311 Perch

    What folder do I put it in if I create it?

    Where the database is? in the webalizer folder? where all my files are?

    Thanks
  4. Yash

    Yash Bass

    It should be put in your domain directory.

    Which database are you referring to? Databases should not be in the domain folder or any sub folders within it. Create a separate DB folder in the root
  5. StPatrick

    StPatrick Perch

    Hmm, actually you should enable either raw logs, or use Webalizer to see if search engine hits your site.
    I'm not quite sure, but as I remember right, robots.txt is used to tell to search bot what to index and what not. At least this is what I'm using it for :)

Share This Page

JodoHost - 26,000 hosting end-users in 100 countries
Plesk Web Hosting
VPS Hosting
H-Sphere Web Hosting
Other Services