SE spidering jodohost forums

[Harrison]

what gives?

 

[Yash]

Not sure, anything wrong with that?

 

[Harrison]

well no. i guess we should all be carefull what we post.
right yash.

 

[Yash]

Yes of course, especially if you are a reseller

I've had to delete quite a few posts and changed quite a few usernames since we introduced our reseller packages earlier this year (on request of resellers of course)

 

[KCWebMonkey]

what gives?

why would you assume that SE's "wouldn't" spider the forum pages? If you can visit ANY page without having to log in or something, you should assume that a SE can view it also. SE's view pages via HTTP just like us...

 

[Harrison]

calm down there webmonkey . I realize now that it would not be feasible, because of the extra traffic (and possible sales) the forums create for jodohost, to exclude them in their robots.txt.

So whatever brings in more business is good right.

 

[Good Oyster]

That's also why it's not a bad idea to include some keyword-laden links to your websites in your signature!