| Author |
Message |
Scott tutorialtoday.com

Joined: 24 Mar 2005 Posts: 2666 Location: Mississauga, Ontario
|
Posted: Wed Mar 26, 2008 8:40 pm Post subject: Blocking Spiders? |
|
|
For some reason my site seems to be blocking spiders. I noticed that traffic from search engines seemed to just stop completely 5 days ago, and I was averaging about 10-20 hits a day and I haven't got one search hit in the past 5 days.
Also, I tried to validate my page and I got a "400 Bad Request".
So I went to try and use https://www.google.com/webmasters/tools/ to find if it was getting any crawl errors, but it couldn't verify my site because when it crawled my site it gave a "400 Bad Request".
Also, this isn't just my site. It doesn't let you try and validate this site either. _________________ Tutorial Management Script - Version 1.4 Released
TutorialToday - Up and running, submit your tutorials!
Linux Tutorials - Coming Soon |
|
| Back to top |
|
| |
Desbrina Jadeite

Joined: 11 Jun 2005 Posts: 3010 Location: Earth
|
|
| Back to top |
|
| |
LP-SolidRaven Dictator of the Dump

Joined: 06 Jun 2004 Posts: 7359 Location: The cheese is made out of moon
|
Posted: Wed Apr 02, 2008 3:32 am Post subject: |
|
|
Have you tried using a robots.txt ? _________________
| Quote: |
<bart416> I just realized something
<bart416> we celebrate the fact that this piece of rock made one rotation around a glowing ball of plasma that is kept together due to its own gravity well
<njsg> HAPPY NEW YEAR
<Easter> ^^
|
|
|
| Back to top |
|
| |
|
|
|