Crawl Delay

Asked by:
MacBros Time:
2011-08-17 10:05 pm Category:
Website Troubleshooting Hits:
1,260
I'm trying to add Crawl Delay which was recommended by you but when I add it I get a 500 error

User-agent: *
Crawl-delay: 30

Never Mind. I put it in the .htacces file instead of the robots.txt file..


You must login before you can ask a follow up question.

You must login before you can submit an answer.

Best answer chosen by Web Hosting Hub staff

0

bradm
2011-08-18 12:11 am
Hi MacBros,

I recommend our article on troubleshooting 500 internal server errors. It covers issues in the .htaccess.

It sounds like you got this one sorted out on your own, and updated your question?

We're here if you need any further support, simply ask!

Thanks,
- Brad

You must login before you can post a comment about this answer.
Like this Question?

Support Center Login

Have a Question?

If you need some help, submit your question to our Community! We guarantee a response within 60 minutes (8am - 9pm EST, Monday - Friday)

Recent Questions

  1. Need to help in redirecting domain to tumblr account
  2. Incorrect E-Mail Address Specified for Backup Notifications
  3. Trying to upload my concrete files from mamp to filezilla

Support Center Search

Current Customers

Email: support@WebHostingHub.com Ticket: Submit a Support Ticket
Call: 877-595-4HUB (4482)
757-416-6627 (Intl.) 		Chat: Click To Chat Now

Ask the Community

Get help with your questions from our community of like-minded hosting users and Web Hosting Hub Staff.

Not a Customer?

Get web hosting from a company that is here to help.