About this service
We review the two files that tell search engines how to crawl your site: the crawl rules file at the root of your domain and your XML sitemap. Common problems are a leftover Disallow rule that blocks a whole section, a sitemap full of redirected, noindex or 404 URLs, and important pages missing from it. You get corrected rules ready to paste and a list of sitemap fixes.
What is included
- What you getA short report with the corrected crawl rules file text, the list of sitemap URLs to remove or add, and notes on how to submit the sitemap to search engines.
- Crawl rules checkNo important pages blocked
- Sitemap cleanupNo redirects, noindex or 404s
- Missing pagesKey URLs added
- Ready-to-paste rulesCorrected file text
How it works
- 1BriefYou share the site and CMS
- 2ReviewWe check the rules and sitemap URLs
- 3DeliveryYou get corrected rules and fixes
What we need from you
A link to the site, which CMS it runs on, and any sections that should stay out of search, such as the account area or test pages.
We will ask you:
- Which site should be checked?
- Which CMS does it run on?
- What should stay out of search?
Compare packages
| Packages | BasicUp to 100 sitemap URLs$10 | StandardUp to 500 sitemap URLs$20 | PremiumUp to 2,000 sitemap URLs$39 |
|---|---|---|---|
| Deadline | 1 day | 2 days | 3 days |
| Revisions | 1 | 2 | 2 |
| Sitemap URLs checked | up to 100 | up to 500 | up to 2,000 |
| Sitemaps | 1 | up to 3 | up to 10 |
| Corrected rules file | Yes | Yes | Yes |
| Order Basic | Order Standard | Order Premium |
Payment protection
You pay when you order, but the money is released only for accepted work.
- Fixed priceThe package price does not change after you pay.
- The money is reservedWhen you pay, the amount is only reserved. It is released to the service once you accept the work.
- Checked before deliveryEvery result goes through a quality check before it reaches you, and you see it on the order page before accepting it.
- Free revisionsAsk for changes within your brief as many times as the package allows.
- Acceptance after 3 daysIf within 3 days of delivery you neither accept the work nor ask for changes, it is accepted automatically. If you write in the order chat after delivery, the order waits; once we answer, we may start the 3 days again and will say so in the chat.
- Redo or a full refundIf the result does not match your brief and the revisions did not fix it, or the work takes more than twice its deadline, write in the order chat: we will redo the work or refund the payment in full.
Questions and answers
Does a Disallow rule remove a page from Google?
No. It stops crawling, but a blocked page can still appear in results if other sites link to it. To keep a page out, use noindex and let it be crawled.
My CMS makes the sitemap itself. Is it fine?
Often not. Plugins and platforms tend to include tag pages, attachments or redirected URLs. The review shows what to switch off.
Will you upload the files?
No, we do not access sites. You or your developer paste the corrected rules and change the sitemap settings.