WordPress robots.txt and sitemapRobots & Sitemap

robots.txt and sitemap setup guide for WordPress

Delivery from 1 dayRevisions includedQuality check
Packages
Payment protectionDetails
  • Revisions within the package are free.
  • If you do not respond within 3 days of delivery, the work is accepted automatically.
Order · $20

The money is reserved when you pay and released only once you accept the work.

robots.txt and sitemap setup guide for WordPress

Example result

Example for the Standard package

SEO audit: website of a regional plumbing company

Summary

AreaScoreMain issue
Indexing and crawlingNeeds work38 blog tags pages indexed, thin content
Technical healthFairMobile load time 4.8 s on service pages
On-pageNeeds work11 of 18 service pages share near-identical titles
Local signalsWeakTown pages are copies with the town name swapped
ContentFairBlog traffic is high, but posts do not link to services

Findings (excerpt)

1. Duplicate and weak titles (high priority)

11 service pages use the pattern "Plumbing Services | Northgate". Searchers and search engines cannot tell "boiler repair" from "drain unblocking".

PageCurrent titleSuggested title
/boiler-repairPlumbing Services, NorthgateBoiler Repair in [City], Same-Day Callout, Northgate
/blocked-drainsPlumbing Services, NorthgateBlocked Drains Cleared in [City] from £89, Northgate

2. Town pages are near duplicates (high priority)

The 7 town pages are 94% identical text. Each needs at least 250 words unique to that town: areas covered, typical jobs there, travel time, a local customer review.

3. Slow service pages on mobile (medium)

Hero images average 1.9 MB. Compressing to WebP and setting width to 1,200 px would bring load time to about 2.5 s.

4. Blog does not pass value to services (medium)

The top 10 posts get 62% of organic visits, but only 2 of them link to a service page. "Why is my boiler losing pressure?" alone gets about 1,100 visits a month and links nowhere.

5. Tag pages indexed (low)

38 /tag/ pages with 1–3 posts each. Set them to noindex.

Prioritised action plan

#ActionEffortImpactWho
1Rewrite titles and meta descriptions for 18 service pages1 dayHighContent
2Write unique content for 7 town pages3–4 daysHighContent
3Add service links to the top 10 blog posts2 hoursMediumContent
4Compress hero images2 hoursMediumDeveloper
5Noindex tag pages, update sitemap1 hourLowDeveloper

Re-check: crawl again 6 weeks after items 1–3 are live and compare impressions for "[service] + [town]" queries.

Client: Northgate Plumbing & Heating, 11 engineers, serving one city and 6 nearby towns Site: 214 pages: home, 18 service pages, 7 town pages, 160 blog posts, contact and legal pages Goal: more calls from local searches such as "boiler repair [town]"

The client and all details are made up.

About this service

WordPress gives you a virtual robots.txt and a sitemap from the core, and SEO plugins like Yoast, Rank Math or All in One SEO replace both with their own, so many sites end up with two sitemaps, tag and author archives in the index and the wp-admin rules copied from an old forum post. We look at what your site serves now and write a step-by-step setup guide for your plugin: which sitemap to keep, which post types and taxonomies to include, a clean robots.txt and where to change each setting.

What is included

  • What you getA setup guide for your WordPress site: the current robots.txt and sitemap findings, a ready robots.txt, the plugin settings to change step by step and what to submit in Search Console.
  • What it serves nowYour live robots.txt and sitemaps checked
  • One sitemapWhich to keep and which to switch off
  • Content in the sitemapPost types, taxonomies and archives
  • Clean robots.txtNo outdated wp-includes blocks
  • Plugin stepsWhere each setting lives

How it works

  1. 1
    CheckWe look at your live files
  2. 2
    GuideWe write steps for your plugin
  3. 3
    SubmitYou apply and submit the sitemap

What we need from you

A link to the site, the SEO plugin you use (or plan to), the post types and taxonomies you have, such as products, portfolio or events, and which archives you want in search.

We will ask you:

  • Which SEO plugin does the site use?
  • Which post types and taxonomies do you have?
  • Should tag, author or date archives appear in search?

Compare packages

PackagesBasicBlog or small site$10StandardBusiness site$20PremiumWooCommerce or multilingual$39
Deadline1 day2 days3 days
Revisions122
Post types and taxonomiesup to 4up to 8up to 15
Plugin setup stepsYesYesYes
Ready robots.txtYesYesYes
Order BasicOrder StandardOrder Premium

Payment protection

You pay when you order, but the money is released only for accepted work.

  • Fixed priceThe package price does not change after you pay.
  • The money is reservedWhen you pay, the amount is only reserved. It is released to the service once you accept the work.
  • Checked before deliveryEvery result goes through a quality check before it reaches you, and you see it on the order page before accepting it.
  • Free revisionsAsk for changes within your brief as many times as the package allows.
  • Acceptance after 3 daysIf within 3 days of delivery you neither accept the work nor ask for changes, it is accepted automatically. If you write in the order chat after delivery, the order waits; once we answer, we may start the 3 days again and will say so in the chat.
  • Redo or a full refundIf the result does not match your brief and the revisions did not fix it, or the work takes more than twice its deadline, write in the order chat: we will redo the work or refund the payment in full.
How it works →

Questions and answers

My site has two sitemaps. Is that bad?

It confuses things and often lists pages twice. The guide says which one to keep, usually the plugin's, and how to switch off the other.

Should I block wp-content in robots.txt?

No. Search engines need your theme files and images to render pages. The ready file keeps them open.

Will you change the plugin settings?

No, we do not log in to your WordPress. You follow the steps in the guide, which take about half an hour.

Packages
Order · $20· 2 days