Skip to content
Searchpedia SEO field notes Callum Bennett Callum

Site ops

How to Perform a Technical SEO Audit

I always start a technical SEO audit by crawling the site with a tool like Screaming Frog and then cross-referencing Search Console, because the crawl alone will waste your time on issues Google has already resolved.

Beginner3 min readUpdated 2026-07-27Notes by Callum Bennett

Start here

  • Crawl your site with a desktop crawler while pulling Google Search Console data for coverage reports and manual actions.
  • Check robots.txt and sitemap coverage to confirm important pages are crawlable and submitted.
  • Audit noindex tags and canonical tags to ensure the right pages are indexed and duplicates are consolidated.
  • Test rendering on JavaScript-heavy pages to see if Google can access all content after execution.
  • Prioritise fixes by traffic impact — a noindex on a money page should always come before a slow image on a low-traffic URL.

Plain-English take

Think of a technical SEO audit like a home inspection before buying a house. You are not redecorating yet — you are checking if the foundation is cracked, the plumbing works, and the doors actually open. The crawl is your flashlight. [Search Console](/seo-audit/) is the blueprints. Together, they show you what Google can and cannot see. I run a crawl with Screaming Frog or Sitebulb first, then pull Search Console's coverage report and sitemap status. The crawl gives me raw URLs, status codes, meta robots tags, and internal link counts. Search Console tells me how Google actually sees those URLs — which ones are indexed, which are excluded, and why. If you only crawl, you miss the difference between 'crawled but dropped from index' and 'crawled and indexed.' That difference changes what you fix.

A solid audit covers four layers: crawlability, indexability, rendering, and performance. Crawlability means your important pages are reachable via internal links and not blocked by robots.txt or login walls. Indexability means those pages have no noindex tag, a correct canonical, and no redirect chain that ends somewhere irrelevant. Rendering matters when your site depends on JavaScript to load key content — Google might see an empty div. Performance covers Core Web Vitals, mobile-friendliness, and server response times. I check each layer, but I always handle crawlability and indexability before touching page speed. A fast page that is not indexed helps no one.

I have stopped counting how many audits I have seen that list 200 issues without any priority. A good audit does not just dump problems — it tells you which one to fix first. I use a simple rule: anything that blocks indexing of a page that drives revenue or traffic gets fixed today. Everything else goes on a backlog. That is the difference between an audit that gathers dust and one that changes the site's performance within a week.

When it actually matters

After a site migration. That is the single most common moment to run a technical audit. I worked on a domain migration last year where the new site looked fine to the marketing team, but the crawl revealed that 60% of the old URLs returned a 404 with no redirect. Google was already dropping those pages from the index. We had lost three weeks of traffic before anyone noticed. A post-migration audit should be run within 24 hours of go-live, then again after a week to catch any deferred redirects or missing [canonical tags](/canonical-tag/).

Before a major content push. If you are launching a new section, adding 500 product pages, or running a campaign, you need to confirm the infrastructure is ready. I check robots.txt to make sure the new paths are not accidentally blocked, and I verify the sitemap includes the new URLs. I once launched a campaign with 200 landing pages only to find the [robots.txt](/robots-txt/) had a disallow for the entire campaign folder that had been there since the last site redesign. That cost two weeks of zero organic traffic.

When traffic drops unexpectedly. A sudden loss of organic traffic often points to a technical issue — a rogue noindex directive from a developer release, a sitemap that stopped updating, or a server change that increased response times. I always check the Search Console coverage report first. If the number of indexed pages has dropped, I look for recent changes to [directives](/directive/) or redirects. If the pages are still indexed but rankings fell, I check [Core Web Vitals](/core-web-vitals/) and mobile usability. Performance regressions can happen overnight after a code deployment, and they can cause Google to demote pages within days.

Some people tell you to audit every quarter regardless. I do not believe in calendar-based audits. I audit when something changes or when something breaks. Running an audit on a static blog every three months is a waste of time — you will find the same minor issues. Save your audit for moments that actually matter.

What I got wrong

Running a crawl without checking Search Console first. I did this for years. I would find 400 broken links, spend hours documenting them, then open Search Console and see that Google had already excluded those URLs from the index — they were old, orphaned pages that nobody visited. The real problem was that my main product pages were not in the sitemap at all, but I missed that because I did not cross-reference the coverage report. Now I open Search Console before I even launch the crawler. I load the sitemap report and the index coverage report, export the lists, then feed those lists into the crawler as a seed. It saves me three hours per audit.

Prioritising page speed over crawlability. I used to think that making the site fast was the most impactful fix. Then I ran an audit for a client whose homepage was loading in under two seconds, but the entire category section was blocked by a noindex tag that a developer had accidentally applied. I had spent a week optimising images and deferring JavaScript while the real issue was right there in the meta tags. Now I fix crawlability and indexability first, then performance. A slow but indexable page still has a chance. A fast page that no search engine can find is a ghost.

Not checking mobile rendering separately. I assumed that if a site passed the mobile-friendly test, Google could render the content. Then I found a site whose navigation collapsed on mobile due to a CSS grid bug, and Google could not reach any subpages because the mobile menu items were not actually links in the rendered HTML. The desktop crawl showed perfect internal linking, but the mobile crawl showed a site with just a homepage and a contact page. Now I always run a separate mobile crawl or use a tool that renders pages as Googlebot Smartphone. The difference can be stark and expensive.

Next step

Quick answers

How often should I run a technical SEO audit?

Only after significant changes like a migration, a content launch, or a traffic drop. Regular calendar audits waste time on a static site. If you do nothing new, check Search Console once a month and skip the full crawl.

Do I need to check every URL manually?

No. Use a crawler to find patterns, then sample a handful of problematic URLs manually. Look at the meta tags, redirected URLs, and rendered HTML. Manual checks prove the pattern is real before you ask a developer to fix 500 pages.

What is the first thing to fix in an audit?

Any page that drives revenue or traffic and is not indexed. Check your analytics for top pages, then see if they appear in the Search Console index. If not, diagnose why — noindex tag, blocked by robots, or missing from sitemap — and fix that same day.

Sources

Primary documentation is linked directly. Anything commercial is marked nofollow.

  • Google Search Central — Primary source for crawling, indexing, sitemaps, robots directives, and structured data guidance used throughout the audit.
  • Google Search Console Help — Best source for interpreting coverage reports, sitemap status, and Core Web Vitals data in an audit.
  • Moz SEO Audit Checklist — Provides a practical pass/fail workflow and prioritisation structure that I adapted for my own order of operations.
  • Sitebulb Technical SEO Audit Guide — Offers clear checklist-style guidance on separating audit sections and communicating findings to stakeholders.

Notes from Callum Bennett.