What it is

SEO Spider is a desktop crawler that fetches every URL on a site and reports broken links, redirect chains, duplicate titles, missing meta descriptions, hreflang errors and orphan pages. It renders JavaScript and pulls in Search Console, Analytics and PageSpeed Insights data.

Why it earns a slot

Fastest way to find what is technically broken before blaming the algorithm. Free mode crawls 500 URLs, which covers a young project entirely, and the licence just removes the cap.

Know before you commit

It runs on your machine and eats RAM — large crawls need database storage mode and patience. No scheduling, history or dashboards unless you build them yourself.

Getting started

Download the desktop app; free mode needs no account.

Field notes

0 from the community

Sign in to add a field note. Reading is always open.

Loading notes…

Field check

Unverified

Sign in to confirm this entry is still accurate.

Pricing snapshot

Free: 500 URLs per crawl with nearly all features. Licence £199/year per user (roughly $250). Volume discounts: £189 each at 5-9 licences, £179 at 10-19, £169 at 20+.

Snapshots move fast — verify at checkout, and post a field note if it changed.

Drop into your Lovable chat

Evaluate Screaming Frog SEO Spider (https://www.screamingfrog.co.uk/seo-spider/) for this project, then use it only if it fits what we are already building.
Context: Desktop website crawler. SEO Spider is a desktop crawler that fetches every URL on a site and reports broken links, redirect chains, duplicate titles, missing meta descriptions, hreflang errors and orphan pages. It renders JavaScript and pulls in Search Console, Analytics and PageSpeed Insights data.
Reviewer notes (general, not written for this codebase): Fastest way to find what is technically broken before blaming the algorithm. Free mode crawls 500 URLs, which covers a young project entirely, and the licence just removes the cap.
Watch out for: It runs on your machine and eats RAM — large crawls need database storage mode and patience. No scheduling, history or dashboards unless you build them yourself.
Pricing: Free: 500 URLs per crawl with nearly all features. Licence £199/year per user (roughly $250). Volume discounts: £189 each at 5-9 licences, £179 at 10-19, £169 at 20+.
Setup: Download the desktop app; free mode needs no account.
Rules: treat the notes above as background only. Do not assume a theme, style, layout or feature that is not already in this project — inspect the existing code first and ask me before changing visual direction.

/api/public/tools/screaming-frog-seo-spider

Also in SEO, growth & newsletter

Ahrefs

ahrefs.com

Backlink and keyword research suite

Free tier + paidSEO, growth & newsletter

Ahrefs Webmaster Tools free for domains you verify. Starter $29/mo. Lite $129/mo, Standard $249/mo, Advanced $449/mo, Enterprise $1,499/mo (annual). Extra seats $40-$100/mo. Brand Radar AI from $199/mo.

Open dossier

AnswerThePublic

answerthepublic.com

Search question visualiser

Free tier + paidSEO, growth & newsletter

Free: about 3 searches per day on a free account. Paid plans start near $9/mo billed annually for Individual, with Pro and Expert tiers around $99/mo and $199/mo; monthly billing costs more. Owned by NP Digital.

Open dossier

beehiiv

beehiiv.com

Newsletter platform with growth tooling

Free tier + paidSEO, growth & newsletter

Launch free to 2,500 subscribers with unlimited sends, custom domain and website. Scale $43/mo ($517/yr). Max $96/mo ($1,151/yr). Enterprise custom past 100,000 subscribers. beehiiv takes 0% of paid subscription revenue, Stripe takes 2.9% + $0.30.

Open dossier

Bitly

bitly.com

Short links and QR codes

Free tier + paidSEO, growth & newsletter

Free: 5 links/month, 2 QR codes/month, unlimited clicks, no analytics. Core $10/mo billed annually ($120/yr, 100 links/mo, 30-day history). Growth $35/mo ($348/yr, custom domain included). Premium $300/mo ($2,388/yr).

Open dossier