Home›Screaming Frog Guides
Practical guides and video tutorials
Screaming Frog Guides.
Step-by-step guides and video tutorials to use SEO Spider’s advanced features and run SEO audits with confidence.
How the articles work.
Every guide starts from a real problem and solves it inside SEO Spider, with menu paths, annotated screenshots and, when useful, a video. Pick by level or topic, or search for the feature you need.
- VideoVideo tutorialIncludes the step-by-step video.
- No videoText onlyWritten article with screenshots.
- LevelBeginner, intermediate or advanced.
Topic
→All articles.46 guides
01.Intermediate Screaming Frog MCP ServerHow to connect SEO Spider to Claude and other AI assistants and run crawls and analysis by simply asking Read13 min No video Read the guide 02.Advanced How to Open Screaming Frog Crawls Directly in PythonQuery pages, links, report tabs and raw SQL from a .dbseospider file with the screamingfrog library, without exporting a single CSV Read12 min No video Updated on 20.10.2026 03.Intermediate SEO Embeddings with Screaming FrogA practical guide to semantic analysis Read12 min No video Updated on 15.10.2026 04.Intermediate Log Files and SEOHow to use log files to optimise a website’s SEO Read12 min No video Updated on 15.10.2026 05.Beginner Screaming Frog for TeamsLearn how to share Screaming Frog data with your team Read4 min No video Updated on 15.10.2026 06.Intermediate What Is Web Scraping?How to scrape SERPs with Screaming Frog’s Custom Extraction. Read11 min No video Read the guide 07.Beginner Crawl ProfilesHow to use custom profiles and customise your crawls with Screaming Frog Read3 min Video Read the guide 08.Beginner How to Debug Invalid HTML in the Head?Learn how to debug invalid HTML in the head Read6 min No video Updated on 16.10.2026 09.Beginner How to Optimise Anchor TextLearn how to analyse, define and optimise anchor text for the spider. Read8 min No video Read the guide 10.Beginner Blocked by robots.txt?Learn how to analyse the effects of robots.txt directives Read2 min No video Read the guide 11.Advanced Lazy Loading and XPathAnalysing lazy loading with Screaming Frog’s advanced XPath feature. Read3 min No video Read the guide 12.Intermediate Finding Spam LinksHow to find spam links on your site with SEO Spider after a hack. Read2 min No video Read the guide 13.Intermediate Engagement ScoreLearn how to use your website’s engagement score and get clean data for your strategy. Read1 min Video Read the guide 14.Intermediate Crawl VisualisationLearn how to use Crawl Visualisation for quick, visual analysis. Read2 min Video Read the guide 15.Intermediate E-commerce AnalysisHow to analyse an e-commerce site with Screaming Frog and improve its rankings in search engines. Read1 min Video Read the guide 16.Intermediate URL Inspection APIDiscover the URL Inspection API for ever more efficient and granular reports. Read7 min Video Read the guide 17.Intermediate Web ScrapingLearn how to use web scraping and the Custom Extraction feature for advanced analysis. Read3 min Video Read the guide 18.Intermediate SEO Parity AuditLearn how to analyse different versions of your website and fix any issues. Read9 min No video Updated on 16.10.2026 19.Intermediate URL RewritingLearn how to remove parameters and session IDs for more precise, effective SEO audits. Read2 min No video Updated on 13.10.2026 20.Intermediate Crawling Staging SitesLearn how to run an SEO audit of a staging website and be ready for go-live. Read4 min Video Updated on 16.10.2026 21.Beginner Crawling SubfoldersLearn how to analyse a specific subfolder for a focused, efficient SEO audit. Read2 min No video Updated on 19.10.2026 22.Advanced Automated Crawl Audits with Data StudioLearn how to set up Screaming Frog SEO Spider to produce automated audits for Google Data Studio. Read5 min Video Updated on 14.10.2026 23.Advanced Comparing Data from 2 CrawlsCompare two crawls with Screaming Frog SEO Spider and analyse how crawl data has changed across tabs and filters over time. Read8 min Video Updated on 13.10.2026 24.Intermediate Cookie SEO AuditLearn how to analyse cookies and monitor the reports with Screaming Frog. Read4 min Video Updated on 16.10.2026 25.Intermediate SEO Spider Crawl ProblemsHow to deal with potential SEO Spider crawl problems. Read7 min No video Updated on 19.10.2026 26.Intermediate Link ScoreAnalyse the PageRank of every page on your website with Screaming Frog’s Link Score Read2 min Video Read the guide 27.Intermediate Broken LinksHow to analyse and manage broken links to improve UX and avoid wasting crawl budget. Read2 min Video Read the guide 28.Intermediate Broken BookmarksHow to audit and manage broken bookmarks. Read2 min Video Read the guide 29.Advanced Analysing JavaScript WebsitesHow to analyse websites with JavaScript content that could get in the way of search engine bots. Read15 min Video Read the guide 30.Intermediate Structured Data AnalysisAnalysing structured data and monitoring opportunities and warnings with SEO Spider. Read4 min Video Read the guide 31.Intermediate Redirect SEO AuditHow to analyse redirects with Screaming Frog and avoid wasted crawl budget and redirect chains. Read2 min Video Read the guide 32.Intermediate List Crawl ModeHow to make the most of Screaming Frog’s “List” crawl mode Read4 min No video Read the guide 33.Advanced SEO MigrationLearn how to run a flawless migration with Screaming Frog without losing search engine rankings. Read10 min Video Read the guide 34.Advanced Web Vitals AnalysisAnalysing Core Web Vitals and monitoring on-page optimisation opportunities Read10 min Video Read the guide 35.Intermediate Duplicate Content AnalysisAnalysis and best practices to avoid duplicate content and keep your search engine rankings. Read5 min Video Read the guide 36.Intermediate AMP AnalysisAnalysing a website’s AMP version and handling its issues. Read3 min Video Read the guide 37.Intermediate Crawling Alt TextAnalysing image alt text to avoid search engine penalties. Read3 min Video Read the guide 38.Intermediate HTML PaginationLearn how to make the most of pagination and improve UX. Read2 min Video Read the guide 39.Advanced Crawling Password-Protected SitesLearn how to analyse staging sites or sites that require a password to view and crawl them. Read2 min No video Read the guide 40.Advanced Link Position AnalysisAnalysing link position to manage broken links and internal ranking. Read5 min Video Read the guide 41.Intermediate Orphan PagesAnalysing and monitoring orphan pages to improve your website’s internal linking. Read3 min Video Read the guide 42.Intermediate Custom SearchChecking for any element in a website’s HTML with Custom Search. Read4 min Video Read the guide 43.Advanced CanonicalAnalysing the canonical attribute and best practices to avoid duplicate content. Read3 min Video Read the guide 44.Intermediate Scheduled CrawlsHow to run a scheduled crawl with Screaming Frog. Read2 min Video Read the guide 45.Beginner Crawling Large WebsitesHow to crawl large websites with "Database Storage" mode and a few tricks. Read5 min Video Read the guide 46.Advanced Custom ExtractionDiscover Custom Extraction to collect custom data from the HTML code. Read3 min Video Read the guide
No results.Try another term or remove some filters.
What I can do for you
Want an expert by your side?
The guides will take you a long way. If you’d like a tailored path, SEO Spider training or support on a project, get in touch.
Screaming Frog trainingSEO Spider beta tester
Author.Raffaele Visintin.Search & Strategic Marketing AdvisorSF ClubBeta tester · SEO Spider
→Other Club sections.3 sections
01.SEO Spider
Screaming Frog Overview: Every SEO Spider tab explained: top and bottom tabs, side panel, filters and reports.
Articles25
Explore the section
02.SEO Spider versions
Screaming Frog Updates: The new features in every SEO Spider release and how to use them for faster, deeper audits.
Articles8
Explore the section
03.SEO
SEO Wiki: Attributes, tags and best practices that, directly or indirectly, affect rankings in search engines.
Articles13
Explore the section
