Scanning the Orphan Pages<\/h2><\/span><\/div><\/div><\/div>Understanding the importance of identifying Orphan pages let’s see the procedure to follow with the Seo Spider:<\/p>\n
\n- Setting up XML Sitemap Scanning<\/strong><\/li>\n<\/ul>\n
Preliminarily, you need to enable the “Crawl Linked XML Sitemaps” option to scan the sitemap of your website.<\/p>\n<\/div><\/div><\/div><\/div><\/div>
Config > Spider > Crawl > Crawl Linked XML Sitemaps<\/span><\/p>\n<\/div><\/div><\/div><\/div><\/div>![](\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/Analisi-delle-sitemap-con-seo-spider.png\")
<\/a><\/span><\/div>\n- Connecting to the Google Analytics API<\/strong><\/li>\n<\/ul>\n
Configures the connection to the Google Analytics API, to find Orphan Pages from the organic search of a specific Account, Property or View.<\/p>\n
Remember to choose the “Organic Traffic” segment, set and customize the date range to be analyzed (Data Range), which by default is one month, and define the metrics and dimensions of your interest.<\/p>\n<\/div>
![](\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/orphan-pages-su-google-analytics.jpeg\")
<\/a><\/span><\/div>Remember to enable the “Crawl New URLs Discovered in Google Analytics” option. If this option is disabled, URLs discovered via Google Analytics are only available in the “Orphan Pages” report. They will not be added to the scan queue, viewable within the user interface and will appear under the respective tabs and filters.<\/p>\n
\n- 3. Connecting to the Search Console API.<\/strong><\/li>\n<\/ul>\n
You will also be able to connect to the Google Search Console API to find all pages that despite having no internal link to the website are receiving Impressions and Clicks in a certain time interval<\/p>\n<\/div>
![](\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/orphan-pages-con-api-google-search-console.jpeg\")
<\/a><\/span><\/div>Again, it is possible to change the reference date on which to collect data. Similarly to Google Analytics, if this option is not enabled, new URLs discovered via Google Search Console will only be available in the “Orphan Pages” report. They will not be added to the scan queue, viewable within the user interface and will appear under the respective tabs and filters.<\/p>\n
\n- 4. Start the crawl and populate the data with Crawl Analysis.<\/li>\n<\/ul>\n
Once you have completed the configuration step, all you have to do is run the scan and activate “Crawl Analysis” (if you have not already automated it previously from the configurations).<\/p>\n<\/div>
![](\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/Crawl-Analysis-e-pagine-orfane.png\")
<\/a><\/span><\/div>Completed these tasks you will be able to browse each tab and its respective ‘Orphan URLs’ filter to view all discovered orphan pages.<\/p>\n
Let us put what we have just described into practice by scanning the Screaming Frog site.<\/p>\n
We’re going to set it up to crawl the XML Sitemap and connect it to the Google Search Console API.<\/p>\n<\/div>
<\/div><\/div><\/span>XML Sitemap<\/h3><\/span><\/div><\/div><\/div>![](\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/orphan-pages-scheda-sitemap.jpeg\" "\\"orphan")
<\/span><\/div>From the example above you can see that the Screaming Frog site has some orphan pages (Tab Sitemap) that were discovered by the XML Sitemap crawl.<\/p>\n
In this case, the pages have a 404 and 301 status code and may represent old pages that were not removed from the XML Sitemap after the new portal was published.<\/p>\n<\/div>
<\/div><\/div><\/span>API Search Console<\/h3><\/span><\/div><\/div><\/div>By connecting the Screaming Frog site to the Search Console API (figure below) you can see that, unlike the previous case (analysis with sitemap.xml), orphan pages are still present in the website (status code 200) and receive Impressions from Google despite having no internal links.<\/p>\n<\/div>
![](\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/orphan-pages-tab-search-console.jpeg\")
<\/a><\/span><\/div>Remember Well: both Google connectors allow you to export results individually simply with the “Export” button on the top window of the Seo Spider.<\/p>\n
If you prefer to get an overview of all the Orphan Pages discovered by Google Analytics, Search Console and Sitemap.xml you can use the “Orphan pages” report, a document found in the main menu.<\/p>\n<\/div>
Understanding the importance of identifying Orphan pages let’s see the procedure to follow with the Seo Spider:<\/p>\n
- \n
- Setting up XML Sitemap Scanning<\/strong><\/li>\n<\/ul>\n
Preliminarily, you need to enable the “Crawl Linked XML Sitemaps” option to scan the sitemap of your website.<\/p>\n<\/div><\/div><\/div><\/div><\/div>
Config > Spider > Crawl > Crawl Linked XML Sitemaps<\/span><\/p>\n<\/div><\/div><\/div><\/div><\/div>
<\/a><\/span><\/div>- \n
- Connecting to the Google Analytics API<\/strong><\/li>\n<\/ul>\n
Configures the connection to the Google Analytics API, to find Orphan Pages from the organic search of a specific Account, Property or View.<\/p>\n
Remember to choose the “Organic Traffic” segment, set and customize the date range to be analyzed (Data Range), which by default is one month, and define the metrics and dimensions of your interest.<\/p>\n<\/div>
<\/a><\/span><\/div>Remember to enable the “Crawl New URLs Discovered in Google Analytics” option. If this option is disabled, URLs discovered via Google Analytics are only available in the “Orphan Pages” report. They will not be added to the scan queue, viewable within the user interface and will appear under the respective tabs and filters.<\/p>\n
- \n
- 3. Connecting to the Search Console API.<\/strong><\/li>\n<\/ul>\n
You will also be able to connect to the Google Search Console API to find all pages that despite having no internal link to the website are receiving Impressions and Clicks in a certain time interval<\/p>\n<\/div>
<\/a><\/span><\/div>Again, it is possible to change the reference date on which to collect data. Similarly to Google Analytics, if this option is not enabled, new URLs discovered via Google Search Console will only be available in the “Orphan Pages” report. They will not be added to the scan queue, viewable within the user interface and will appear under the respective tabs and filters.<\/p>\n
- \n
- 4. Start the crawl and populate the data with Crawl Analysis.<\/li>\n<\/ul>\n
Once you have completed the configuration step, all you have to do is run the scan and activate “Crawl Analysis” (if you have not already automated it previously from the configurations).<\/p>\n<\/div>
<\/a><\/span><\/div>Completed these tasks you will be able to browse each tab and its respective ‘Orphan URLs’ filter to view all discovered orphan pages.<\/p>\n
Let us put what we have just described into practice by scanning the Screaming Frog site.<\/p>\n
We’re going to set it up to crawl the XML Sitemap and connect it to the Google Search Console API.<\/p>\n<\/div>
<\/div><\/div><\/span>XML Sitemap<\/h3><\/span>
<\/div><\/div><\/div><\/span><\/div>From the example above you can see that the Screaming Frog site has some orphan pages (Tab Sitemap) that were discovered by the XML Sitemap crawl.<\/p>\n
In this case, the pages have a 404 and 301 status code and may represent old pages that were not removed from the XML Sitemap after the new portal was published.<\/p>\n<\/div>
<\/div><\/div><\/span>API Search Console<\/h3><\/span>
<\/div><\/div><\/div>By connecting the Screaming Frog site to the Search Console API (figure below) you can see that, unlike the previous case (analysis with sitemap.xml), orphan pages are still present in the website (status code 200) and receive Impressions from Google despite having no internal links.<\/p>\n<\/div>
<\/a><\/span><\/div>Remember Well: both Google connectors allow you to export results individually simply with the “Export” button on the top window of the Seo Spider.<\/p>\n
If you prefer to get an overview of all the Orphan Pages discovered by Google Analytics, Search Console and Sitemap.xml you can use the “Orphan pages” report, a document found in the main menu.<\/p>\n<\/div>
- 4. Start the crawl and populate the data with Crawl Analysis.<\/li>\n<\/ul>\n
- 3. Connecting to the Search Console API.<\/strong><\/li>\n<\/ul>\n
- Connecting to the Google Analytics API<\/strong><\/li>\n<\/ul>\n