TAB URL

Tab for the analysis and management of the most important and recurring criticalities of URLs.

Analysis tab URLs

The tab presents details about the URLs discovered during the crawl and their respective problems.

  • Address: identifies the URL being scanned.
  • Content Type: returns the content type of the URL.
  • Status code: the HTTP response code.
  • Status Code: the HTTP header response.
  • Indexability: whether the URL is indexable or non-indexable.
  • Indexability Status: the reason why a URL is not indexable.
  • Hash: serial value of each page to identify any duplicate content.
  • Length: the length of the URL calculated by characters.
  • Canonical 1: the canonical data of the link element.
  • URL Encoded Address: the URL actually requested by the Seo Spider. All non-ASCII characters are percentage-encoded, according to RFC 3986.
Tab Url nella schermata principale di Screaming Frog

Filters

To analyze the collected data you can use one of the 9 filters provided:

  • Non ASCII Characters: URLs are shown that contain attributes that are not included in the ASCII character set. URLs must be converted to a valid ASCII format by encoding URL links with secure characters (consisting of % followed by two hexadecimal digits). Today’s browsers and Search Engines are largely capable of accurately transforming and adapting URLs automatically.
  • Underscores: URLs have the “underscore” symbol (“_”) inside them. At the Seo level, these characters are not always interpreted by the Search Engine as word separators and could penalize indexing. We recommend the use of the “-” symbol between words to identify the space between queries to be indexed.
  • Uppercase: show URLs that have uppercase characters in them. URLs are case-sensitive, so as a best practice, URLs should generally be lowercase to avoid any potential confusion and duplication.
  • Multiply Slashes: the URL has multiple slashes in the “path” (example: screamingfrog.co.uk/seo//).
  • Repetitive Path: the URL has a repeated path in the string (example: screamingfrog.co.uk/seo/seo/, or screamingfrog.co.uk/services/seo/technical/seo/). In some cases this may be legitimate and logical for the structure of the website, but it may be redundant and seen as “overstuffing” by the Search Engine. This filter can also help you identify problems with incorrect relative links, which could cause infinite URLs.
  • Contains a Space: URLs that have a space within them are displayed. These are considered unsafe and could cause the link to break when shared. Hyphens should be preferred to spaces as separators.
  • Internal Search: the URL could be part of the site’s internal search function. Google and other Search Engines recommend blocking internal search pages from crawling, and links to it should include a “nofollow” link attribute.
  • Parameters: the URL includes parameters such as ‘?’ or ‘&’. This is not a problem for Google, but it is recommended to limit the number of parameters in a URL that may be complicated for users, and could be considered low value-added.
Seo Spider Tab