{"id":4991,"date":"2024-07-11T10:42:42","date_gmt":"2024-07-11T10:42:42","guid":{"rendered":"http:\/\/screamingfrog.club\/log-file-and-the-seo\/"},"modified":"2024-07-11T12:18:07","modified_gmt":"2024-07-11T12:18:07","slug":"log-file-and-the-seo","status":"publish","type":"post","link":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/","title":{"rendered":"Log File and the Seo"},"content":{"rendered":"<div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-1 fusion-flex-container has-pattern-background has-mask-background nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;\" ><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"max-width:1248px;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:20px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-title title fusion-title-1 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">What are Log Files?<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-1\"><div class=\"flex-shrink-0 flex flex-col relative items-end\">\n<div>\n<div class=\"pt-0.5 juice:pt-0\">\n<div class=\"gizmo-bot-avatar flex h-6 w-6 items-center justify-center overflow-hidden rounded-full juice:h-8 juice:w-8\">\n<div class=\"relative p-1 rounded-sm flex items-center justify-center bg-token-main-surface-primary text-token-text-primary h-8 w-8\">When we talk about analyzing web server logs, we are referring to<strong>access logs (Access Logs<\/strong>).<br \/>\nWeb servers also produce other log files, such as error logs, but for purely SEO analysis we only need logs of access<span style=\"color: var(--awb-text-color); font-family: var(--awb-text-font-family); font-size: var(--awb-font-size); font-style: var(--awb-text-font-style); font-weight: var(--awb-text-font-weight); letter-spacing: var(--awb-letter-spacing); text-align: var(--awb-content-alignment); text-transform: var(--awb-text-transform); background-color: var(--awb-bg-color-hover);\"> to a website<\/span>.<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"group\/conversation-turn relative flex w-full min-w-0 flex-col agent-turn\">\n<div class=\"flex-col gap-1 md:gap-3\">\n<div class=\"flex flex-grow flex-col max-w-full\">\n<div class=\"min-h-&#091;20px&#093; text-message flex flex-col items-start whitespace-pre-wrap break-words &#091;.text-message+&amp;&#093;:mt-5 juice:w-full juice:items-end overflow-x-auto gap-2\" dir=\"auto\" data-message-author-role=\"assistant\" data-message-id=\"a9211efd-0388-4a6d-a122-e453c5543f89\">\n<div class=\"flex w-full flex-col gap-1 juice:empty:hidden juice:first:pt-&#091;3px&#093;\">\n<div class=\"markdown prose w-full break-words dark:prose-invert dark\">\n<p>Typically, the file is presented with one line per request, which will include some or all of the following data:<\/p>\n<ul>\n<li>Time of request;<\/li>\n<li>URL required;<\/li>\n<li>User agent provided during the request;<\/li>\n<li>Web site response code;<\/li>\n<li>Response size;<\/li>\n<li>IP address of the client that made the request;<\/li>\n<li>Time taken to serve the request;<\/li>\n<li>Referrer, the page that provided the link to make the request.<\/li>\n<\/ul>\n<p>Having an accurate record of all requests received by a web server is extremely useful because it allows for very efficient and versatile analysis to find errors, critical issues, and evaluate the project architecture.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><div class=\"fusion-title title fusion-title-2 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Why analyze Log Files?<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-2\"><p><strong>Log files<\/strong> are an incredibly powerful, but still underutilized, way to gain valuable information about how each <b>Search Engine<\/b> crawls your site.<\/p>\n<p>This is why every Seo should analyze them even though access logs might be difficult to obtain from the client (and\/or the hosting provider, server, and development team).<\/p>\n<p>Analysis of log files can help you obtain the following results:<\/p>\n<ol>\n<li>Verify exactly what can and cannot be scanned. A crawl is a simulation, whereas log files show exactly what was scanned (full story).<\/li>\n<li>Visualize the responses encountered by search engines as they crawl (and compare the data in different scans over time). With Log Files analysis, problems can be <u>qualitatively<\/u> defined. If you find several 404s on your site during a crawl, it is difficult to tell which ones are the most important; by analyzing the log files, you can see how often they occurred, helping you prioritize their resolution.<\/li>\n<li>Identify crawling deficiencies, which could have broader implications at the site level (such as hierarchy or internal link structure).<\/li>\n<li>See which pages the search engines prioritize and consider the most important and which could be optimized to achieve a more consonant crawl rate. This condition is underestimated, but it is often the case that the strategic vision of the website does not match the responses of the Search Engine.<\/li>\n<li>Discover areas of wasted Crawl Budget (Crawl Budget).<\/li>\n<li>See Orphan URLs. If a URL is not internally linked, it will not be found by scanning the site. URLs linked only externally (or historically) will be reported in the logs allowing them to be managed, optimized or deleted.<\/li>\n<li>View changes over time. A crawl is a snapshot of the moment, while log files provide historical information about each resource.<\/li>\n<\/ol>\n<p>By analyzing this invaluable data you will be able to preserve the Crawling Budget and define what elements are negatively impacting BOT navigation.<br \/>\nWe see below some very common critical issues:<\/p>\n<ul>\n<li>Faceted browsing and session identifiers.<\/li>\n<li>Duplicate content on the site.<\/li>\n<li>Soft error pages.<\/li>\n<li>Hacked pages.<\/li>\n<li>Infinite spaces and proxies.<\/li>\n<li>Low quality content and spam.<\/li>\n<\/ul>\n<p>Therefore, it is useful to avoid having the BOT waste time and energy in scanning such URLs, as it reduces activity and causes delays in scanning the most important pages.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-3 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Log File Analyser<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-3\"><p>The basis of log file analysis is to be able to verify exactly which URLs have been scanned by search engine bots. Through<strong>&#8220;Log File Analyser<\/strong>&#8221; you can import your log files by simply dragging and dropping the file of directly into the interface and automatically check Search Engine bots.<\/p>\n<p>After importing you can use the &#8220;Verification Status&#8221; filter to display only verified ones and the &#8220;User-Agent&#8221; filter to get &#8220;all bots&#8221; or isolate a particular bot such as &#8220;Googlebot&#8221; or &#8220;Googlebot for smartphones&#8221; for granular analysis.<\/p>\n<p>After this very simple and intuitive setup you will get exactly the URLs that have been scanned by the Bot filtered in the &#8220;URLs&#8221; tab classifying them by the number of events generated in a given time period.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-1 hover-type-none\"><a href=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/identify-crawled-urls-dude.jpg\" class=\"fusion-lightbox\" data-rel=\"iLightbox[9d6e4da6e9eea8e8d87]\" data-title=\"identify-crawled-urls-dude\" title=\"identify-crawled-urls-dude\"><img decoding=\"async\" width=\"850\" height=\"529\" alt=\"Log file analyser, importazione dei log\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/identify-crawled-urls-dude.jpg\" class=\"img-responsive wp-image-4908\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/identify-crawled-urls-dude-200x124.jpg 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/identify-crawled-urls-dude-400x249.jpg 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/identify-crawled-urls-dude-600x373.jpg 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/identify-crawled-urls-dude-800x498.jpg 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/identify-crawled-urls-dude.jpg 850w\" sizes=\"(max-width: 640px) 100vw, 850px\" \/><\/a><\/span><\/div><div class=\"fusion-title title fusion-title-4 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Identify low URL Value<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-4\"><p>Content for Seo is one of the most important ranking elements, and understanding which URLs are crawled and their frequency can help you uncover potential areas of wasted &#8220;Crawling Budget&#8221; that perhaps have &#8220;facetted navigation,&#8221; session IDs or duplicate content.<\/p>\n<p>For example, through the tool&#8217;s search bar you might look for the presence of a question mark (?) in the &#8220;Path URL&#8221; (frequently found in e-commerce with filters), which will help you identify URLs with parameters that are perhaps not &#8220;canonicalized&#8221; and frequently browsed by the Google Bot.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-2 hover-type-none\"><img decoding=\"async\" width=\"850\" height=\"417\" alt=\"Url con parametri\" title=\"parameter-urls\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/parameter-urls.jpg\" class=\"img-responsive wp-image-4913\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/parameter-urls-200x98.jpg 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/parameter-urls-400x196.jpg 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/parameter-urls-600x294.jpg 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/parameter-urls-800x392.jpg 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/parameter-urls.jpg 850w\" sizes=\"(max-width: 640px) 100vw, 850px\" \/><\/span><\/div><div class=\"fusion-text fusion-text-5\" style=\"--awb-margin-top:20px;\"><p>As you can see in the example above the first entry generated 57 events corresponding to WordPress comments, so not exactly a high-value resource. In this specific case, it will be sufficient to disable comments to resolve this scenario and safeguard the Crawl Budget.<\/p>\n<p>Clicking on the &#8220;URL&#8221; column header will allow you to sort them alphabetically and discover URLs that differ only by session id or parameters that should not be available to the BOT scan.<\/p>\n<p>Clicking on &#8220;Num Events&#8221; will give you the resources that have, over a time interval, a higher and lower scanning frequency.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-5 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Scan Frequency Analysis<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-6\"><p>The frequency with which Googlebot requests a page is based on a number of factors such as the freshness of the content or the &#8220;Ranking&#8221; attributed by Google to one resource in relation to others. Although this concept is trivialized, it is very useful to analyze the number of events per URL as an indicator to help you identify any underlying problems among resources.<\/p>\n<p>Through the filters in the main bar menu you will also be able to choose which events are generated by the individual Spider considering also Bots such as Bing, Yandex or others that could affect the data and create &#8220;false positives&#8221; in strategic analysis or drastically burden the server load.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-3 hover-type-none\"><img decoding=\"async\" width=\"1338\" height=\"772\" alt=\"Analisi della Tab URL del software log file analyser\" title=\"Analisi-log-tab-url\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-log-tab-url.png\" class=\"img-responsive wp-image-4917\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-log-tab-url-200x115.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-log-tab-url-400x231.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-log-tab-url-600x346.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-log-tab-url-800x462.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-log-tab-url-1200x692.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-log-tab-url.png 1338w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/span><\/div><div class=\"fusion-text fusion-text-7\"><p>Leaving the default &#8220;All BOT&#8221; setting instead will give you an overview of events processed by URL and a division of Spiders by scrolling to the right in the Tab.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-4 hover-type-none\"><img decoding=\"async\" width=\"1636\" height=\"438\" alt=\"Analisi degli eventi generati da tutti gli Spider con log file analyser\" title=\"Analisi All Bot con log file analyser\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-All-Bot-con-log-file-analyser.png\" class=\"img-responsive wp-image-4922\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-All-Bot-con-log-file-analyser-200x54.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-All-Bot-con-log-file-analyser-400x107.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-All-Bot-con-log-file-analyser-600x161.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-All-Bot-con-log-file-analyser-800x214.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-All-Bot-con-log-file-analyser-1200x321.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/Analisi-All-Bot-con-log-file-analyser.png 1636w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/span><\/div><div class=\"fusion-title title fusion-title-6 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Scanning Frequency Subdirectory<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-8\"><p>The next step in analyzing log files is to consider subdirectories (Directory Tab).<br \/>\nIn this way, it will be possible to understand any performing areas or areas to be optimized that perhaps have critical issues that do not allow the crawler to navigate in a linear fashion.<\/p>\n<p>With a focus of the subfolders you will be able to discover any &#8220;Waste Area.&#8221;<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-5 hover-type-none\"><a href=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/file-di-log-delle-directory.png\" class=\"fusion-lightbox\" data-rel=\"iLightbox[f31351b066a9845ca60]\" data-title=\"file di log delle directory\" title=\"file di log delle directory\"><img decoding=\"async\" width=\"1719\" height=\"448\" alt=\"Analisi dei file di log delle sotto directory\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/file-di-log-delle-directory.png\" class=\"img-responsive wp-image-4928\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/file-di-log-delle-directory-200x52.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/file-di-log-delle-directory-400x104.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/file-di-log-delle-directory-600x156.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/file-di-log-delle-directory-800x208.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/file-di-log-delle-directory-1200x313.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/file-di-log-delle-directory.png 1719w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/a><\/span><\/div><div class=\"fusion-title title fusion-title-7 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Scanning Frequency Content<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-9\"><p>While log files per se do not contain a content type, the Log File Analyser analyzes URLs for the most common formats and allows you to easily filter crawl frequency by content type, whether it is HTML, images, JavaScript, CSS, PDF, etc.<\/p>\n<p>Through this analysis scenario you will be able to interpret how much time Google spends proportionally crawling each type of content.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-6 hover-type-none\"><img decoding=\"async\" width=\"764\" height=\"876\" alt=\"Analisi dei file di Log suddivisi per tipologia di contenuto\" title=\"analisi log file dei contenuti\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-log-file-dei-contenuti-.png\" class=\"img-responsive wp-image-4933\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-log-file-dei-contenuti--200x229.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-log-file-dei-contenuti--400x459.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-log-file-dei-contenuti--600x688.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-log-file-dei-contenuti-.png 764w\" sizes=\"(max-width: 640px) 100vw, 764px\" \/><\/span><\/div><div class=\"fusion-title title fusion-title-8 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Scan Frequency per User Agent<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-10\"><p>Another point of analysis is related to crawl frequencies based on different user-agents, which will be able to help you understand the respective performance of each individual Search Engine.<\/p>\n<p>Based on this index, it will be possible to define the number of unique URLs crawled in the time period analyzed by providing a rough indication of the time it might take each search engine to crawl all URLs on the site. This will give you an overview of the &#8220;Crawl Budget&#8221; (Crawl Rate) that is devoted to your online project.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-7 hover-type-none\"><a href=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-file-di-log-attraverso-user-agent.png\" class=\"fusion-lightbox\" data-rel=\"iLightbox[75275770423656d0e23]\" data-title=\"analisi file di log attraverso user agent\" title=\"analisi file di log attraverso user agent\"><img decoding=\"async\" width=\"766\" height=\"881\" alt=\"Analisi File di Log attraverso User Agent differenti\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-file-di-log-attraverso-user-agent.png\" class=\"img-responsive wp-image-4937\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-file-di-log-attraverso-user-agent-200x230.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-file-di-log-attraverso-user-agent-400x460.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-file-di-log-attraverso-user-agent-600x690.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/analisi-file-di-log-attraverso-user-agent.png 766w\" sizes=\"(max-width: 640px) 100vw, 766px\" \/><\/a><\/span><\/div><div class=\"fusion-text fusion-text-11\"><p>Very interesting to understand the behavior of various Bots but especially vital if the behavior of &#8220;Googlebot&#8221; and &#8220;Googlebot for smartphone&#8221; is diversified. For example, you will be able to understand whether there are bottlenecks in the mobile version or understand whether the site is considered &#8220;mobile first indexing.&#8221;<\/p>\n<\/div><div class=\"fusion-title title fusion-title-9 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">URL Crawl per day, week, and month<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-12\"><p>Through the &#8220;Overview&#8221; function you will have a timely summary of the overall events of the selected period with a very visual and intuitive dashboard.<\/p>\n<p>Another point of view when analyzing log files is to consider the total number of unique URLs that were crawled, as well as the number of unique URLs crawled each day. In this case, it will then be possible to estimate how many days it might take the Search Engines to fully re-crawl all your URLs.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-8 hover-type-none\"><img decoding=\"async\" width=\"766\" height=\"880\" alt=\"Tab Panoramica di Log File Analyser\" title=\"panoramica dei file di log\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/panoramica-dei-file-di-log.png\" class=\"img-responsive wp-image-4941\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/panoramica-dei-file-di-log-200x230.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/panoramica-dei-file-di-log-400x460.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/panoramica-dei-file-di-log-600x689.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/panoramica-dei-file-di-log.png 766w\" sizes=\"(max-width: 640px) 100vw, 766px\" \/><\/span><\/div><div class=\"fusion-text fusion-text-13\" style=\"--awb-margin-top:20px;\"><p>The dashboard allows you to export graph data in &#8220;.csv&#8221; format and, by hovering over the graph nodes see granularly the log results according to different user-agents or status codes..<\/p>\n<\/div><div class=\"fusion-title title fusion-title-10 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">404 Analysis and Server Errors<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-14\"><p>Logs allow you to quickly analyze the last response code that Search Engines encountered for each URL that was crawled.<\/p>\n<p>In the &#8220;response codes&#8221; tab, you can use the filter to view 4XX client errors to discover broken links, or 5XX server errors.<\/p>\n<p>You can also see which URLs are potentially the most important to fix, as they are sorted by crawling frequency.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-11 fusion-title-center fusion-title-text fusion-title-size-four\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h4 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">404 Analysis: Screaming Frog or Log File?<\/h4><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-15\"><p>Screaming Frog allows you to analyze all links present and any 404 errors between internal links or to external resources but is limited to that.<\/p>\n<p>With log files, one can also identify URLs that are no longer present on the project under analysis but perhaps had been indexed in Google&#8217;s database in earlier versions of the website (not covered by previous seo migrations).<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-9 hover-type-none\"><a href=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-di-log-analisi-errori-404.png\" class=\"fusion-lightbox\" data-rel=\"iLightbox[240e6a750a1b281688f]\" data-title=\"File di log analisi errori 404\" title=\"File di log analisi errori 404\"><img decoding=\"async\" width=\"1208\" height=\"492\" alt=\"Analisi degli errori 404 attraverso i file di Log\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-di-log-analisi-errori-404.png\" class=\"img-responsive wp-image-4947\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-di-log-analisi-errori-404-200x81.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-di-log-analisi-errori-404-400x163.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-di-log-analisi-errori-404-600x244.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-di-log-analisi-errori-404-800x326.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-di-log-analisi-errori-404-1200x489.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-di-log-analisi-errori-404.png 1208w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/a><\/span><\/div><div class=\"fusion-text fusion-text-16\"><p>At this stage of analysis, it is important to remember to check the &#8220;Last Response&#8221; box next to the 4xx filter, otherwise the &#8220;Log File Analyser&#8221; will present all URLs that have a corresponding event over time (rather than just the &#8220;Last Response&#8221;\/<strong>&#8220;Last Response<\/strong>&#8220;) sometimes giving a nonconforming result since the error may have already been resolved since the first day you started logging files.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-12 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Inconsistent Responses<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-17\"><p>A very interesting filter that echoes what was mentioned in the previous point is &#8220;incosistent,&#8221; which helps you identify which resources have inconsistent responses among the results; for example, because a broken link was later corrected, or because the site has more internal server errors under load conditions and there is an intermittent problem that needs to be investigated.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-10 hover-type-none\"><img decoding=\"async\" width=\"1207\" height=\"357\" alt=\"Utilizzo del filtro Incosistent con Log file analyser\" title=\"File log con filtro Incosistent\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-log-con-filtro-Incosistent.png\" class=\"img-responsive wp-image-4952\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-log-con-filtro-Incosistent-200x59.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-log-con-filtro-Incosistent-400x118.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-log-con-filtro-Incosistent-600x177.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-log-con-filtro-Incosistent-800x237.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-log-con-filtro-Incosistent-1200x355.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/File-log-con-filtro-Incosistent.png 1207w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/span><\/div><div class=\"fusion-title title fusion-title-13 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Audit Redirect<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-18\"><p>Through the log records, it will be possible to view all URLs that search engines request and receive a redirect as a response.<\/p>\n<p>This not only includes redirects that are present on the site, but also historical redirects that are still requested from time to time, perhaps due to previous migrations.<\/p>\n<p>To view Urls with status code 3xx it will be sufficient to use the related tab with the filter &#8220;Redirection (3XX),&#8221; along with the &#8220;Last Reply&#8221; box.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-14 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Bot Spoofed<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-19\"><p>The IP tab and the &#8220;verification status&#8221; filter set to &#8220;spoofed&#8221; allow you to quickly view the IP addresses of requests that emulate search engine bots, using their user-agent string, but without verifying them. Through this data, it will be possible to block scans and, as a result, lighten the work of the server.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-11 hover-type-none\"><img decoding=\"async\" width=\"2382\" height=\"414\" alt=\"Identificazione bot spoofed\" title=\"spoofed bot &#8211; log file analyser\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/spoofed-bot-log-file-analyser.png\" class=\"img-responsive wp-image-4959\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/spoofed-bot-log-file-analyser-200x35.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/spoofed-bot-log-file-analyser-400x70.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/spoofed-bot-log-file-analyser-600x104.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/spoofed-bot-log-file-analyser-800x139.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/spoofed-bot-log-file-analyser-1200x209.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/spoofed-bot-log-file-analyser.png 2382w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/span><\/div><div class=\"fusion-text fusion-text-20\"><p>If you change the &#8220;verification status&#8221; filter to &#8220;verified,&#8221; you can view all the IPs of the verified search engine bots. This can be useful when analyzing websites that have localization-friendly pages and serve different content based on country.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-15 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Identify Large Page Size<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-21\"><p>Another very important element during log file analyses are the different response times of individual resources to Bot requests.<\/p>\n<p>Very heavy and underperforming pages greatly affect the crawling budget, so that by analyzing the &#8220;average bytes&#8221; of URLs, it will be quick and easy to identify areas that need to be optimized.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-12 hover-type-none\"><a href=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/byte-medio-risorse-con-analisi-file-di-log.png\" class=\"fusion-lightbox\" data-rel=\"iLightbox[cfdfd5426fb6b71efed]\" data-title=\"byte medio risorse con analisi file di log\" title=\"byte medio risorse con analisi file di log\"><img decoding=\"async\" width=\"2420\" height=\"986\" alt=\"Analisi del peso medio delle pagine attraverso i file di log\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/byte-medio-risorse-con-analisi-file-di-log.png\" class=\"img-responsive wp-image-4963\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/byte-medio-risorse-con-analisi-file-di-log-200x81.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/byte-medio-risorse-con-analisi-file-di-log-400x163.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/byte-medio-risorse-con-analisi-file-di-log-600x244.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/byte-medio-risorse-con-analisi-file-di-log-800x326.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/byte-medio-risorse-con-analisi-file-di-log-1200x489.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/byte-medio-risorse-con-analisi-file-di-log.png 2420w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/a><\/span><\/div><div class=\"fusion-title title fusion-title-16 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Crawl vs. Log File Analysis<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-22\"><p>One of the most interesting analyses of log files is to compare them with data obtained through a crawl. Through this comparison you will be able to understand whether certain URLs or entire areas of your site are not getting scans by the Spider.<\/p>\n<p>It will be sufficient to download the URLs obtained with a Screaming Frog scan in &#8220;.csv&#8221; format and import them into Log File Analyser, through the<b>&#8220;Not in Log File<\/b>&#8221; filter of the URL tab you will be able to easily find the areas on which to intervene to improve navigability by the BOT, such as Internal Linking.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-13 hover-type-none\"><a href=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/uncrawled-urls.jpg\" class=\"fusion-lightbox\" data-rel=\"iLightbox[06d76ae39a3b58dcf7c]\" data-title=\"uncrawled-urls\" title=\"uncrawled-urls\"><img decoding=\"async\" width=\"850\" height=\"417\" alt=\"Analisi Url non presenti nei log file\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/uncrawled-urls.jpg\" class=\"img-responsive wp-image-4975\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/uncrawled-urls-200x98.jpg 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/uncrawled-urls-400x196.jpg 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/uncrawled-urls-600x294.jpg 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/uncrawled-urls-800x392.jpg 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/07\/uncrawled-urls.jpg 850w\" sizes=\"(max-width: 640px) 100vw, 850px\" \/><\/a><\/span><\/div><div class=\"fusion-text fusion-text-23\" style=\"--awb-margin-top:20px;\"><p>Reversing the<b>&#8220;Not in URL DATA<\/b>&#8221; analysis will have URLs that are present in Bot browsing but not in Screaming Frog scanning; in this scenario you will be able to find all occurrences generated by addresses that are no longer present or Orphan pages that are not linked, but are present in the site being analyzed. The latter point can also be analyzed with the Ga4 and Search Console APIs, which allow finding resources that receive Impressions or visits without being linked internally (e.g., pages with links from external sites).<\/p>\n<\/div><div class=\"fusion-title title fusion-title-17 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Hacking and Log Files<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-24\"><p>Log Files become essential in case of hacking or malware on the site. Many times one realizes that an online project has been compromised too late perhaps through warnings from the search console or due to a drastic drop in Serp due to manual penalties.<\/p>\n<p>In this case, scanning and removing the compromised (&#8220;410&#8221;- gone) URLs may not be enough (instant solution), and the Log files will allow you to see what the real damage of the cyber attack is to the Search Engine and get a full view of the pages or folders created that would continue to do damage if not deleted completely.<\/p>\n<p>A very frequent case could be a &#8220;.php&#8221; code file or something else that intermittently generates new spammy resources; in this case scanning alone would be insufficient while through the log files you would have several alerts over time with relative time for fixes.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-18 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Top Crawled Pages<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-25\"><p>After this in-depth discussion you will surely have understood the importance of Log Files, but I would also like to draw your attention to another aspect other than merely searching for errors.<\/p>\n<p>Knowledge of Logs gives you a 360-degree view of website strategies and architecture. In fact, you could compare the Top Pages for search engines (based on events) and what your most visited pages should be. If there are inconsistencies you will immediately be able to make Internal Linking changes or restructure your architecture or the &#8220;Crawl Depth&#8221; of individual resources and then submit a new sitemap while waiting for the Bot&#8217;s response.<\/p>\n<\/div><\/div><\/div><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":2712,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[38],"tags":[52],"class_list":["post-4991","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-guide-screaming-frog","tag-beginner-en"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Leverage Log File Analysis to Increase Ranking<\/title>\n<meta name=\"description\" content=\"Learn how to leverage Log Files for Web site SEO, find critical issues, and understand what Google browses and values about your project.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Leverage Log File Analysis to Increase Ranking\" \/>\n<meta property=\"og:description\" content=\"Learn how to leverage Log Files for Web site SEO, find critical issues, and understand what Google browses and values about your project.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/\" \/>\n<meta property=\"og:site_name\" content=\"Screaming Frog Club\" \/>\n<meta property=\"article:published_time\" content=\"2024-07-11T10:42:42+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-07-11T12:18:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png\" \/>\n\t<meta property=\"og:image:width\" content=\"600\" \/>\n\t<meta property=\"og:image:height\" content=\"300\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"raffaele.visintin@gmail.com\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"raffaele.visintin@gmail.com\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"13 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/\"},\"author\":{\"name\":\"raffaele.visintin@gmail.com\",\"@id\":\"https:\/\/screamingfrog.club\/en\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73\"},\"headline\":\"Log File and the Seo\",\"datePublished\":\"2024-07-11T10:42:42+00:00\",\"dateModified\":\"2024-07-11T12:18:07+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/\"},\"wordCount\":7879,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/#organization\"},\"image\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png\",\"keywords\":[\"Beginner\"],\"articleSection\":[\"Guide Screaming Frog\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/\",\"url\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/\",\"name\":\"Leverage Log File Analysis to Increase Ranking\",\"isPartOf\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png\",\"datePublished\":\"2024-07-11T10:42:42+00:00\",\"dateModified\":\"2024-07-11T12:18:07+00:00\",\"description\":\"Learn how to leverage Log Files for Web site SEO, find critical issues, and understand what Google browses and values about your project.\",\"breadcrumb\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#primaryimage\",\"url\":\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png\",\"contentUrl\":\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png\",\"width\":600,\"height\":300},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/screamingfrog.club\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Log File and the Seo\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/screamingfrog.club\/en\/#website\",\"url\":\"https:\/\/screamingfrog.club\/en\/\",\"name\":\"Screaming Frog Club\",\"description\":\"Guide e Tutorial sul Seo SPider\",\"publisher\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/screamingfrog.club\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/screamingfrog.club\/en\/#organization\",\"name\":\"Screaming Frog Club\",\"url\":\"https:\/\/screamingfrog.club\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/screamingfrog.club\/en\/#\/schema\/logo\/image\/\",\"url\":\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png\",\"contentUrl\":\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png\",\"width\":117,\"height\":67,\"caption\":\"Screaming Frog Club\"},\"image\":{\"@id\":\"https:\/\/screamingfrog.club\/en\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/screamingfrog.club\/en\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73\",\"name\":\"raffaele.visintin@gmail.com\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"url\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"contentUrl\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"caption\":\"raffaele.visintin@gmail.com\"},\"sameAs\":[\"http:\/\/screamingfrog.club\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Leverage Log File Analysis to Increase Ranking","description":"Learn how to leverage Log Files for Web site SEO, find critical issues, and understand what Google browses and values about your project.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/","og_locale":"en_US","og_type":"article","og_title":"Leverage Log File Analysis to Increase Ranking","og_description":"Learn how to leverage Log Files for Web site SEO, find critical issues, and understand what Google browses and values about your project.","og_url":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/","og_site_name":"Screaming Frog Club","article_published_time":"2024-07-11T10:42:42+00:00","article_modified_time":"2024-07-11T12:18:07+00:00","og_image":[{"width":600,"height":300,"url":"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png","type":"image\/png"}],"author":"raffaele.visintin@gmail.com","twitter_card":"summary_large_image","twitter_misc":{"Written by":"raffaele.visintin@gmail.com","Est. reading time":"13 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#article","isPartOf":{"@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/"},"author":{"name":"raffaele.visintin@gmail.com","@id":"https:\/\/screamingfrog.club\/en\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73"},"headline":"Log File and the Seo","datePublished":"2024-07-11T10:42:42+00:00","dateModified":"2024-07-11T12:18:07+00:00","mainEntityOfPage":{"@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/"},"wordCount":7879,"commentCount":0,"publisher":{"@id":"https:\/\/screamingfrog.club\/en\/#organization"},"image":{"@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#primaryimage"},"thumbnailUrl":"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png","keywords":["Beginner"],"articleSection":["Guide Screaming Frog"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/","url":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/","name":"Leverage Log File Analysis to Increase Ranking","isPartOf":{"@id":"https:\/\/screamingfrog.club\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#primaryimage"},"image":{"@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#primaryimage"},"thumbnailUrl":"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png","datePublished":"2024-07-11T10:42:42+00:00","dateModified":"2024-07-11T12:18:07+00:00","description":"Learn how to leverage Log Files for Web site SEO, find critical issues, and understand what Google browses and values about your project.","breadcrumb":{"@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#primaryimage","url":"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png","contentUrl":"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png","width":600,"height":300},{"@type":"BreadcrumbList","@id":"https:\/\/screamingfrog.club\/en\/log-file-and-the-seo\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/screamingfrog.club\/en\/"},{"@type":"ListItem","position":2,"name":"Log File and the Seo"}]},{"@type":"WebSite","@id":"https:\/\/screamingfrog.club\/en\/#website","url":"https:\/\/screamingfrog.club\/en\/","name":"Screaming Frog Club","description":"Guide e Tutorial sul Seo SPider","publisher":{"@id":"https:\/\/screamingfrog.club\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/screamingfrog.club\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/screamingfrog.club\/en\/#organization","name":"Screaming Frog Club","url":"https:\/\/screamingfrog.club\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/screamingfrog.club\/en\/#\/schema\/logo\/image\/","url":"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png","contentUrl":"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png","width":117,"height":67,"caption":"Screaming Frog Club"},"image":{"@id":"https:\/\/screamingfrog.club\/en\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/screamingfrog.club\/en\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73","name":"raffaele.visintin@gmail.com","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","url":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","contentUrl":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","caption":"raffaele.visintin@gmail.com"},"sameAs":["http:\/\/screamingfrog.club"]}]}},"_links":{"self":[{"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/posts\/4991","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/comments?post=4991"}],"version-history":[{"count":0,"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/posts\/4991\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/media\/2712"}],"wp:attachment":[{"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/media?parent=4991"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/categories?post=4991"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/screamingfrog.club\/en\/wp-json\/wp\/v2\/tags?post=4991"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}