{"id":4148,"date":"2024-04-19T07:53:21","date_gmt":"2024-04-19T07:53:21","guid":{"rendered":"http:\/\/screamingfrog.club\/bloque-par-robots-txt\/"},"modified":"2024-07-05T08:19:02","modified_gmt":"2024-07-05T08:19:02","slug":"bloque-par-robots-txt","status":"publish","type":"post","link":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/","title":{"rendered":"Bloqu\u00e9 par Robots.txt ?"},"content":{"rendered":"<p><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-1 fusion-flex-container has-pattern-background has-mask-background nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;\" ><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"max-width:1248px;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:20px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-title title fusion-title-1 fusion-title-center fusion-title-text fusion-title-size-two\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h2 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Robots.txt et SEO<\/h2><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-1\"><p class=\"p1\">Le fichier <strong>robots.txt<\/strong> est essentiel pour le r\u00e9f\u00e9rencement, car il vous permet d&rsquo;indiquer aux moteurs de recherche quelles pages de votre site doivent \u00eatre exclues de l&rsquo;indexation, optimisant ainsi la visibilit\u00e9 du contenu le plus pertinent. Une configuration correcte du fichier robots.txt peut influencer directement le classement d&rsquo;un site dans les r\u00e9sultats de recherche, en permettant un meilleur contr\u00f4le de l&rsquo;indexation et de l&rsquo;exploration par les moteurs de recherche. Cependant, une mauvaise manipulation de ce fichier peut entra\u00eener l&rsquo;exclusion accidentelle de pages importantes, ce qui compromet le classement g\u00e9n\u00e9ral du site. Ce sc\u00e9nario est tr\u00e8s fr\u00e9quent lors des migrations SEO, dans la phase &lsquo;Staging&rsquo; o\u00f9, trop souvent, il reste compl\u00e8tement ferm\u00e9 et inhibe compl\u00e8tement l&rsquo;indexation des araign\u00e9es.<\/p>\n<\/div><style type=\"text\/css\" scopped=\"scopped\">.fusion-syntax-highlighter-1 > .CodeMirror, .fusion-syntax-highlighter-1 > .CodeMirror .CodeMirror-gutters {background-color:var(--awb-color1);}.fusion-syntax-highlighter-1 > .CodeMirror .CodeMirror-gutters { background-color: var(--awb-color2); }.fusion-syntax-highlighter-1 > .CodeMirror .CodeMirror-linenumber { color: var(--awb-color8); }<\/style><div class=\"fusion-syntax-highlighter-container fusion-syntax-highlighter-1 fusion-syntax-highlighter-theme-light\" style=\"opacity:0;margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;font-size:14px;border-width:1px;border-style:solid;border-color:var(--awb-color3);\"><div class=\"syntax-highlighter-copy-code\"><span class=\"syntax-highlighter-copy-code-title\" data-id=\"fusion_syntax_highlighter_1\" style=\"font-size:14px;\">Copy to Clipboard<\/span><\/div><label for=\"fusion_syntax_highlighter_1\" class=\"screen-reader-text\">Syntax Highlighter<\/label><textarea class=\"fusion-syntax-highlighter-textarea\" id=\"fusion_syntax_highlighter_1\" data-readOnly=\"nocursor\" data-lineNumbers=\"1\" data-lineWrapping=\"\" data-theme=\"default\" data-mode=\"text\/html\">User-agent: *\nDisallow: \/<\/textarea><\/div><div class=\"fusion-title title fusion-title-2 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;line-height:1em;\">Robots.txt et Screaming Frog<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-2\" style=\"--awb-margin-top:10px;\"><p>Comme nous l&rsquo;avons d\u00e9j\u00e0 vu dans nos guides, Screaming Frog permet de v\u00e9rifier minutieusement le fichier Robots.txt et de tester des \u00ab\u00a0Path URLs\u00a0\u00bb individuels directement \u00e0 partir de la console.<br \/>\nGr\u00e2ce \u00e0 SEO Spider, il est possible de respecter (\u00ab\u00a0Respecter Robots.txt\u00a0\u00bb) ou d&rsquo;ignorer Robots.txt (\u00ab\u00a0Ignorer Robots.txt\u00a0\u00bb) pendant l&rsquo;exploration, en fonction de l&rsquo;objectif de l&rsquo;analyse.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-1 hover-type-none\"><img decoding=\"async\" width=\"1304\" height=\"815\" alt=\"configurazione custom robots txt con il seo spider\" title=\"custom robots txt con seo spider\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider.png\" class=\"img-responsive wp-image-1605\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-200x125.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-400x250.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-600x375.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-800x500.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-1200x750.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider.png 1304w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/span><\/div><div class=\"fusion-text fusion-text-3\" style=\"--awb-margin-top:10px;\"><p>Gr\u00e2ce \u00e0 la fonction pr\u00e9c\u00e9dente, il est possible de v\u00e9rifier individuellement les dossiers ou les chemins pour voir si le fichier Robots.txt cr\u00e9e des blocages, mais il n&rsquo;est pas possible d&rsquo;effectuer une analyse \u00ab\u00a0en vrac\u00a0\u00bb.<\/p>\n<p>Screaming Frog, gr\u00e2ce au filtre<b>\u00ab\u00a0Blocked by Robots.txt<\/b>\u00a0\u00bb de l&rsquo;onglet<b>\u00ab\u00a0Status Code<\/b>\u00ab\u00a0, permet de visualiser toutes les URL affect\u00e9es par le fichier et, gr\u00e2ce \u00e0 l&rsquo;exportation, il est possible de t\u00e9l\u00e9charger un document de r\u00e9f\u00e9rence en vue d&rsquo;un contr\u00f4le ou d&rsquo;une analyse \u00e9ventuels.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-2 hover-type-none\"><img decoding=\"async\" width=\"1075\" height=\"540\" title=\"filtro robots.txt in screaming frog\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog.png\" alt class=\"img-responsive wp-image-2472\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog-200x100.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog-400x201.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog-600x301.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog-800x402.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog.png 1075w\" sizes=\"(max-width: 640px) 100vw, 1075px\" \/><\/span><\/div><div class=\"fusion-text fusion-text-4\" style=\"--awb-margin-top:10px;\"><p>Vous connaissiez probablement d\u00e9j\u00e0 cette option, mais vous n&rsquo;avez peut-\u00eatre jamais pens\u00e9 \u00e0 l&rsquo;une des colonnes disponibles avec ce filtre, la<strong>\u00ab\u00a0Ligne Robots.txt correspondante<\/strong>\u00ab\u00a0.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-3 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Ligne Robots.txt correspondante<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-5\"><p>Lorsque vous analysez le fichier robots.txt, si tout est configur\u00e9 correctement avec le filtre pr\u00e9c\u00e9dent, vous ne trouverez que les ressources que vous vouliez vraiment bloquer, mais que se passe-t-il si des pages importantes que vous vouliez indexer sont incluses ? Mais surtout, comment se d\u00e9p\u00eatrer dans le cas d&rsquo;un e-commerce avec des centaines de milliers d&rsquo;URLs pour trouver l&rsquo;\u00e9ventuel bug dans la compilation du fichier Robots.txt ?<\/p>\n<p>Pour vous aider, Screaming Frog a mis \u00e0 votre disposition la colonne \u00ab\u00a0Ligne Robots.txt correspondante\u00a0\u00bb, qui vous indique, pour chaque URL, la r\u00e8gle (ligne de directive dans le fichier) du fichier robots.txt qui bloque l&rsquo;indexation.<\/p>\n<p>Pour une vue tr\u00e8s simplifi\u00e9e, vous pouvez cliquer sur l&rsquo;en-t\u00eate de la colonne et tout trier en fonction de la ligne de r\u00e9f\u00e9rence. Ainsi, m\u00eame lors de l&rsquo;analyse de grands sites web ou de commerce \u00e9lectronique, la r\u00e9solution de toutes les configurations peut \u00eatre grandement simplifi\u00e9e.<\/p>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-2 fusion-flex-container has-pattern-background has-mask-background hundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--link_color: #f79501;--awb-border-sizes-top:0;--awb-border-sizes-bottom:0;--awb-border-sizes-left:5;--awb-border-sizes-right:0;--awb-border-color:var(--awb-color6);--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-padding-bottom:8px;--awb-margin-bottom:43px;--awb-background-color:var(--awb-color3);--awb-flex-wrap:wrap;\" ><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"width:104% !important;max-width:104% !important;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-1 fusion_builder_column_1_1 1_1 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:20px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-text fusion-text-6 fusion-text-no-margin\" style=\"--awb-margin-top:5px;--awb-margin-right:10px;--awb-margin-bottom:-10px;--awb-margin-left:10px;\"><p><strong>Ressources utiles<\/strong>: <a href=\"https:\/\/screamingfrog.club\/fr\/code-detat\/\">Response Code<\/a> | <a href=\"http:\/\/screamingfrog.club\/sidebar-laterale\/\">Probl\u00e8mes d&rsquo;analyse avec Screaming Frog<\/a><\/p>\n<\/div><\/div><\/div><\/div><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[69,83],"tags":[80,85],"class_list":["post-4148","post","type-post","status-publish","format-standard","hentry","category-guide-screaming-frog","category-seo-wiki","tag-debutant","tag-seo-fr"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Bloqu\u00e9 par Robots.txt ? | Screaming Frog<\/title>\n<meta name=\"description\" content=\"D\u00e9couvrez quelles directives du fichier Robots.txt bloquent les ressources de votre site web lors d&#039;une exploration \u00e0 l&#039;aide de Screaming Frog.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Bloqu\u00e9 par Robots.txt ? | Screaming Frog\" \/>\n<meta property=\"og:description\" content=\"D\u00e9couvrez quelles directives du fichier Robots.txt bloquent les ressources de votre site web lors d&#039;une exploration \u00e0 l&#039;aide de Screaming Frog.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/\" \/>\n<meta property=\"og:site_name\" content=\"Screaming Frog Club\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-19T07:53:21+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-07-05T08:19:02+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png\" \/>\n<meta name=\"author\" content=\"raffaele.visintin@gmail.com\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"raffaele.visintin@gmail.com\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/\"},\"author\":{\"name\":\"raffaele.visintin@gmail.com\",\"@id\":\"https:\/\/screamingfrog.club\/fr\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73\"},\"headline\":\"Bloqu\u00e9 par Robots.txt ?\",\"datePublished\":\"2024-04-19T07:53:21+00:00\",\"dateModified\":\"2024-07-05T08:19:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/\"},\"wordCount\":2767,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/screamingfrog.club\/fr\/#organization\"},\"keywords\":[\"D\u00e9butant\",\"Seo\"],\"articleSection\":[\"Guide Screaming Frog\",\"Seo\"],\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/\",\"url\":\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/\",\"name\":\"Bloqu\u00e9 par Robots.txt ? | Screaming Frog\",\"isPartOf\":{\"@id\":\"https:\/\/screamingfrog.club\/fr\/#website\"},\"datePublished\":\"2024-04-19T07:53:21+00:00\",\"dateModified\":\"2024-07-05T08:19:02+00:00\",\"description\":\"D\u00e9couvrez quelles directives du fichier Robots.txt bloquent les ressources de votre site web lors d'une exploration \u00e0 l'aide de Screaming Frog.\",\"breadcrumb\":{\"@id\":\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/screamingfrog.club\/fr\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Bloqu\u00e9 par Robots.txt ?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/screamingfrog.club\/fr\/#website\",\"url\":\"https:\/\/screamingfrog.club\/fr\/\",\"name\":\"Screaming Frog Club\",\"description\":\"Guide e Tutorial sul Seo SPider\",\"publisher\":{\"@id\":\"https:\/\/screamingfrog.club\/fr\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/screamingfrog.club\/fr\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/screamingfrog.club\/fr\/#organization\",\"name\":\"Screaming Frog Club\",\"url\":\"https:\/\/screamingfrog.club\/fr\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/screamingfrog.club\/fr\/#\/schema\/logo\/image\/\",\"url\":\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png\",\"contentUrl\":\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png\",\"width\":117,\"height\":67,\"caption\":\"Screaming Frog Club\"},\"image\":{\"@id\":\"https:\/\/screamingfrog.club\/fr\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/screamingfrog.club\/fr\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73\",\"name\":\"raffaele.visintin@gmail.com\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"url\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"contentUrl\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"caption\":\"raffaele.visintin@gmail.com\"},\"sameAs\":[\"http:\/\/screamingfrog.club\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Bloqu\u00e9 par Robots.txt ? | Screaming Frog","description":"D\u00e9couvrez quelles directives du fichier Robots.txt bloquent les ressources de votre site web lors d'une exploration \u00e0 l'aide de Screaming Frog.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/","og_locale":"fr_FR","og_type":"article","og_title":"Bloqu\u00e9 par Robots.txt ? | Screaming Frog","og_description":"D\u00e9couvrez quelles directives du fichier Robots.txt bloquent les ressources de votre site web lors d'une exploration \u00e0 l'aide de Screaming Frog.","og_url":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/","og_site_name":"Screaming Frog Club","article_published_time":"2024-04-19T07:53:21+00:00","article_modified_time":"2024-07-05T08:19:02+00:00","og_image":[{"url":"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png","type":"","width":"","height":""}],"author":"raffaele.visintin@gmail.com","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"raffaele.visintin@gmail.com","Dur\u00e9e de lecture estim\u00e9e":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/#article","isPartOf":{"@id":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/"},"author":{"name":"raffaele.visintin@gmail.com","@id":"https:\/\/screamingfrog.club\/fr\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73"},"headline":"Bloqu\u00e9 par Robots.txt ?","datePublished":"2024-04-19T07:53:21+00:00","dateModified":"2024-07-05T08:19:02+00:00","mainEntityOfPage":{"@id":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/"},"wordCount":2767,"commentCount":0,"publisher":{"@id":"https:\/\/screamingfrog.club\/fr\/#organization"},"keywords":["D\u00e9butant","Seo"],"articleSection":["Guide Screaming Frog","Seo"],"inLanguage":"fr-FR","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/","url":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/","name":"Bloqu\u00e9 par Robots.txt ? | Screaming Frog","isPartOf":{"@id":"https:\/\/screamingfrog.club\/fr\/#website"},"datePublished":"2024-04-19T07:53:21+00:00","dateModified":"2024-07-05T08:19:02+00:00","description":"D\u00e9couvrez quelles directives du fichier Robots.txt bloquent les ressources de votre site web lors d'une exploration \u00e0 l'aide de Screaming Frog.","breadcrumb":{"@id":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/screamingfrog.club\/fr\/bloque-par-robots-txt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/screamingfrog.club\/fr\/"},{"@type":"ListItem","position":2,"name":"Bloqu\u00e9 par Robots.txt ?"}]},{"@type":"WebSite","@id":"https:\/\/screamingfrog.club\/fr\/#website","url":"https:\/\/screamingfrog.club\/fr\/","name":"Screaming Frog Club","description":"Guide e Tutorial sul Seo SPider","publisher":{"@id":"https:\/\/screamingfrog.club\/fr\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/screamingfrog.club\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/screamingfrog.club\/fr\/#organization","name":"Screaming Frog Club","url":"https:\/\/screamingfrog.club\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/screamingfrog.club\/fr\/#\/schema\/logo\/image\/","url":"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png","contentUrl":"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png","width":117,"height":67,"caption":"Screaming Frog Club"},"image":{"@id":"https:\/\/screamingfrog.club\/fr\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/screamingfrog.club\/fr\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73","name":"raffaele.visintin@gmail.com","image":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","url":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","contentUrl":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","caption":"raffaele.visintin@gmail.com"},"sameAs":["http:\/\/screamingfrog.club"]}]}},"_links":{"self":[{"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/posts\/4148","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/comments?post=4148"}],"version-history":[{"count":0,"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/posts\/4148\/revisions"}],"wp:attachment":[{"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/media?parent=4148"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/categories?post=4148"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/screamingfrog.club\/fr\/wp-json\/wp\/v2\/tags?post=4148"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}