{"id":4765,"date":"2024-04-19T07:53:21","date_gmt":"2024-04-19T07:53:21","guid":{"rendered":"http:\/\/screamingfrog.club\/bloqueado-por-robots-txt\/"},"modified":"2024-07-08T07:24:57","modified_gmt":"2024-07-08T07:24:57","slug":"bloqueado-por-robots-txt","status":"publish","type":"post","link":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/","title":{"rendered":"\u00bfBloqueado por Robots.txt?"},"content":{"rendered":"<p><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-1 fusion-flex-container has-pattern-background has-mask-background nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;\" ><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"max-width:1248px;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:20px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-title title fusion-title-1 fusion-title-center fusion-title-text fusion-title-size-two\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h2 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">Robots.txt y SEO<\/h2><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-1\"><p class=\"p1\">El archivo <strong>robots.txt<\/strong> es crucial para el SEO, ya que te permite indicar a los motores de b\u00fasqueda qu\u00e9 p\u00e1ginas de tu sitio deben excluirse de la indexaci\u00f3n, optimizando la visibilidad del contenido m\u00e1s relevante. Una configuraci\u00f3n correcta del robots.txt puede influir directamente en la clasificaci\u00f3n de un sitio en los resultados de b\u00fasqueda, permitiendo un mejor control sobre la indexaci\u00f3n y el rastreo por parte de los motores de b\u00fasqueda. Sin embargo, un manejo inadecuado de este archivo podr\u00eda llevar a la exclusi\u00f3n accidental de p\u00e1ginas importantes, comprometiendo as\u00ed la clasificaci\u00f3n general del sitio. Este escenario es muy frecuente durante las migraciones SEO, en la fase de \u00abStaging\u00bb donde, en demasiadas ocasiones, permanece completamente cerrado e inhibe por completo la indexaci\u00f3n de la ara\u00f1a.<\/p>\n<\/div><style type=\"text\/css\" scopped=\"scopped\">.fusion-syntax-highlighter-1 > .CodeMirror, .fusion-syntax-highlighter-1 > .CodeMirror .CodeMirror-gutters {background-color:var(--awb-color1);}.fusion-syntax-highlighter-1 > .CodeMirror .CodeMirror-gutters { background-color: var(--awb-color2); }.fusion-syntax-highlighter-1 > .CodeMirror .CodeMirror-linenumber { color: var(--awb-color8); }<\/style><div class=\"fusion-syntax-highlighter-container fusion-syntax-highlighter-1 fusion-syntax-highlighter-theme-light\" style=\"opacity:0;margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;font-size:14px;border-width:1px;border-style:solid;border-color:var(--awb-color3);\"><div class=\"syntax-highlighter-copy-code\"><span class=\"syntax-highlighter-copy-code-title\" data-id=\"fusion_syntax_highlighter_1\" style=\"font-size:14px;\">Copy to Clipboard<\/span><\/div><label for=\"fusion_syntax_highlighter_1\" class=\"screen-reader-text\">Syntax Highlighter<\/label><textarea class=\"fusion-syntax-highlighter-textarea\" id=\"fusion_syntax_highlighter_1\" data-readOnly=\"nocursor\" data-lineNumbers=\"1\" data-lineWrapping=\"\" data-theme=\"default\" data-mode=\"text\/html\">User-agent: *\nDisallow: \/<\/textarea><\/div><div class=\"fusion-title title fusion-title-2 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;line-height:1em;\">Robots.txt y Screaming Frog<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-2\" style=\"--awb-margin-top:10px;\"><p>Como ya hemos visto con nuestras gu\u00edas, Screaming Frog permite comprobar minuciosamente el Robots.txt y probar \u00abURLs de ruta\u00bb individuales directamente desde la consola.<br \/>\nA trav\u00e9s de la Ara\u00f1a SEO, es posible respetar (\u00abRespetar Robots.txt\u00bb) o ignorar Robots.txt (\u00abIgnorar Robots.txt\u00bb) durante el rastreo, en funci\u00f3n de la finalidad del an\u00e1lisis.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-1 hover-type-none\"><img decoding=\"async\" width=\"1304\" height=\"815\" alt=\"configurazione custom robots txt con il seo spider\" title=\"custom robots txt con seo spider\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider.png\" class=\"img-responsive wp-image-1605\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-200x125.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-400x250.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-600x375.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-800x500.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider-1200x750.png 1200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/custom-robots-txt-con-seo-spider.png 1304w\" sizes=\"(max-width: 640px) 100vw, 1200px\" \/><\/span><\/div><div class=\"fusion-text fusion-text-3\" style=\"--awb-margin-top:10px;\"><p>Mediante la funci\u00f3n anterior, es posible comprobar carpetas o rutas individualmente para ver si el Robots.txt crea bloqueos, pero no permite un an\u00e1lisis \u00abMasivo\u00bb.<\/p>\n<p>Screaming Frog, a trav\u00e9s del filtro<b>&#8216;Bloqueado por Robots.txt<\/b>&#8216;, de la pesta\u00f1a<b>&#8216;C\u00f3digo de Estado<\/b>&#8216; permite ver todas las URLs afectadas por el fichero, y a trav\u00e9s de la exportaci\u00f3n es posible descargar un documento de referencia para su posible control o an\u00e1lisis.<\/p>\n<\/div><div class=\"fusion-image-element \" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-2 hover-type-none\"><img decoding=\"async\" width=\"1075\" height=\"540\" title=\"filtro robots.txt in screaming frog\" src=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog.png\" alt class=\"img-responsive wp-image-2472\" srcset=\"https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog-200x100.png 200w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog-400x201.png 400w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog-600x301.png 600w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog-800x402.png 800w, https:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/04\/filtro-robots.txt-in-screaming-frog.png 1075w\" sizes=\"(max-width: 640px) 100vw, 1075px\" \/><\/span><\/div><div class=\"fusion-text fusion-text-4\" style=\"--awb-margin-top:10px;\"><p>Probablemente ya conoc\u00edas esta opci\u00f3n, pero quiz\u00e1s nunca consideraste una de las columnas disponibles con este filtro, la<strong>\u00abL\u00ednea Robots.txt coincidente<\/strong>\u00ab.<\/p>\n<\/div><div class=\"fusion-title title fusion-title-3 fusion-title-center fusion-title-text fusion-title-size-three\" style=\"--awb-text-color:#141617;--awb-margin-top:20px;--awb-margin-bottom:20px;--awb-font-size:40px;\"><div class=\"title-sep-container title-sep-container-left\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><span class=\"awb-title-spacer\"><\/span><h3 class=\"fusion-title-heading title-heading-center awb-gradient-text fusion-responsive-typography-calculated\" style=\"font-family:&quot;Work Sans&quot;;font-style:normal;font-weight:800;margin:0;letter-spacing:-0.012em;text-transform:var(--awb-typography1-text-transform);background-color:#f79501;background-image:linear-gradient(150deg, #f79501 20%,#fe6996 100%);font-size:1em;--fontSize:40;line-height:1;\">L\u00ednea Robots.txt coincidente<\/h3><span class=\"awb-title-spacer\"><\/span><div class=\"title-sep-container title-sep-container-right\"><div class=\"title-sep sep-single sep-solid\" style=\"border-color:var(--awb-color3);\"><\/div><\/div><\/div><div class=\"fusion-text fusion-text-5\"><p>Al analizar el archivo robots.txt, si todo est\u00e1 configurado correctamente con el filtro anterior, s\u00f3lo encontrar\u00e1s los recursos que realmente quer\u00edas bloquear, pero \u00bfqu\u00e9 ocurre si se incluyen p\u00e1ginas importantes que de otro modo quer\u00edas indexar? Pero, sobre todo, \u00bfc\u00f3mo desentra\u00f1ar, en el caso de un comercio electr\u00f3nico con cientos de miles de URL, el posible fallo en la compilaci\u00f3n del archivo Robots.txt?<\/p>\n<p>Para ayudarte, Screaming Frog ha proporcionado la columna \u00abL\u00ednea Robots.txt coincidente\u00bb, que para cada URL individual te indica qu\u00e9 regla (l\u00ednea directiva en el archivo) del archivo robots.txt est\u00e1 bloqueando la indexaci\u00f3n.<\/p>\n<p>Para obtener una vista muy simplificada, puedes hacer clic en la cabecera de la columna y ordenarlo todo seg\u00fan la l\u00ednea de referencia, de modo que, incluso al analizar grandes sitios web o comercios electr\u00f3nicos, la resoluci\u00f3n de cualquier configuraci\u00f3n puede simplificarse enormemente.<\/p>\n<\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-2 fusion-flex-container has-pattern-background has-mask-background hundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--link_color: #f79501;--awb-border-sizes-top:0;--awb-border-sizes-bottom:0;--awb-border-sizes-left:5;--awb-border-sizes-right:0;--awb-border-color:var(--awb-color6);--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-padding-bottom:8px;--awb-margin-bottom:43px;--awb-background-color:var(--awb-color3);--awb-flex-wrap:wrap;\" ><div class=\"fusion-builder-row fusion-row fusion-flex-align-items-flex-start fusion-flex-content-wrap\" style=\"width:104% !important;max-width:104% !important;margin-left: calc(-4% \/ 2 );margin-right: calc(-4% \/ 2 );\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-1 fusion_builder_column_1_1 1_1 fusion-flex-column\" style=\"--awb-bg-size:cover;--awb-width-large:100%;--awb-margin-top-large:0px;--awb-spacing-right-large:1.92%;--awb-margin-bottom-large:20px;--awb-spacing-left-large:1.92%;--awb-width-medium:100%;--awb-order-medium:0;--awb-spacing-right-medium:1.92%;--awb-spacing-left-medium:1.92%;--awb-width-small:100%;--awb-order-small:0;--awb-spacing-right-small:1.92%;--awb-spacing-left-small:1.92%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-justify-content-flex-start fusion-content-layout-column\"><div class=\"fusion-text fusion-text-6 fusion-text-no-margin\" style=\"--awb-margin-top:5px;--awb-margin-right:10px;--awb-margin-bottom:-10px;--awb-margin-left:10px;\"><p><strong>Recursos \u00fatiles<\/strong>: <a href=\"https:\/\/screamingfrog.club\/es\/codigo-de-estado\/\">C\u00f3digo de respuesta<\/a> | <a href=\"https:\/\/screamingfrog.club\/es\/barra-sideral\/\">Problemas de escaneado con Screaming Frog<\/a><\/p>\n<\/div><\/div><\/div><\/div><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[97,109],"tags":[106,110],"class_list":["post-4765","post","type-post","status-publish","format-standard","hentry","category-guia-screaming-frog","category-seo-wiki","tag-principiante","tag-seo-es"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>\u00bfBloqueado por Robots.txt? | Screaming Frog<\/title>\n<meta name=\"description\" content=\"Averigua qu\u00e9 directivas del Robots.txt bloquean los recursos de tu sitio web o comercio electr\u00f3nico durante un rastreo con Screaming Frog.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/\" \/>\n<meta property=\"og:locale\" content=\"es_ES\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u00bfBloqueado por Robots.txt? | Screaming Frog\" \/>\n<meta property=\"og:description\" content=\"Averigua qu\u00e9 directivas del Robots.txt bloquean los recursos de tu sitio web o comercio electr\u00f3nico durante un rastreo con Screaming Frog.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/\" \/>\n<meta property=\"og:site_name\" content=\"Screaming Frog Club\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-19T07:53:21+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-07-08T07:24:57+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png\" \/>\n<meta name=\"author\" content=\"raffaele.visintin@gmail.com\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Escrito por\" \/>\n\t<meta name=\"twitter:data1\" content=\"raffaele.visintin@gmail.com\" \/>\n\t<meta name=\"twitter:label2\" content=\"Tiempo de lectura\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutos\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/\"},\"author\":{\"name\":\"raffaele.visintin@gmail.com\",\"@id\":\"https:\/\/screamingfrog.club\/es\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73\"},\"headline\":\"\u00bfBloqueado por Robots.txt?\",\"datePublished\":\"2024-04-19T07:53:21+00:00\",\"dateModified\":\"2024-07-08T07:24:57+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/\"},\"wordCount\":2735,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/screamingfrog.club\/es\/#organization\"},\"keywords\":[\"Principiante\",\"Seo\"],\"articleSection\":[\"Guia Screaming Frog\",\"SEO\"],\"inLanguage\":\"es\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/\",\"url\":\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/\",\"name\":\"\u00bfBloqueado por Robots.txt? | Screaming Frog\",\"isPartOf\":{\"@id\":\"https:\/\/screamingfrog.club\/es\/#website\"},\"datePublished\":\"2024-04-19T07:53:21+00:00\",\"dateModified\":\"2024-07-08T07:24:57+00:00\",\"description\":\"Averigua qu\u00e9 directivas del Robots.txt bloquean los recursos de tu sitio web o comercio electr\u00f3nico durante un rastreo con Screaming Frog.\",\"breadcrumb\":{\"@id\":\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/#breadcrumb\"},\"inLanguage\":\"es\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/screamingfrog.club\/es\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u00bfBloqueado por Robots.txt?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/screamingfrog.club\/es\/#website\",\"url\":\"https:\/\/screamingfrog.club\/es\/\",\"name\":\"Screaming Frog Club\",\"description\":\"Guide e Tutorial sul Seo SPider\",\"publisher\":{\"@id\":\"https:\/\/screamingfrog.club\/es\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/screamingfrog.club\/es\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"es\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/screamingfrog.club\/es\/#organization\",\"name\":\"Screaming Frog Club\",\"url\":\"https:\/\/screamingfrog.club\/es\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"es\",\"@id\":\"https:\/\/screamingfrog.club\/es\/#\/schema\/logo\/image\/\",\"url\":\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png\",\"contentUrl\":\"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png\",\"width\":117,\"height\":67,\"caption\":\"Screaming Frog Club\"},\"image\":{\"@id\":\"https:\/\/screamingfrog.club\/es\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/screamingfrog.club\/es\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73\",\"name\":\"raffaele.visintin@gmail.com\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"es\",\"@id\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"url\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"contentUrl\":\"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410\",\"caption\":\"raffaele.visintin@gmail.com\"},\"sameAs\":[\"http:\/\/screamingfrog.club\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\u00bfBloqueado por Robots.txt? | Screaming Frog","description":"Averigua qu\u00e9 directivas del Robots.txt bloquean los recursos de tu sitio web o comercio electr\u00f3nico durante un rastreo con Screaming Frog.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/","og_locale":"es_ES","og_type":"article","og_title":"\u00bfBloqueado por Robots.txt? | Screaming Frog","og_description":"Averigua qu\u00e9 directivas del Robots.txt bloquean los recursos de tu sitio web o comercio electr\u00f3nico durante un rastreo con Screaming Frog.","og_url":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/","og_site_name":"Screaming Frog Club","article_published_time":"2024-04-19T07:53:21+00:00","article_modified_time":"2024-07-08T07:24:57+00:00","og_image":[{"url":"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/03\/SF_Back_dark.png","type":"","width":"","height":""}],"author":"raffaele.visintin@gmail.com","twitter_card":"summary_large_image","twitter_misc":{"Escrito por":"raffaele.visintin@gmail.com","Tiempo de lectura":"3 minutos"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/#article","isPartOf":{"@id":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/"},"author":{"name":"raffaele.visintin@gmail.com","@id":"https:\/\/screamingfrog.club\/es\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73"},"headline":"\u00bfBloqueado por Robots.txt?","datePublished":"2024-04-19T07:53:21+00:00","dateModified":"2024-07-08T07:24:57+00:00","mainEntityOfPage":{"@id":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/"},"wordCount":2735,"commentCount":0,"publisher":{"@id":"https:\/\/screamingfrog.club\/es\/#organization"},"keywords":["Principiante","Seo"],"articleSection":["Guia Screaming Frog","SEO"],"inLanguage":"es","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/","url":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/","name":"\u00bfBloqueado por Robots.txt? | Screaming Frog","isPartOf":{"@id":"https:\/\/screamingfrog.club\/es\/#website"},"datePublished":"2024-04-19T07:53:21+00:00","dateModified":"2024-07-08T07:24:57+00:00","description":"Averigua qu\u00e9 directivas del Robots.txt bloquean los recursos de tu sitio web o comercio electr\u00f3nico durante un rastreo con Screaming Frog.","breadcrumb":{"@id":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/#breadcrumb"},"inLanguage":"es","potentialAction":[{"@type":"ReadAction","target":["https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/screamingfrog.club\/es\/bloqueado-por-robots-txt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/screamingfrog.club\/es\/"},{"@type":"ListItem","position":2,"name":"\u00bfBloqueado por Robots.txt?"}]},{"@type":"WebSite","@id":"https:\/\/screamingfrog.club\/es\/#website","url":"https:\/\/screamingfrog.club\/es\/","name":"Screaming Frog Club","description":"Guide e Tutorial sul Seo SPider","publisher":{"@id":"https:\/\/screamingfrog.club\/es\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/screamingfrog.club\/es\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"es"},{"@type":"Organization","@id":"https:\/\/screamingfrog.club\/es\/#organization","name":"Screaming Frog Club","url":"https:\/\/screamingfrog.club\/es\/","logo":{"@type":"ImageObject","inLanguage":"es","@id":"https:\/\/screamingfrog.club\/es\/#\/schema\/logo\/image\/","url":"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png","contentUrl":"http:\/\/screamingfrog.club\/wp-content\/uploads\/2024\/02\/SF_Club_Logo-2.png","width":117,"height":67,"caption":"Screaming Frog Club"},"image":{"@id":"https:\/\/screamingfrog.club\/es\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/screamingfrog.club\/es\/#\/schema\/person\/cd9ee509ae86128e5e339f9e3de1bc73","name":"raffaele.visintin@gmail.com","image":{"@type":"ImageObject","inLanguage":"es","@id":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","url":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","contentUrl":"https:\/\/screamingfrog.club\/wp-content\/litespeed\/avatar\/5b2dd661ff57d360794386547fd7a2dd.jpg?ver=1775343410","caption":"raffaele.visintin@gmail.com"},"sameAs":["http:\/\/screamingfrog.club"]}]}},"_links":{"self":[{"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/posts\/4765","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/comments?post=4765"}],"version-history":[{"count":0,"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/posts\/4765\/revisions"}],"wp:attachment":[{"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/media?parent=4765"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/categories?post=4765"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/screamingfrog.club\/es\/wp-json\/wp\/v2\/tags?post=4765"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}