If implemented the wrong way, it can hide URLs from users in search results and prevent search engines from finding the rest of your site and passing ranking power.Select the internal tab > filter for HTML > scroll right to find the “Meta Robots” column.Open screaming frog and crawl your site.Are there any URLs with a “nofollow” value? Note that these internal URLs may have a “nofollow” for a reason but should be investigated. Does each URL that should not be included in search results have a “noindex” value?.Does each URL that should be included in search results have one of the following: 1) An absence of “noindex” (Google defaults to indexing in this case) or 2) “index” is listed.If implemented correctly, it allows you to choose which URLs you want to show in search results as well as whether you want search engines to pass ranking power to the pages linked to from the page with the meta robots tag.If implemented the wrong way, it can hide URLs from users in search results and prevent crawlers from finding the rest of your site and passing ranking power.Does GSC show any resources being blocked that should not be?Ĭhecks 1-5: Navigate to /robots.txtĬheck 6: To find resources blocked by robots.txt in GSC, navigate to Coverage > Excluded > Blocked by robots.txt.
0 Comments
Leave a Reply. |