This sectionexplains HTTP status codesthat your server might return when we request a page of your site. We display HTTP status codes
in several places in Google Sitemaps (such as on therobots.txt analysis pageand on thecrawl errorspage) and some site owners have asked us to provide more information about what these mean.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],[],[[["\u003cp\u003eGoogle updated their webmaster help center with new sections on using robots.txt and understanding HTTP status codes.\u003c/p\u003e\n"],["\u003cp\u003eThe robots.txt section explains how to create, utilize, and understand the functionality of this file for controlling crawler access.\u003c/p\u003e\n"],["\u003cp\u003eThe HTTP status codes section provides information on different codes returned by your server and their meanings within Google Sitemaps and crawl error reports.\u003c/p\u003e\n"]]],["The webmaster help center was updated with two new sections: robots.txt files and HTTP status codes. The robots.txt section details how to create such files, descriptions of Google's user-agents, pattern matching usage, and robots.txt recrawl frequency. The HTTP status codes section explains the status codes that servers return, which appear on the robots.txt analysis and crawl errors pages within Google Sitemaps. The updated information can be found on the website.\n"],null,["# Webmaster help center updates\n\nJune 13, 2006\n\n\nWe recently updated our\n[webmaster help center](https://www.google.com/support/webmasters).\nTwo new sections that you may find particularly useful are:\n\n- Using a robots.txt file\n- Understanding HTTP status codes\n\nUsing a robots.txt file\n-----------------------\n\n\nWe've added a new section of help topics in the\n[How Google crawls my site](/search/docs/fundamentals/how-search-works#crawling)\nsection. [These topics](/search/docs/crawling-indexing/robots/intro) include\ninformation on:\n\n- [How to create a robots.txt file](/search/docs/crawling-indexing/robots/create-robots-txt)\n- [Descriptions of each user-agent that Google uses](/search/docs/crawling-indexing/overview-google-crawlers)\n- [How to use pattern matching](/search/docs/crawling-indexing/robots/robots_txt#url-matching-based-on-path-values)\n- [How often we recrawl your robots.txt file](/search/docs/crawling-indexing/robots/submit-updated-robots-txt#refresh-googles-robots.txt-cache) (around once a day)\n\nUnderstanding HTTP status codes\n-------------------------------\n\n\nThis section\n[explains HTTP status codes](/search/docs/crawling-indexing/http-network-errors)\nthat your server might return when we request a page of your site. We display HTTP status codes\nin several places in Google Sitemaps (such as on the\n[robots.txt analysis page](https://www.google.com/webmasters/tools/robots-testing-tool)\nand on the\n[crawl errors](https://support.google.com/webmasters/answer/9679690)\npage) and some site owners have asked us to provide more information about what these mean.\n\nPosted by [Vanessa Fox](https://www.vanessafox.com/)"]]
