Google has released a new crawler, a new Googlebot, named Google-InspectionTool. This new Google crawler will be how Google identifies crawling activity for the crawler used by Google Search’s testing tools, like the rich results test and Google Search Console’s URL inspection tool.
Google-InspectionTool. Google posted details about this new crawler in its help document . It says, “Google-InspectionTool is the crawler used by Search testing tools such as the Rich Result Test and URL inspection in Search Console. Apart from the user agent and user agent token, it mimics Googlebot.”
Here is a screenshot of that documentation:
User agent. The user agent token for its crawl activity can either be the classic Googlebot or the new Google-InspectionTool. Google also listed the full user agent strings which differ for mobile and desktop crawls:
- Mobile
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0) - Desktop
Mozilla/5.0 (compatible; Google-InspectionTool/1.0)
Why we care. If you are a crawler junky and you analyze the crawling activity and bot activity in your log files, you might see Google-InspectionTool show up. That is especially if you use the Rich Result Test and URL inspection in Google Search Console.
If you see issues with these tools doing their jobs, you might be blocking the Google-InspectionTool user agent from accessing your site. So make sure to allow Google-InspectionTool to crawl your site if you have strict rules in place.
Related stories
New on Search Engine Land
@media screen and (min-width: 800px) {
#div-gpt-ad-3191538-7 {
display: flex !important;
justify-content: center !important;
align-items: center !important;
min-width:770px;
min-height:260px;
}
}
@media screen and (min-width: 1279px) {
#div-gpt-ad-3191538-7 {
display: flex !important;
justify-content: center !important;
align-items: center !important;
min-width:800px!important;
min-height:440px!important;
}
}
About the author
Barry Schwartz a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns , a NY based web consulting firm. He also runs , a popular search blog on very advanced SEM topics. Barry can be followed .
- Google Search of today won’t exist in 10 years, says DeepMind co-founder - May 26, 2023
- How to do B2B content marketing the right way (with 5 examples) - May 26, 2023
- TikTok tests AI chatbot for search and discovery - May 25, 2023