Can you see Google bot activity in the logs on sitemap pages? Episode 1

This is the first video in our new series, with me Andy and Corey Aka The Server Log Kid.

 

Today’s Question is: Can you see Google bot activity in the logs on Sitemap pages?

Answer:

That is a brilliant question Corey and the answer is yes, if you look in the server logs you can see Googlebot activity on the different sitemap pages.

 

You can see:

  • When they last crawled
  • How many times have they been crawled
  • Which bot it was, whether that’s mobile or desktop bot

 

Obviously, you don’t want to rely upon Googlebot crawling the sitemap to find new pages, you want to use internal linking and external linking but you can look into the logs to see when Googlebot last hit your sitemap pages.

If you have any questions to do with Googlebot crawling sitemap pages ask in the questions below and we will answer them for you, if you have a question you would like the Server Log Kid to answer, please email them to us or comment below and it could be your question we answer next.

Why not check out the rest of the series in Server Log Kid to see some of the other questions we have answered.

About

Hello, my name is Andrew Halliday a UK based professional SEO expert and consultant of 9 years. Over those years, I have gained a great wealth of SEO knowledge. I have helped hundreds of companies around the world. I specialise in Technical SEO audits and Server Log Analysis. “You wouldn’t build a million dollar business on quicksand, so don’t build a million dollar website on poor foundations”

Leave a Reply

Your email address will not be published. Required fields are marked *

*