2 July 2019

Google has been making some big announcements in the recent week about the robots.txt file but this one if one of the biggest announcements. If you weren’t aware robots.txt is 25 years old, Google has finally decided to make it a standard so that everyone knows the rules and follows them. If you are interested […]