We all know that robots were created to make life easier (or to make us lazier!), so it stands to reason that the robots.txt file on your website is meant to make someone’s job easier, and that someone is Googlebot. Getting your robots.txt file right, however, can also make your job easier, if you’re looking …
While Google didn’t use that exact phrase, that exactly how I imagined them saying it, especially in a British accent. Bet you just tried it, didn’t you? John Muller was recently asked on twitter why they had only indexed 30,000 pages of a site and how long would it take to index the rest of …
Sorry, Sir, we’re not going to index all your pages Read More »
Understanding Googlebot and making it work for you Link building is vital for increasing brand awareness. For those that aren’t in the know, link building consists of actions you take that aim to build and increase the number of inbound links to your webpage to increase your rankings within search engines. So now you’ve got …
How Google Changes To Link Attributes Will Affect SEO – And Why You Should Care Last September,Google made a big announcement, 14 years after introducing the nofollow link attribute, they are changing how they treat this instruction as well as adding a few new attributes – cue more stress – and more research by pretty …
How Google Changes To Link Attributes Will Affect SEO – And Why You Should Care Read More »
[lmt-page-modified-info] Enterprise Level Technical Auditing Technical Auditing on a whole different level. DeepCrawl Find out More Read Review Preferred Tool OnCrawl Find out More Read Review Botify Check Price Read Review How I tested the tools Sites Crawled Tools Used Enterprise Level Technical Auditing Crawling your site and finding technical issues is important, in fact, …
You might have noticed a fairly big update with the latest Screaming Frog release. They have added another API integration. PageSpeed Insights by Google. But before you jump in and start pulling in metrics for every URL (and you should – speed is measured at a URL level, not domain level, just because your home …
If you need to create a sitemap, then this isn’t for you – this tool allows you to download your existing sitemap and analyse it. A sitemap is an important tool in your arsenal for helping Google find new pages on your site, it shouldn’t be your only tool but it should be used. Having …
Google has been making some big announcements in the recent week about the robots.txt file but this one if one of the biggest announcements. If you weren’t aware robots.txt is 25 years old, Google has finally decided to make it a standard so that everyone knows the rules and follows them. If you are interested …
Doing technical Audits is important and allows you to find errors on your site which could be holding back its potential. However if your just using Screaming Frog your just doing great audits, if you want to take them to the next level and really find issues you need to connect different data points. In …
How to Connect Screaming Frog to Google Search Console Data Read More »
In this video I am going to cover off the basics off how to connect the two data sources together, then a few of the advance changes you can make to get the data which matters to you and then finally I will explain why this is a must and should be something you should …
At a recent Google IO talk, there were some key topics which came up which I found were useful and wanted to share. The videos are below. The key things is Google bot is using the latest version of Chrome for Rendering it was on Chrome 41 over 3 years old, which is great news …
So SEMRush Crawling tool is taking on Screaming Frog Crawling tool to determine which tool is the best for crawling your website to find technical issues. While Screaming Frog is from Britain, a small town in Oxford, SEMRush is a more global operation. There is Head Office is based in Boston in the United States, …
I haven’t been able to verify this yet, but some people are reporting a new Google User-Agent in their logs called “Google-speakr”. The IP of the bot is 66.249.81.186 which resolves to Google. People are speculating that the bot is some sort of Home / Google Assistant crawler but there is no news from Google …
Finding Orphan pages are super important and can be very easy to find. In this video, we are going to show you how to quickly and easily find your orphan pages.https://www.youtube.com/watch?v=0mDJ59wjR-4 Note: If the site doesn’t have the pages in the sitemaps or any internal links, it will be quite hard to identify them, …
Over the years I have become quite an expert and analysing websites to find out technically what’s wrong with them. Historically while this has always got good results, SEOs have tended to just get more links or improve the content too boost rankings. This, however, is changing, over the last few years, more and …
Crawling your website is one of the most important parts of technical audits, but finding the best tools to complete the job can be difficult, but don’t worry we have analysed the two most popular tools on the market to see which one is the best to use.