So earlier this week @methode explained how Google crawls the web, but now you want a deeper technical dive. Join Gary and @okaylizzi on this week’s #SOTRpodcast as they discuss all things crawling with web developer @davewsmart.

@methode @okaylizzi @davewsmart 📖 Transcript link → goo.gle/sotr070-transc… 📺 Join us on YouTube ↓ goo.gle/3IzxnFA

@googlesearchc @methode @okaylizzi @davewsmart Seems you don't need to crawl the web anymore with your useless updates.

@googlesearchc @methode @okaylizzi @davewsmart Instead of crawling urls on the sitemap, genius Google prefers to crawl urls built on spammy sites.

@googlesearchc @methode @okaylizzi @davewsmart This is kind of joke for them but it is like snatching bread and butter for someone kids. How inhuman this company can be?

@googlesearchc @methode @okaylizzi @davewsmart I hate you google,, you penalized our domain without giving any warning.. how can i fix this error?? there's no option to submit a reconsideration request in Webmaster for this issue.

@googlesearchc @methode @okaylizzi @davewsmart At this point it is better to buy in a physical store. Previously there were review sites with real images, product tests and useful advice, now only products sold by large companies. No use for the consumer. Before, Google offered useful content....

@googlesearchc @methode @okaylizzi @davewsmart The internet literally built Google and you are turning your back on them. Stop crawling the web if you're not going to honor being an answer engine.

@googlesearchc @methode @okaylizzi @davewsmart If you want information on something, you need to use the word "guide" in your search string, otherwise you just get loads of products.

@googlesearchc @methode @okaylizzi @davewsmart I have never seen any company be so indifferent towards the creators. Can you imagine reading these comments, under every post, and just turning a blind eye. Who are you posting this for? Everyone in search community despises what you have done. Shameless.

@googlesearchc @methode @okaylizzi @davewsmart We miss the Google SEO Office Hours with @JohnMu

@googlesearchc @methode @okaylizzi @davewsmart What is Common Crawl?

@googlesearchc @methode @okaylizzi @davewsmart If one wants to buy a product on the internet he should know what he is buying. Before, you could find reviews and opinions from people who had tested those products with useful information for users. Now you can only find shops where you can buy products you know nothing about.

@googlesearchc @methode @okaylizzi @davewsmart Who cares, in the end you'll only have a thousand sites to crawl