Google: We Learn How To Crawl Your Site’s URL Patterns
Google’s John Mueller said when it comes to sites with pagination and large site’s faceted navigation, Google will learn how to crawl it. He said on Twitter, “we do try to “learn” useful URL patterns...