.Google.com's Gary Illyes discloses Googlebot collects hyperlinks instead of "observing" all of them, negating official records.Googlebot gathers web links rather than observing all of them in real-time.Gary Illyes discussed this relevant information in Google.com's 'Search Off The Document' podcast.Google.com's documentation negates the real crawler actions.