Exploring the Idea of using Googlebot’s Directive Approach to Robots.txt to Sculpting PageRank

A fascinating read that explores how Googlebot takes instructions in Robots.txt as a directive to possibly sculpt PageRank and prevent Googlebot from seeing what we don’t want them to see on our site, you could possibly block intrusive interstitials, A/B tests, etc.