Google just added some info on how they handle Unsuccessful robots.txt responses
https://support.google.comCheck out the extra bits of info Google has added in the Crawl Stats report documentation.
Get daily dose of marketing news in quick TL;DR style.
I love tl;dr Marketing because I can get all the latest SEO news and trends in one spot without having to read lengthy articles. I really look forward to the daily emails to see what's new in our industry!