Google’s robots.txt parser is now open source
Is Golang significantly slower than c++ ? I thought Google had invented Golang to solve precisely these kinds of code for their internal use.<p>I had thought most of the systems code inside Google would be golang by now. is that not the case ? 
the code doesnt look too big - I dont think porting is the big issue.