Google’s robots.txt parser is now open source
Is Golang significantly slower than c++ ? I thought Google had invented Golang to solve precisely these kinds of code for their internal use.I had thought most of the systems code inside Google would be golang by now. is that not the case ? 
the code doesnt look too big - I dont think porting is the big issue.