question: What is the result of the programmer making a mistake ?
answer: defect ( fault , bug )
turker_answer: The result of the programmer making a mistake is defect ( fault , bug ) .
rule-based: The result of the programmer making a mistake is defect ( fault , bug .