Asking 60 LLMs a set of 20 questions
> Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have?The site reports every LLM as getting this wrong. But GPT4 seems to get it right for me:> Sally has 3 brothers. Since each brother has 2 sisters and Sally is one of those sisters, the other sister is the second sister for each brother. So, Sally has 1 sister.