This study shows that the amount of linearly decodable information for categorical-orthogonal object tasks (for example, position, scale, pose, perimeter and aspect ratio) increases up the ventral visual hierarchy, ultimately matching human levels in inferior temporal cortex. It also provides a computational model that explains how this pattern of information arises.