Recent neuropsychological evidence, supporting a strong version of Whorfian principles of linguistic relativity, has reinvigorated debate about the role of language in colour categorisation. This paper questions the methodology used in this research and uses a novel approach to examine the unique contribution of language to categorisation behaviour. Results of three investigations are reported. The first required development of objective measures of category coherence and consistency to clarify questions about healthy control performance on the freesorting colour categorisation task used in previous studies. Between-participant consistency was found to be only moderate and the number of colour categories generated was found to vary markedly between individuals. The second study involved longitudinal neuropsychological examination of a patient whose colour categorisation strategy was monitored in the context of a progressive decline in language due to semantic dementia. Performance on measures of category coherence and consistency was found to be relatively stable over time despite a profound decline in the patient’s colour language. In a final investigation we demonstrated that, for both the patient and controls, between- and within-participant consistency were higher than expected by (a) random sorting and (b) sorting perceptually similar chips together. These findings indicate that the maintenance of colour categorisation need not depend on language.