Co3O4 nanosheets and Co3O4/carbon allotrope (Co3O4/C) composites have been successfully synthesized and investigated as anode materials for sodium ion batteries (SIBs). Microstructure characterizations have been performed to confirm the formation of Co3O4/C nanohybrids. It has been found that the as-prepared Co3O4/C composites exhibit excellent sodium storage properties including superior cycle stability and rate capability, delivering reversible capacities of 436.9 (for Co3O4/GNSs), 388.5 (for Co3O4/CNTs), and 340.1 mA h g−1 (for Co3O4/CB) at a current density of 50 mA g−1 after 100 cycles, respectively, which are much higher than that of the bare Co3O4 counterpart (219.7 mA h g−1 at 50 mA g−1 after 100 cycles). Moreover, reversible capacities of 231 mA h g−1 for Co3O4/GNSs is realized at a high rate of 3.2 A g−1. The improved electrochemical performance is considered due to the introduction of the carbon-based materials, which not only serve as efficient buffering matrixes to decrease in volume expansion during cycling but also improve the electrode conductivity.