The development of advanced 1D/2D hierarchical nanocomposites for high-performance lithium-ion batteries is important and promising. Herein, monodispersed FeCO3 nanorods anchored on reduced graphene oxide (RGO) are prepared via a facile and efficient one-pot hydrothermal synthesis. The influence of RGO content on the morphology and electrochemical performances of the mesoporous FeCO3/reduced graphene oxide (FeCO3/RGO) composites are systematically studied. Optimized FeCO3/RGO composite shows good cycling stability. It delivers an initial discharge capacity of 1449 mAh·g−1 at the current density of 200 mA g−1 and maintained a capacity of 789 mAh·g−1 after 80 cycles. A moderate amount of RGO sheets can not only provide more conductive channels to improve the electrode conductivity, but also effectively buffer the large volume variation of FeCO3 during continuous charge/discharge process. The combination of FeCO3 nanorods with RGOs synergistically contribute to enhanced capacity and durability of the composite anode. It demonstrates that RGO anchored-FeCO3 nanorods should be an attractive candidate as anode material for high-performance lithium-ion batteries.