The composite with NiS nanorods anchored on reduced graphene oxide (rGO) has been prepared via a two-step hydrothermal method. With the corresponding precursors of hydroxide composites prepared during the first stage, ion exchange (from OH− to S2−) and reduction of GO are performed on subsequently, resulting in NiS/rGO composite. The NiS nanorods uniformly distribute on the surface of graphene, forming a 3D conductive network. The electrochemical performances of the composite are investigated in extenso as electrode materials for supercapacitors, and it exhibits preferable cycling performances and excellent capacitance. These satisfactory electrochemical behaviors can be attributed to the introduction of graphene, which enhances the specific surface area and electronic conductivity of the electrode, producing more active sites for the charging/discharging process and facilitating fast electron transport through the underlying graphene layers.