A graphene coating mesoporous carbon/sulfur (RGO@CMK-3/S) composite, which is characteristic of a hybrid structure by incorporating the merits of CMK-3 matrix and graphene (RGO) skin, is synthesized by a facile and scalable route. The CMK-3/S composite is synthesized via a simple melt-diffusion strategy, and then a thin RGO skin is absorbed on the CMK-3/S composite surface in aqueous solution. When evaluating the electrochemical properties of as-prepared RGO wrapped nanostructures as cathode materials in lithium–sulfur batteries, it exhibits much improved cyclical stability and high rate performance. The RGO@CMK-3/S composite with 53.14 wt.% sulfur presents a reversible discharge capacity of about 734 mA h g− 1 after 100 cycles at 0.5 C. The improved performance is attributed to the unique structure of RGO@CMK-3/S composite. CMK-3 with extensively mesopores can offer buffering space for the volume change of sulfur and efficient diffusion channel for lithium ions during the charge/discharge process. Meanwhile, the conductive RGO coating skin physically and chemically prevents the dissolution of polysulfides from the cathode, both of which contribute to the reduced capacity fade and improved electrochemical properties.