Featuring with low cost, exceptional inherent safety and decent electrochemical performance, rechargeable Zn-based batteries (RZBs) have attracted increased attention and revived research efforts recently as a compelling alternative battery chemistry to Li-ion. However, some challenges still stand in the way of the development of these energy storage systems, such as low operation voltage, instability of cathode materials as well as dissolution of Zn electrode, etc. In this review, we present a comprehensive overview of recent progress in different RZBs systems including mild electrolyte RZBs, alkaline RZBs, hybrid RZBs, Zn-ion capacitors and Zn air batteries. The fundamental chemistry of various RZB systems, different cathode materials, optimization of Zn anode as well as various types of electrolytes and their influence on the battery performance are summarized. The major issues of different components along with respective strategies to alleviate them are discussed, aiming at providing a general guide for design and construction of high-performance RZBs. Additionally, the development of RZBs with different features in the last few years are summarized. Finally, we discuss the limitations and challenges that need to be overcome, providing potential future research directions in the field of next-generation RZBs.