As more renewable energy is developed, energy storage is increasingly important and attractive, especially grid-scale electrical energy storage; hence, finding and implementing cost-effective and sustainable energy storage and conversion systems is vital. Batteries of various types and sizes are considered one of the most suitable approaches to store energy and extensive research exists for different technologies and applications of batteries; however, environmental impacts of large-scale battery use remain a major challenge that requires further study. In this paper, batteries from various aspects including design features, advantages, disadvantages, and environmental impacts are assessed. This review reaffirms that batteries are efficient, convenient, reliable and easy-to-use energy storage systems (ESSs). It also confirms that battery shelf life and use life are limited; a large amount and wide range of raw materials, including metals and non-metals, are used to produce batteries; and, the battery industry can generate considerable amounts of environmental pollutants (e.g., hazardous waste, greenhouse gas emissions and toxic gases) during different processes such as mining, manufacturing, use, transportation, collection, storage, treatment, disposal and recycling. Battery use at a large scale or grid-scale (>50 MW), which is widely anticipated, will have significant social and environmental impacts; hence, it must be compared carefully with alternatives in terms of sustainability, while focusing on research to quantify externalities and reduce risk. Alternatives such as pumped hydro and compressed air energy storage must be encouraged because of their low environmental impact compared to different types of batteries.