The all-solid-state lithium batteries using solid electrolytes are considered to be the new generation of devices for energy storage. Recent advances in this kind of rechargeable batteries have brought them much closer to a commercial reality. However, several challenges such as insufficient room temperature ionic conductivity (10−5~10−3 Scm−1) when compared to those of conventional organic liquid electrolytes (10−2 Scm−1), the difficulty in informing an effective electrode-electrolyte interface and insufficient fundamental understanding of the interfacial process after charge/discharge, hindering the reality of such devices. To accelerate the research and development, the overall picture about the current state of all solid-state lithium batteries was reviewed in this article with major focus on the material aspects, including inorganic ceramic and organic solid polymer electrolyte materials. In particular, the importance of the electrolytes and their associated interfaces with electrodes as well as their effects on the battery performance are emphasized by in-depth discussion and data analysis. To overcome the challenges, several possible research directions are also suggested for facilitating further improvement on the battery performance.