Garnet-type solid electrolytes are one of key materials to enable practical usage of lithium metal anode for high-energy-density batteries. However, it suffers from lithium growth in pellets on charging, which causes short circuit. In this study, grain boundaries of Li6.5La3Zr1.5Ta0.5O12 (LLZT) pellets are modified with Li2CO3 and LiOH to investigate the influence of the microstructure of grain boundaries on lithium growth and to study the mechanism of the lithium growth. In spite of similar properties (relative density of ca. 96% and total ionic conductivity of 7 × 10−4 S cm−1 at 25 °C), the obtained pellets exhibit different tolerance on the short circuit. The LLZT pellets prepared from LiOH-modified LLZT powders exhibit rather high critical current density of 0.6 mA cm−2, at which short circuit occurs. On the other hand, the LLZT pellets without grain boundary modification short-circuited at 0.15 mA cm−2. Microstructural analyses by means of SEM, STEM and EIS suggest that lithium grows through interconnected open voids, and reveal that surface layers such as Li2CO3 and LiOH are not only plug voids but also facilitate the sintering of LLZT to suppress the lithium growth. The results indicate a strategy towards short-circuit-free lithium metal batteries.