A bulk-type all-solid-state lithium ion battery based on Ta-doped Li6.75La3Zr1.75Ta0.25O12 (LLZ-Ta) is prepared by a simple solid state process with high capacity of 279.0 μAh cm−2 at 80 °C. However, severe polarization is discovered during charging/discharging cycles at room temperature (RT) for battery with a higher active cathode loading. Large interfacial resistance due to the poor contact at the interfaces between cathode and LLZ-Ta solid electrolyte and at the interfaces within the composite cathode layer is proven to be the main reason for the poor electrochemical performance of the battery at RT. The polarization could be suppressed at elevated temperature, which is attributed to the decreased interfacial resistance as indicated by the results of impedance measurements and gives rise to much enhanced performance of the all-solid-state battery.