Li-ion ceramic electrolyte material is considered the key for advanced lithium metal batteries, and garnet-type oxides are promising ceramic electrolyte materials. To disentangle the thinness-strength dilemma in garnet-type Li6.4La3Zr1.4Ta0.6O12 (LLZTO) electrolyte, we designed and successfully synthesized a ceramic–ceramic composite electrolyte, i.e. a honeycomb-Al2O3 pellet supported LLZTO membrane. The honeycomb-Al2O3 pellet acts as a supporter to the thin LLZTO membrane and makes the whole composite electrolyte strong enough, while the straight holes in the Al2O3 supporter can be filled with liquid electrolyte and acts as channels for Li+ transportation. Such a composite design eliminates the concern over the LLZTO membrane's fragility, and keeps its good electrical property.