Solid electrolytes with high ionic conductivity and excellent electrochemical stability are of prime significance to enable the application of solid-state batteries in energy storage and conversion. In this study, solid composite polymer electrolytes (CPEs) based on sodium bis(trifluorosulfonyl) imide (NaTFSI) and poly (ethylene oxide) (PEO) incorporated with active ceramic filler (NASICON) are reported for the first time. With the addition of NASICON fillers, the thermal stability and electrochemical stability of the CPEs are improved. A high conductivity of 2.8 mS/cm (at 80 °C) is readily achieved when the content of the NASICON filler in the composite polymer reaches 50 wt%. Furthermore, Na3V2(PO4)3/CPE/Na solid-state batteries using this composite electrolyte display good rate and excellent cycle performance.