The oligo(ethylene oxide) modified layered double hydroxide (LDH) prepared by template method was added as a nanoscale nucleating agent into poly(ethylene oxide) (PEO) to form PEO/OLDH nanocomposite electrolytes. The effects of OLDH addition on morphology and conductivities of nanocomposite electrolytes were studied using wide-angle X-ray diffractometer, polarized optical microscopy, differential scanning calorimetry and ionic conductivity measurement. The results show that the exfoliated morphology of nanocomposites is formed due to the surface modification of LDH layers with PEO matrix compatible oligo(ethylene oxide)s. The nanoscale dispersed OLDH layers inhibit the crystal growth of PEO crystallites and result in a plenty amount of intercrystalline grain boundary within PEO/OLDH nanocomposites. The ionic conductivities of nanocomposite electrolytes are enhanced by three orders of magnitude compared to the pure PEO polymer electrolytes at ambient temperature. It can be attributed to the ease transport of Li+ along intercrystalline amorphous phase. This novel nanocomposite electrolytes system with high conductivities will be benefited to fabricate the thin-film type of Li-polymer secondary battery.