A passive thermal management system (TMS) for LiFePO4 battery modules using phase change material (PCM) as the heat dissipation source to control battery temperature rise is developed. Expanded graphite matrix and graphite sheets are applied to compensate low thermal conductivity of PCM and improve temperature uniformity of the batteries. Constant current discharge and mixed charge–discharge duties were applied on battery modules with and without PCM on a battery thermal characteristics test platform. Experimental results show that PCM cooling significantly reduces the battery temperature rise during short-time intense use. It is also found that temperature uniformity across the module deteriorates with the increasing of both discharge time and current rates. The maximum temperature differences at the end of 1C and 2C-rate discharges are both less than 5 °C, indicating a good performance in battery thermal uniformity of the passive TMS. Experiments on warm-keeping performance show that the passive TMS can effectively keep the battery within its optimum operating temperature for a long time during cold weather uses. A three dimensional numerical model of the battery pack with the passive TMS was conducted using ANSYS Fluent. Temperature profiles with respect to discharging time reveal that simulation shows good agreement with experiment at 1C-discharge rate.