A design of an Instantaneous High Power Supply System (IHPSS) with a power distribution management (PDM) for portable military devices is newly addressed. The system includes a power board and a hybrid battery that can not only supply instantaneous high power but also maintain stable operation at critical low temperature (−30 °C). The power leakage and battery overcharge are effectively prevented by the optimal PDM. The performance of the proposed system under the required pulse loads and the operating conditions of a Korean Advanced Combat Rifle employed in the battlefield is modeled with simulations and verified experimentally. The system with the IHPSS charged the fuse setter with 1.7 times higher voltage (8.6 V) than the one without (5.4 V) under the pulse discharging rate (1 A at 0.5 duty, 1 ms) for 500 ms.