Not really solar panels as most think of them today (PV cells to generate electricity), but solar water heaters.  The were removed during a resurfacing of the White House roof and not reinstalled.  The oil crisis was no longer a threat and Reagan turned to addressing  stratospheric ozone depletion.