"baby's on fire" has received positive reviews from critics, mainly noting the guitar solo. douglas wolk of "blender" described the song as "a two-note wonder built around an all-hell-breaks-loose guitar meltdown by king crimson’s robert fripp", while chris ott of pitchfork media called the track "earth-shattering".