 Bryson also produced the cover art for the band's releases.The name came from a misheard line in a song, with Hartley explaining "I like the way that the mouth moves when you say Bog Shed".They were helped initially by The Membranes, leading to several performances in London, and the band's first release was the "Let Them Eat Bogshed" EP on John Robb's Vinyl Drip label in 1985.