richardson was born in new york city, the son of norma kessler, an actress, and bob richardson, a fashion photographer who struggled with schizophrenia and drug abuse. richardson's father was irish catholic and his mother is jewish. following the divorce of his parents, richardson moved to woodstock, new york, with his mother and stepfather, english guitarist jackie lomax. richardson later moved to the hollywood neighborhood of los angeles, where he attended hollywood high school. he moved with his mother to ojai, california, where he attended nordhoff high school, when he was 16. richardson originally wanted to be a punk rock musician rather than a photographer. he played bass guitar in the punk rock band the invisible government for four years. he played bass for a variety of other punk bands in southern california including signal street alcoholics, doggy style, baby fist and middle finger.