John David,

As I understand it, there is an exemption under the Fair Housing Act that applies to buildings with four or fewer units, one of which is occupied by the building owner.

Assuming that is the case, maybe a compromise could be worked out.  For example, if a business provides baked goods for the owner and no more than three other persons, it could be exempt.  However, if you are providing baked goods to the general public, you would not be entitled to an exemption.