You are setting the brightness to zero, so a black image would be expected.
ColorJitter with a brightness argument is calling into adjust_brightness 4, which is blending two images, the input image and a zero image (black). The brightness factor would be zero, which is used as ratio in _blend.
As you can see, you have an additive transformation as:
return (ratio * img1 + (1.0 - ratio) * img2).clamp(0, bound).to(img1.dtype)

where ratio=0. and you are thus getting a black output image.