Could you explain a bit, how this matrix would look like?
Are you passing these frequency images as your input to the model and would like to assign a label for each “pixel” (similar so a segmentation use case)?