Hi,
as titled, recently I am looking into preprocessing and want to try some whitening methods.
ZCA sounds good to me but my hardware cannot support the calculation of matrix multiplication of [50000, 3072]
so I am wondering…does pytorch provide ZCA function? or ZCA matrix? …or is there a way to estimate the ZCA matrix for the whole dataset?
P.S: I have found a github repo providing CIFAR10 ZCA matrix(though not sure if it is accurate or not), i am still looking for CIFAR100 ZCA matrix and wondering how people will handle dataset like imagenet with few million images???
thanks in advance