Hi,
I am a university student that is currently developing a Pytorch add-on. The add-on would aim to make models train 70%-90% faster.
However, this speed boost while training comes at the expense of model accuracy (approximately 3%-5%).
I was hoping to open a discussion about people’s thoughts on this proposed framework. More specifically, what people think about the speed vs accuracy trade off.