Hi @Derek,
Jakub from neptune.ml here.
It feels like Neptune would solve your problems. It helps you keep track of code, hyperparameters, data versions, summary charts (prediction distribution) and things like that. Some time ago I wrote a blog post about it, so feel free to go and read it here  8.
Before you ask, Neptune is open and free for non-organizations.
Read more about it on the product documentation page and check the neptune-contrib read the docs 1 to get a better view.