Street-Fighting Mathematics
Follow that up with his slightly more advanced The Art of Insight in Science and Engineering [0].I feel like these two books plus Art Benjamin's Secrets of Mental Math [1] would put your Fermi calculation abilities on another level.[0] https://mitpress.mit.edu/books/art-insight-science-and-engin...