Show HN: Port of OpenAI's Whisper model in C/C++
Great work. 
It's a real bowl of fresh air coming from huge framework that use cuda.<p>So many different cuda version, with each framework using its own, that all rely on a different driver, and everything needs a new version every 3 months and takes ~10G, (and don't even talk about cudnn needing some manual logged-in install).<p>Here everything is just two files. For embedded system that don't have a GPU it's perfect.<p>Here the parallelization and vectorization has been done by hand, but there is a glimmer of hope coming from the side of various compiler projects :<p>Here is an interesting intel project that does the parallelization and vectorization automatically for different architecture that's definitely worth a look :
<a href="https://ispc.github.io/ispc.html" rel="nofollow">https://ispc.github.io/ispc.html</a><p>For the auto-differentiation when I need performance or memory, I currently use tapenade ( <a href="http://tapenade.inria.fr:8080/tapenade/index.jsp" rel="nofollow">http://tapenade.inria.fr:8080/tapenade/index.jsp</a> ) and/or manually written gradient when I need to fuse some kernel, but Enzyme ( <a href="https://enzyme.mit.edu/" rel="nofollow">https://enzyme.mit.edu/</a> ) is also very promising.<p>MPI for parallelization across machines.