H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark
These could train GPT-3 in 46 hours. (Edited from "11 mins" per <a href="https://news.ycombinator.com/item?id=36500154">https://news.ycombinator.com/item?id=36500154</a> )<p>An equivalent number of V100's (GPT-3's original GPU) would've taken about 36 days [0].<p>0 – <a href="https://www.reddit.com/r/GPT3/comments/p1xf10/comment/h8h3sl4/?utm_source=reddit&utm_medium=web2x&context=3" rel="nofollow noreferrer">https://www.reddit.com/r/GPT3/comments/p1xf10/comment/h8h3sl...</a>