H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark
These could train GPT-3 in 46 hours. (Edited from "11 mins" per https://news.ycombinator.com/item?id=36500154 )An equivalent number of V100's (GPT-3's original GPU) would've taken about 36 days [0].0 – https://www.reddit.com/r/GPT3/comments/p1xf10/comment/h8h3sl...