How Video Streaming Processing Works
A quick search for &quot;latency&quot; in here has one little hand-wavey blurb about Mux working to optimize HLS.<p>&gt;Using various content delivery networks, Mux is driving HTTP Live Streaming (HLS) latency down to the lowest levels possible levels, and partnering with the best services at every mile of delivery is crucial in supporting this continued goal.<p>In my experience, HLS and even LLHLS are a nightmare for latency. I jokingly call it &quot;High Latency Streaming&quot;, since it seems very hard to (reliably) obtain glass-to-glass latency in the LL range (under 4 seconds). Usually Latency with cloud streaming gets to at least 30+s.<p>I&#x27;ve dabbled with implementing WebRTC solutions to obtain Ultra Low Latency (&lt;1s) delivery but that is even more complicated and fragmented with all of the browsers vying for standardization. The solution I&#x27;ve cooked up in the lab with mediasoup requires an FFMPEG shim to convert from MPEGTS&#x2F;h264 via UDP&#x2F;SRT to MKV&#x2F;YP9 via RTP, which of course drives up the latency. Mediasoup has a ton of opinionated quirks for RTP ingest too, of course. Still I&#x27;ve been able to prove out 400ms &quot;glass-to-glass&quot; which has been fun.<p>I wonder if Mux or really anyone has intentions to deliver scalable, on cloud or on prem solutions to fill the web-native LL&#x2F;Ultra LL void left by the death of flash. I&#x27;m aware of some niche solutions like Softvelum&#x27;s nimble streamer, but I hate their business model and I don&#x27;t know anything about their scalability.