Show HN: Faster FastAPI with simdjson and io_uring on Linux 5.19
On a tangent, does anyone have code samples of parsing large JSON newline files with simdjson that don't fit into memory? I.e. where the file overall is many GB (more than 4) but individual documents in the top-level are not that big. Most of the code samples for simdjson assume you can load the whole file in memory.<p>I've got an idea for how you can do it with parse_many(json,window) and truncated_bytes() but it would be easier if there were just an example out there I could look at.<p>See pages like [0] and [1] that describe it should be possible but I am just not seeing (or yet able to produce myself) working code.<p>[0] <a href="https://github.com/simdjson/simdjson/issues/188">https://github.com/simdjson/simdjson/issues/188</a><p>[1] <a href="https://github.com/simdjson/simdjson/blob/master/doc/iterate_many.md">https://github.com/simdjson/simdjson/blob/master/doc/iterate...</a>