I’m excited by onnx as I’ve shifted my development to pytorch and production performance is a concern.  I haven’t seen any benchmarking that compares tf-serving and caffe in terms of throughput on fixed hardware.  I’d also love to see examples of caffe2 deployed in production using flask or some other serving mechanism, particularly in a digestable format like a blog post.  Has anyone seen that sort of thing before?  I’ve seen an example targeting AWS lambda but the performance benchmarks there weren’t anywhere close to what we’re getting with a dedicated tf-serving server.
Also wondering… Is there an equivalent caffe2 discussion forum like pytorch?  I did a quick google and didn’t see anything that seemed solid like this forum.
thanks
Even