BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching
Paper • 2412.03594 • Published
AI & ML interests
None defined yet.
Recent Activity
Papers
TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxy
Tstars-Tryon 1.0: Robust and Realistic Virtual Try-On for Diverse Fashion Items
