Zhenyu (Allen) Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher R ´e, Clark W. Barrett, Zhangyang Wang, and Beidi Chen. H2o: Heavy-hitter oracle for efficient generative inference of large language mod-els. Ar Xiv, abs/2306. 14048, 2023. URL https://api. semanticscholar. org/ Corpus ID:259263947. Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, and Sujian Li. Pose: Effi-cient context window extension of llms via positional skip-wise training. Ar Xiv, abs/2309. 10400, 2023. URL https://api. semanticscholar. org/Corpus ID:262053659. 11