LoCoCo: Dropping In Convolutions for Long Context Compression Ruisi Cai1, Yuandong Tian2, Zhangyang Wang1, Beidi Chen3, 1University of Texas at Austin, 2Meta AI (FAIR), 3Carnegie Mellon University The code will come out soon!