Xinyue Ma

I build efficient systems for large language models — long-context serving, KV cache reconfiguration, and continual learning on the edge. Advised by Professor Myeongjae Jeon, Graduate School of Artificial Intelligence, OMNIA at POSTECH.

Research Interests

Efficient Systems for LLMs
Continual Learning

Publications

arXiv Preprint

CacheSmith: Accurate RAG Serving under Latency SLOs with Adaptive KV Reuse

Xinyue Ma, Damin Lee, Aashaka Shah, Myeongjae Jeon

arXiv Preprint

ShoreKeeper: Accelerating Iterative Data Analytics in the Cloud via Distributed Recovery-Cost-Aware Caching

Jongseop Lee, Minsu Sun, Xinyue Ma, Atul Sandur, Myeongjae Jeon

arXiv Preprint

DIALER: A Case for Improving Rare-Class Accuracy in Retraining-Free Edge Video Analytics

Dongyoon Ryu, Sungho Jeon, Xinyue Ma, Di Wang, Jonghyun Choi, Minjia Zhang, Myeongjae Jeon

VLDB 2026 ↗

ORBITFLOW: SLO-Aware Long-Context LLM Serving with Fine-Grained KV Cache Reconfiguration

Xinyue Ma*, Heelim Hong*, Taegeon Um, Jongseop Lee, Seoyeong Choy, Woo-Yeon Lee, Myeongjae Jeon  *Equal contribution

NeurIPS 2025 ↗

REP: Resource-Efficient Prompting for Rehearsal-Free Continual Learning

Sungho Jeon, Xinyue Ma, Kwang In Kim, Myeongjae Jeon

ACM MobiCom 2023 ↗

Cost-effective On-device Continual Learning over Memory Hierarchy with Miro

Xinyue Ma, Suyeon Jeong, Minjia Zhang, Di Wang, Jonghyun Choi, Myeongjae Jeon

Experience

2026.9 – 2026.12
Research Intern
Microsoft Research, Redmond — RiSE Group
Effective RL post-training for LLMs
2025.10.12 – 2024.10.13
Web Chair
2024.9 – 2024.12
Research Intern
Microsoft Research, Redmond — RiSE Group
Effective KV cache reuse for retrieval-augmented generation
2023.11 – 2024.2
Research Intern
Microsoft Research Asia — Intelligent Cloud & Edge Group
2024 – Present
Teaching Assistant
POSTECH
AI Systems (2025 Fall)
2022 – 2024
Teaching Assistant
UNIST
Computer Architecture (2023 Fall)
Parallel Computing (2022 Fall)
Advanced Programming (2022 Spring)