Skip to content
@LCM-Lab

LCM-Lab

Towards an unbounded context for foundation models

Hi there 👋

This is LCM-Lab, an open-source research team within the OpenNLG Group that focuses on long sequence modeling and optimization. Below is a list of our work—please feel free to explore!

If you have any questions about the code or paper details, please don’t hesitate to open an issue or contact this email [email protected].


🔹 Long Sequence Reward

  • LongRM: Pushing the limits of reward modeling beyond 128K tokens
    Zecheng Tang, Baibei Ji, Quantong Qiu, Haitian Wang, Xiaobo Liang, Juntao Li, Min Zhang.
    GitHub arXiv

  • MemoryRewardBench: Benchmarking Reward Models for Long-Term Memory Management in Large Language Models
    Zecheng Tang, Baibei Ji, Ruoxi Sun, Haitian Wang, WangJie You, Zhang Yijun, Wenpeng Zhu, Ji Qi, Juntao Li, Min Zhang.
    GitHub arXiv

🔹 Long Sequence Evaluation

  • LOOM-Eval: A comprehensive and efficient framework for long-context model evaluation
    Zecheng Tang, Haitian Wang, Quantong Qiu, Baibei Ji, Ruoxi Sun, Keyan Zhou, Juntao Li, Min Zhang .
    GitHub arXiv

  • L-CiteEval (ACL 2025): A faithfulness-oriented benchmark for long-context citation
    Zecheng Tang, Keyan Zhou, Juntao Li, Baibei Ji, Jianye Hou, Min Zhang.
    GitHub ACL Anthology

  • MMLongCite: A Benchmark for Evaluating Fidelity of Long-Context Vision-Language Models
    Keyan Zhou, Zecheng Tang, Lingfeng Ming, Guanghao Zhou, Qiguang Chen, Dan Qiao, Zheming Yang, Libo Qin, Minghui Qiu, Juntao Li, Min Zhang.
    GitHub arXiv

🔹 Long Sequence Modeling & Aligning

  • Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers
    Zecheng Tang, Quantong Qiu, Yi Yang, Zhiyi Hong, Haiya Xiang, Kebin Liu, Qingqing Dang, Juntao Li, Min Zhang.
    GitHub arXiv

  • CDT (ICLR 2026): Context Denoising Training for Long-Context Modeling
    Zecheng Tang, Baibei Ji, Juntao Li, Lijun Wu, Haijia Gui, Min Zhang.
    GitHub ICLR

  • LOGO (ICML 2025): Long cOntext aliGnment via efficient preference Optimization
    Zecheng Tang, Zechen Sun, Juntao Li, Qiaoming Zhu, Min Zhang.
    GitHub ICML

  • Global-Mamba (ACL 2025): Efficient long-context modeling architecture
    Wangjie You, Zecheng Tang, Juntao Li, Lili Yao, Min Zhang.
    GitHub ACL Anthology

Pinned Loading

  1. LOOM-Eval LOOM-Eval Public

    A comprehensive and efficient long-context model evaluation framework

    Python 30 4

  2. L-CITEEVAL L-CITEEVAL Public

    Evaluating the faithfulness of long-context language models

    Python 30 2

  3. context-denoising-training context-denoising-training Public

    context denoising training for long-context modeling

    Python 15 2

  4. LongRM LongRM Public

    Revealing and unlocking the context boundary of reward models

    Python 21 1

  5. LOGO LOGO Public

    Code for paper: Long cOntext aliGnment via efficient preference Optimization

    Jupyter Notebook 24

  6. MemRewardBench MemRewardBench Public

    A benchmark to systematically evaluate Reward Models' ability to assess long-term memory management of LLMs

    9 1

Repositories

Showing 10 of 13 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…