Abid, Abubakar, Ali Abdalla, Ali Abid, Dawood Khan, Abdulrahman Alfozan, and James Zou. 2019. Gradio: Hassle-Free Sharing and Testing of ML Models in the Wild. https://arxiv.org/abs/1906.02569.

Abnar, Samira, and Willem Zuidema. 2020. “Quantifying Attention Flow in Transformers.” Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/2005.00928.

Aghajanyan, Armen, Sonal Gupta, and Luke Zettlemoyer. 2021. “Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning.” Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/2012.13255.

AI, Meta. 2025. “The Llama 4 Herd: The Beginning of a New Era of Natively Multimodal AI.” Meta AI Blog. https://ai.meta.com/blog/llama-4-multimodal-intelligence/.

AI, Mistral. 2024. “Mistral Large 2.” Mistral AI Blog. https://mistral.ai/news/mistral-large-2407/.

Amodei, Dario, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, and Dan Mané. 2016. “Concrete Problems in AI Safety.” arXiv Preprint arXiv:1606.06565. https://arxiv.org/abs/1606.06565.

An, Yanxu, Li Shen, Yifan Xu, and Xinmei Liu. 2025. “DPPO: Direct Divergence-Based Policy Optimization for Language Model Alignment.” arXiv Preprint arXiv:2503.14532. https://arxiv.org/abs/2503.14532.

Andrychowicz, Marcin, Filip Wolski, Alex Ray, et al. 2017. “Hindsight Experience Replay.” Advances in Neural Information Processing Systems (NeurIPS).

Anthropic. 2024a. Building Effective Agents. https://www.anthropic.com/research/building-effective-agents.

Anthropic. 2024b. Model Context Protocol. https://modelcontextprotocol.io.

Anthropic. 2024c. “The Claude 3 Model Family: Opus, Sonnet, Haiku.” Anthropic Technical Report. https://www.anthropic.com/news/claude-3-family.

Anthropic. 2026. “Natural Language Autoencoders: Interpreting Neural Networks with Natural Language Descriptions.” Anthropic Research Blog. https://www.anthropic.com/research/natural-language-autoencoders.

Asai, Akari, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi. 2023. “Self-RAG: Learning to Retrieve, Generate, and Critique Through Self-Reflection.” arXiv Preprint arXiv:2310.11511. https://arxiv.org/abs/2310.11511.

Azar, Mohammad Gheshlaghi, Mark Rowland, Bilal Piot, et al. 2024. “A General Theoretical Paradigm to Understand Learning from Human Feedback.” arXiv Preprint arXiv:2310.12036. https://arxiv.org/abs/2310.12036.

Ba, Jimmy Lei, Jamie Ryan Kiros, and Geoffrey E. Hinton. 2016. “Layer Normalization.” arXiv Preprint arXiv:1607.06450. https://arxiv.org/abs/1607.06450.

Bai, Yuntao, Andy Jones, Kamal Ndousse, et al. 2022. “Constitutional AI: Harmlessness from AI Feedback.” arXiv Preprint arXiv:2212.08073. https://arxiv.org/abs/2212.08073.

Banerjee, Satanjeev, and Alon Lavie. 2005. “METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments.” Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization. https://aclanthology.org/W05-0909/.

Barkan, Oren, Edan Hauon, Avi Caciularu, Ido Dagan, and Noam Koenigstein. 2021. “Grad-SAM: Explaining Transformers via Gradient Self-Attention Maps.” Proceedings of the 30th ACM International Conference on Information and Knowledge Management (CIKM). https://arxiv.org/abs/2104.13299.

Bellifemine, Fabio Luigi, Giovanni Caire, and Dominic Greenwood. 2007. JADE: Developing Multi-Agent Systems with JADE.

Beltagy, Iz, Matthew E. Peters, and Arman Cohan. 2020. “Longformer: The Long-Document Transformer.” arXiv Preprint arXiv:2004.05150. https://arxiv.org/abs/2004.05150.

Berners-Lee, Tim, James Hendler, and Ora Lassila. 2001. “The Semantic Web.” Scientific American.

Besta, Maciej, Nils Blach, Ales Kubicek, et al. 2024. “Graph of Thoughts: Solving Elaborate Problems with Large Language Models.” Proceedings of the AAAI Conference on Artificial Intelligence.

Beurer-Kellner, Luca, Marc Fischer, and Martin Vechev. 2023. “Prompting Is Programming: A Query Language for Large Language Models.” Proceedings of PLDI.

Bonatti, Rogerio, Dan Zhao, Francesco Bonacci, et al. 2024. “Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale.” arXiv Preprint arXiv:2409.08264. https://arxiv.org/abs/2409.08264.

Bono, Edward de. 1985. Six Thinking Hats.

Bradley, Ralph Allan, and Milton E. Terry. 1952. “Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons.” Biometrika. https://www.jstor.org/stable/2334029.

Bricken, Trenton, Adly Templeton, Joshua Batson, et al. 2023. “Towards Monosemanticity: Decomposing Language Models with Dictionary Learning.” Transformer Circuits Thread. https://transformer-circuits.pub/2023/monosemantic-features/index.html.

Brockman, Greg, Vicki Cheung, Ludwig Pettersson, et al. 2016. OpenAI Gym.

Brown, Tom, Benjamin Mann, Nick Ryder, et al. 2020. “Language Models Are Few-Shot Learners.” NeurIPS.

Burges, Chris, Tal Shaked, Erin Renshaw, et al. 2005. “Learning to Rank Using Gradient Descent.” Proceedings of the 22nd International Conference on Machine Learning (ICML).

Burges, Christopher J. C., Robert Ragno, and Quoc V. Le. 2006. “Learning to Rank with Nonsmooth Cost Functions.” Advances in Neural Information Processing Systems (NeurIPS).

Cai, Tianle, Yuhong Li, Zhengyang Geng, et al. 2024. “Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads.” Proceedings of the 41st International Conference on Machine Learning (ICML). https://arxiv.org/abs/2401.10774.

Campbell, Brian, John Bradley, Nat Sakimura, and Torsten Lodderstedt. 2020. OAuth 2.0 Mutual-TLS Client Authentication and Certificate-Bound Access Tokens. https://datatracker.ietf.org/doc/html/rfc8705.

Campbell, Murray, A. Joseph Hoane Jr., and Feng-hsiung Hsu. 2002. “Deep Blue.” Artificial Intelligence.

Cao, Zhe, Tao Qin, Tie-Yan Liu, Ming-Feng Tsai, and Hang Li. 2007. “Learning to Rank: From Pairwise Approach to Listwise Approach.” Proceedings of the 24th International Conference on Machine Learning (ICML).

Carlini, Nicholas, Florian Tramer, Eric Wallace, et al. 2021. “Extracting Training Data from Large Language Models.” USENIX Security Symposium. https://arxiv.org/abs/2012.07805.

Chainlit. 2024. Chainlit: Build Production-Ready Conversational AI Applications. https://chainlit.io.

Chase, Harrison. 2022. LangChain. https://github.com/langchain-ai/langchain.

Chawla, Kushal, Jaysa Ramirez, Rene Clever, Gale Lucas, Jonathan May, and Jonathan Gratch. 2021. “CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systems.” Proceedings of NAACL.

Chen, Huayu, Guande Zheng, Yimeng Kim, and Yiwen Chen. 2024. “Noise Contrastive Alignment of Language Models with Explicit Rewards.” arXiv Preprint arXiv:2402.05369. https://arxiv.org/abs/2402.05369.

Chen, Jianlv, Shitao Luo, Mingzheng Zhang, Zheng Liu, Yingxia Xiao, and Defu Han. 2022. “Hybrid Retrieval for Open-Domain Question Answering.” arXiv Preprint arXiv:2210.06029. https://arxiv.org/abs/2210.06029.

Chen, Jianlv, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, and Zheng Liu. 2024. “BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation.” arXiv Preprint arXiv:2402.03216.

Chen, Lingjiao, Matei Zaharia, and James Zou. 2023. “FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance.” arXiv Preprint arXiv:2305.05176. https://arxiv.org/abs/2305.05176.

Chen, Mark, Jerry Tworek, Heewoo Jun, et al. 2021. “Evaluating Large Language Models Trained on Code.” arXiv Preprint arXiv:2107.03374. https://arxiv.org/abs/2107.03374.

Chen, Shouyuan, Sherman Wong, Liangjian Chen, and Yuandong Tian. 2023. “Extending Context Window of Large Language Models via Positional Interpolation.” arXiv Preprint arXiv:2306.15595. https://arxiv.org/abs/2306.15595.

Chen, Tianqi, Bing Xu, Chiyuan Zhang, and Carlos Guestrin. 2016. “Training Deep Nets with Sublinear Memory Cost.” arXiv Preprint arXiv:1604.06174.

Chen, Zhiyu, Yiwei Deng, Ruiqi Zhang, Hao Sun, and Weizhu Chen. 2025. “GSPO: Sequence-Level Policy Optimization for Language Model Alignment.” arXiv Preprint arXiv:2502.12459. https://arxiv.org/abs/2502.12459.

Chhikara, Prateek, Dev Khant, Saket Aryan, Taranjeet Singh, and Deshraj Yadav. 2025. “Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory.” arXiv Preprint arXiv:2504.19413. https://arxiv.org/abs/2504.19413.

Choi, Seokhyun, Hyunji Park, Doyoung Moon, Kyuyoung Kim, and Edward Choi. 2025. “GOPO: Group Ordinal Policy Optimization for LLM Alignment with Non-Verifiable Rewards.” arXiv Preprint arXiv:2505.12948. https://arxiv.org/abs/2505.12948.

Chowdhery, Aakanksha, Sharan Narang, Jacob Devlin, et al. 2022. “PaLM: Scaling Language Modeling with Pathways.” arXiv Preprint arXiv:2204.02311.

Chowdhury, Sayak Ray, Anush Chakraborty, Srinadh Natarajan, Alekh Agarwal, and David Sontag. 2024. “Provably Robust DPO: Aligning Language Models with Noisy Feedback.” arXiv Preprint arXiv:2403.00409. https://arxiv.org/abs/2403.00409.

Christiano, Paul F., Jan Leike, Tom B. Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017. “Deep Reinforcement Learning from Human Preferences.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1706.03741.

Chuang, Yung-Sung, Yujia Xie, Hongyin Luo, Yoon Kim, James Glass, and Pengcheng He. 2024. “DoLA: Decoding by Contrasting Layers Improves Factuality in Large Language Models.” Proceedings of the 12th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2309.03883.

Chung, Hyung Won, Le Hou, Shayne Longpre, et al. 2024. “Scaling Instruction-Finetuned Language Models.” Journal of Machine Learning Research. https://arxiv.org/abs/2210.11416.

Cohen, Jacob. 1960. “A Coefficient of Agreement for Nominal Scales.” Educational and Psychological Measurement.

Consortium, World Wide Web. 2022. Decentralized Identifiers (DIDs) v1.0. https://www.w3.org/TR/did-core/.

Cormack, Gordon V., Charles L. A. Clarke, and Stefan Buettcher. 2009. “Reciprocal Rank Fusion Outperforms Condorcet and Individual Rank Learning Methods.” Proceedings of the 32nd International ACM SIGIR Conference.

Cunningham, Hoagy, Aidan Ewart, Logan Riggs, Robert Huben, and Lee Sharkey. 2024. “Sparse Autoencoders Find Highly Interpretable Features in Language Models.” Proceedings of the 12th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2309.08600.

Dao, Tri. 2024. “FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2307.08691.

Dao, Tri, Daniel Y. Fu, Stefano Ermon, Atri Rudra, and Christopher Ré. 2022. “FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2205.14135.

Das, Abhishek, Théophile Gerber, Georgia Gkioxari, Stefan Lee, Devi Parikh, and Dhruv Batra. 2019. “TarMAC: Targeted Multi-Agent Communication.” Proceedings of the 36th International Conference on Machine Learning (ICML). https://arxiv.org/abs/1810.11187.

Databricks. 2024. “DBRX: A New State-of-the-Art Open LLM.” Databricks Blog. https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm.

DeepMind, Google. 2024. AlphaProof and AlphaGeometry 2: Solving Olympiad Geometry Without Human Demonstrations. https://deepmind.google/discover/blog/ai-solves-imo-problems-at-silver-medal-level/.

DeepSeek-AI. 2024a. “DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model.” arXiv Preprint arXiv:2405.04434. https://arxiv.org/abs/2405.04434.

DeepSeek-AI. 2024b. “DeepSeek-V3 Technical Report.” arXiv Preprint arXiv:2412.19437. https://arxiv.org/abs/2412.19437.

DeepSeek-AI, Daya Guo, Dejian Yang, et al. 2025. “DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.” arXiv Preprint arXiv:2501.12948. https://arxiv.org/abs/2501.12948.

Deng, Xiang, Yu Gu, Boyuan Zheng, et al. 2023. “Mind2Web: Towards a Generalist Agent for the Web.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2306.06070.

Dennis, Michael, Natasha Jaques, Eugene Vinitsky, et al. 2020. “Emergent Complexity and Zero-Shot Transfer via Unsupervised Environment Design.” Advances in Neural Information Processing Systems (NeurIPS).

Dettmers, Tim, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. “QLoRA: Efficient Finetuning of Quantized Language Models.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2305.14314.

Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. “BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding.” Proceedings of NAACL-HLT. https://arxiv.org/abs/1810.04805.

Dong, Yixin, Charlie Moon, Yuekai Wang, et al. 2024. “XGrammar: Flexible and Efficient Structured Generation Engine for Large Language Models.” arXiv Preprint arXiv:2411.15100.

Du, Yilun, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum, and Igor Mordatch. 2023. “Improving Factuality and Reasoning in Language Models Through Multiagent Debate.” Proceedings of the 41st International Conference on Machine Learning (ICML). https://arxiv.org/abs/2305.14325.

Duan, Yan, John Schulman, Xi Chen, Peter L. Bartlett, Ilya Sutskever, and Pieter Abbeel. 2016. “RL2: Fast Reinforcement Learning via Slow Reinforcement Learning.” arXiv Preprint arXiv:1611.02779.

Durfee, Edmund H., Victor R. Lesser, and Daniel D. Corkill. 1989. “Trends in Cooperative Distributed Problem Solving.” IEEE Transactions on Knowledge and Data Engineering. https://doi.org/10.1109/69.43404.

Ebbinghaus, Hermann. 1885. Über Das Gedächtnis: Untersuchungen Zur Experimentellen Psychologie.

Edge, Darren, Ha Trinh, Newman Cheng, et al. 2024. “From Local to Global: A Graph RAG Approach to Query-Focused Summarization.” arXiv Preprint arXiv:2404.16130. https://arxiv.org/abs/2404.16130.

Egiazarian, Vage, Andrei Panferov, Denis Kuznedelev, Elias Frantar, Artem Babber, and Dan Alistarh. 2024. “Extreme Compression of Large Language Models via Additive Quantization.” arXiv Preprint arXiv:2401.06118. https://arxiv.org/abs/2401.06118.

Elo, Arpad E. 1978. The Rating of Chess Players, Past and Present.

Es, Shahul, Jithin James, Luis Espinosa-Anke, and Steven Schockaert. 2023. “RAGAs: Automated Evaluation of Retrieval Augmented Generation.” arXiv Preprint arXiv:2309.15217. https://arxiv.org/abs/2309.15217.

Ethayarajh, Kawin. 2019. “How Contextual Are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings.” Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://arxiv.org/abs/1909.00512.

Ethayarajh, Kawin, Winnie Xu, Niklas Muennighoff, Dan Jurafsky, and Douwe Kiela. 2024. “KTO: Model Alignment as Prospect Theoretic Optimization.” arXiv Preprint arXiv:2402.01306. https://arxiv.org/abs/2402.01306.

Face, Hugging. 2025. OpenEnv: An Interface Library for RL Post-Training with Environments. https://github.com/huggingface/OpenEnv.

Fedus, William, Barret Zoph, and Noam Shazeer. 2022. “Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity.” Journal of Machine Learning Research.

Ferrucci, David, Eric Brown, Jennifer Chu-Carroll, et al. 2010. “Building Watson: An Overview of the DeepQA Project.” AI Magazine.

Firth, John Rupert. 1957. “A Synopsis of Linguistic Theory, 1930–1955.” Studies in Linguistic Analysis.

Fleiss, Joseph L. 1971. “Measuring Nominal Scale Agreement Among Many Raters.” Psychological Bulletin.

Formal, Thibault, Carlos Lassance, Benjamin Piwowarski, and Stéphane Clinchant. 2021. “SPLADE v2: Sparse Lexical and Expansion Model for Information Retrieval.” arXiv Preprint arXiv:2109.10086.

Formal, Thibault, Benjamin Piwowarski, and Stéphane Clinchant. 2021. “SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking.” Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.

Forte, Tiago. 2022. Building a Second Brain: A Proven Method to Organize Your Digital Life and Unlock Your Creative Potential.

Francis, Nadime, Alastair Green, Paolo Guagliardo, et al. 2018. “Cypher: An Evolving Query Language for Property Graphs.” Proceedings of the 2018 International Conference on Management of Data (SIGMOD).

Frantar, Elias, and Dan Alistarh. 2023. “SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot.” Proceedings of the 40th International Conference on Machine Learning (ICML). https://arxiv.org/abs/2301.00774.

Frantar, Elias, Saleh Ashkboos, Torsten Hoefler, and Dan Alistarh. 2023. “GPTQ: Accurate Post-Training Quantization for Generative Pre-Trained Transformers.” arXiv Preprint arXiv:2210.17323. https://arxiv.org/abs/2210.17323.

Fu, Yao, Rameswar Panda, Xinyao Niu, et al. 2024. “Data Engineering for Scaling Language Models to 128K Context.” arXiv Preprint arXiv:2402.10171. https://arxiv.org/abs/2402.10171.

Fu, Yichao, Peter Bailis, Ion Stoica, and Hao Zhang. 2024. “Break the Sequential Dependency of LLM Inference Using Lookahead Decoding.” arXiv Preprint arXiv:2402.02057. https://arxiv.org/abs/2402.02057.

Gal, Avigdor, Ateret Anaby-Tavor, Alberto Trombetta, and Danilo Montesi. 2005. “A Framework for Modeling and Evaluating Automatic Semantic Reconciliation.” Proceedings of the 31st International Conference on Very Large Data Bases (VLDB). https://link.springer.com/chapter/10.1007/11896548_42.

Gallegos, Isabel O., Ryan A. Rossi, Joe Barber, Shanshan Tong, et al. 2024. “Bias and Fairness in Large Language Models: A Survey.” Computational Linguistics. https://arxiv.org/abs/2309.00770.

Gao, Leo, John Schulman, and Jacob Hilton. 2023. “Scaling Laws for Reward Model Overoptimization.” Proceedings of the 40th International Conference on Machine Learning (ICML).

Gao, Luyu, Xueguang Ma, Jimmy Lin, and Jamie Callan. 2023. “Precise Zero-Shot Dense Retrieval Without Relevance Labels.” Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/2212.10496.

Garcı́a, Javier, and Fernando Fernández. 2015. “A Comprehensive Survey on Safe Reinforcement Learning.” Journal of Machine Learning Research.

Gemini Team, Google. 2024. “Gemini 1.5: Unlocking Multimodal Understanding Across Millions of Tokens of Context.” arXiv Preprint arXiv:2403.05530. https://arxiv.org/abs/2403.05530.

Gerganov, Georgi. 2023. GGUF: GPT-Generated Unified Format (llama.cpp). https://github.com/ggerganov/llama.cpp.

Geva, Mor, Roei Schuster, Jonathan Berant, and Omer Levy. 2021. “Transformer Feed-Forward Layers Are Key-Value Memories.” Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP).

Gloeckle, Fabian, Badr Youbi Idrissi, Baptiste Rozière, David Lopez-Paz, and Gabriel Synnaeve. 2024. “Better & Faster Large Language Models via Multi-Token Prediction.” Proceedings of the 41st International Conference on Machine Learning (ICML). https://arxiv.org/abs/2404.19737.

Goodhart, Charles A. E. 1984. “Problems of Monetary Management: The U.K. Experience.” Monetary Theory and Practice.

Google. 2025. Agent2Agent (A2A) Protocol. https://developers.google.com/agent2agent.

Gorbatenko, Alexander. 2024. “Online DPO with Synchronised Reference Model Updates.” TRL Documentation.

Grassé, Pierre-Paul. 1959. “La Reconstruction Du Nid Et Les Coordinations Interindividuelles Chez Bellicositermes Natalensis Et Cubitermes Sp. La Théorie de La Stigmergie: Essai d’interprétation Du Comportement Des Termites Constructeurs.” Insectes Sociaux.

Grattafiori, Aaron, Abhimanyu Dubey, Abhinav Jauhri, et al. 2024. “The Llama 3 Herd of Models.” arXiv Preprint arXiv:2407.21783. https://arxiv.org/abs/2407.21783.

Graves, Alex, Greg Wayne, Malcolm Reynolds, et al. 2016. “Hybrid Computing Using a Neural Network with Dynamic External Memory.” Nature.

Greshake, Kai, Sahar Abdelnabi, Shailesh Mishra, Christoph Endres, Thorsten Holz, and Mario Fritz. 2023. “Not What You’ve Signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection.” Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security (AISec).

Group, JSON-RPC Working. 2010. JSON-RPC 2.0 Specification. https://www.jsonrpc.org/specification.

Gu, Albert, and Tri Dao. 2023. “Mamba: Linear-Time Sequence Modeling with Selective State Spaces.” arXiv Preprint arXiv:2312.00752. https://arxiv.org/abs/2312.00752.

Gu, Albert, and Tri Dao. 2024. “Mamba: Linear-Time Sequence Modeling with Selective State Spaces.” Proceedings of the 41st International Conference on Machine Learning (ICML). https://arxiv.org/abs/2312.00752.

Guo, Chuan, Geoff Pleiss, Yu Sun, and Kilian Q. Weinberger. 2017. “On Calibration of Modern Neural Networks.” International Conference on Machine Learning (ICML).

Guo, Mandy, Joshua Ainslie, David Uthus, et al. 2022. “LongT5: Efficient Text-to-Text Transformer for Long Sequences.” Findings of the Association for Computational Linguistics: NAACL 2022. https://arxiv.org/abs/2112.07916.

Guo, Ruiqi, Philip Sun, Erik Lindgren, et al. 2020. “Accelerating Large-Scale Inference with Anisotropic Vector Quantization.” International Conference on Machine Learning (ICML).

Guo, Shangmin, Biao Zhang, Tianlin Liu, et al. 2024. “Direct Language Model Alignment from Online AI Feedback.” arXiv Preprint arXiv:2402.04792. https://arxiv.org/abs/2402.04792.

Guu, Kelvin, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang. 2020. “REALM: Retrieval-Augmented Language Model Pre-Training.” Proceedings of the 37th International Conference on Machine Learning (ICML). https://arxiv.org/abs/2002.08909.

Haarnoja, Tuomas, Aurick Zhou, Pieter Abbeel, and Sergey Levine. 2018. “Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor.” Proceedings of the 35th International Conference on Machine Learning (ICML). https://arxiv.org/abs/1801.01290.

Hafner, Danijar, Timothy Lillicrap, Jimmy Ba, and Mohammad Norouzi. 2020. “Dream to Control: Learning Behaviors by Latent Imagination.” Proceedings of the 8th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1912.01603.

Han, Chi, Minlie Li, and Wenting Chen. 2025. “SAPO: Soft Adaptive Policy Optimization for Efficient LLM Alignment.” arXiv Preprint arXiv:2503.01739. https://arxiv.org/abs/2503.01739.

Han, Daniel, and Michael Han. 2024. Unsloth: Efficient LLM Fine-Tuning. https://github.com/unslothai/unsloth.

Hardt, Dick. 2012. The OAuth 2.0 Authorization Framework. https://datatracker.ietf.org/doc/html/rfc6749.

Harris, Steve, and Andy Seaborne. 2013. SPARQL 1.1 Query Language. https://www.w3.org/TR/sparql11-query/.

Hayes-Roth, Barbara. 1985. “A Blackboard Architecture for Control.” Artificial Intelligence. https://doi.org/10.1016/0004-3702(85)90063-3.

Hayou, Soufiane, Nikhil Ghosh, and Bin Yu. 2024. “LoRA+: Efficient Low Rank Adaptation of Large Models.” arXiv Preprint arXiv:2402.12354. https://arxiv.org/abs/2402.12354.

Hendrycks, Dan, Collin Burns, Steven Basart, et al. 2021. “Measuring Massive Multitask Language Understanding.” International Conference on Learning Representations (ICLR).

Herbrich, Ralf, Tom Minka, and Thore Graepel. 2006. “TrueSkill: A Bayesian Skill Rating System.” Advances in Neural Information Processing Systems (NeurIPS). https://proceedings.neurips.cc/paper/2006/hash/f44ee263952e65b3610b8ba51229d1f9-Abstract.html.

Hinton, Geoffrey, Oriol Vinyals, and Jeff Dean. 2015. “Distilling the Knowledge in a Neural Network.” arXiv Preprint arXiv:1503.02531.

Hoffmann, Jordan, Sebastian Borgeaud, Arthur Mensch, et al. 2022. “Training Compute-Optimal Large Language Models.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2203.15556.

Hong, Jiwoo, Noah Lee, and James Thorne. 2024. “ORPO: Monolithic Preference Optimization Without Reference Model.” arXiv Preprint arXiv:2403.07691. https://arxiv.org/abs/2403.07691.

Hong, Sirui, Mingchen Zhuge, Jonathan Chen, et al. 2024. MetaGPT: Meta Programming for a Multi-Agent Collaborative Framework.

Hosseini, Arian, Xingdi Yuan, Pascal Poupart, Adam Trischler, and Yoshua Bengio. 2024. “V-STaR: Training Verifiers for Self-Taught Reasoners.” arXiv Preprint arXiv:2402.06457.

Houlsby, Neil, Andrei Giber, Stanislaw Jastrzebski, et al. 2019. “Parameter-Efficient Transfer Learning for NLP.” International Conference on Machine Learning (ICML). https://arxiv.org/abs/1902.00751.

Hsu, Pin-Lun, Yun Dai, Vignesh Kothapalli, et al. 2024. “Liger-Kernel: Efficient Triton Kernels for LLM Training.” arXiv Preprint arXiv:2410.10989. https://arxiv.org/abs/2410.10989.

Hu, Edward J., Yelong Shen, Phillip Wallis, et al. 2022a. “LoRA: Low-Rank Adaptation of Large Language Models.” arXiv Preprint arXiv:2106.09685.

Hu, Edward J., Yelong Shen, Phillip Wallis, et al. 2022b. “LoRA: Low-Rank Adaptation of Large Language Models.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2106.09685.

Hu, Jian, Xibin Tao, Weixun Zhu, Sicheng Yang, Jingwen Liu, and Zilin Li. 2024. “OpenRLHF: An Easy-to-Use, Scalable and High-Performance RLHF Framework.” arXiv Preprint arXiv:2405.11143.

Hu, Qinghao, Shang Yang, et al. 2025. “Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter.” arXiv Preprint arXiv:2511.16665. https://arxiv.org/abs/2511.16665.

Hu, Shengding, Yuge Tu, Xu Han, et al. 2024. “MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies.” arXiv Preprint arXiv:2404.06395. https://arxiv.org/abs/2404.06395.

Huang, Qian, Jian Vora, Percy Liang, and Jure Leskovec. 2024. “MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation.” Proceedings of the 41st International Conference on Machine Learning (ICML). https://arxiv.org/abs/2310.03302.

Huang, Yanping, Youlong Cheng, Ankur Bapna, et al. 2019. “GPipe: Efficient Training of Giant Neural Networks Using Pipeline Parallelism.” Advances in Neural Information Processing Systems (NeurIPS).

Hubinger, Evan, Carson Denison, Jesse Mu, et al. 2024. “Sleeper Agents: Training Deceptive LLMs That Persist Through Safety Training.” arXiv Preprint arXiv:2401.05566.

Inc, LangChain. 2024a. LangGraph Studio: The First Agent IDE. https://github.com/langchain-ai/langgraph-studio.

Inc, LangChain. 2024b. LangGraph: Build Stateful Multi-Actor Applications with LLMs. https://github.com/langchain-ai/langgraph.

Inc, Streamlit. 2024. Streamlit: The Fastest Way to Build and Share Data Apps. https://streamlit.io.

Intelligent Physical Agents, Foundation for. 2002. FIPA ACL Message Structure Specification. http://www.fipa.org/specs/fipa00061/.

Irving, Geoffrey, Paul Christiano, and Dario Amodei. 2018. “AI Safety via Debate.” arXiv Preprint arXiv:1805.00899. https://arxiv.org/abs/1805.00899.

Jaderberg, Max, Wojciech M. Czarnecki, Iain Dunning, et al. 2019. “Human-Level Performance in 3D Multiplayer Games with Population-Based Reinforcement Learning.” Science. https://www.science.org/doi/10.1126/science.aau6249.

Jain, Neel, Ping-yeh Chiang, Yuxin Wen, et al. 2024. “NEFTune: Noisy Embeddings Improve Instruction Finetuning.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2310.05914.

Jain, Sarthak, and Byron C. Wallace. 2019. “Attention Is Not Explanation.” Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL). https://arxiv.org/abs/1902.10186.

Jang, Eric, Shixiang Gu, and Ben Poole. 2017. “Categorical Reparameterization with Gumbel-Softmax.” International Conference on Learning Representations (ICLR).

Jeong, Soyeong, Jinheon Baek, Sukmin Cho, Sung Ju Hwang, and Jong C. Park. 2024. “Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models Through Question Complexity.” arXiv Preprint arXiv:2403.14403. https://arxiv.org/abs/2403.14403.

Ji, Jiatao, Adam Fisch, Jason Weston, and Sainbayar Sukhbaatar. 2024. “Towards Exact Optimization of Language Model Alignment.” arXiv Preprint arXiv:2402.05369. https://arxiv.org/abs/2402.05369.

Ji, Ziwei, Nayeon Lee, Rita Frieske, et al. 2023. “Survey of Hallucination in Natural Language Generation.” ACM Computing Surveys. https://arxiv.org/abs/2202.03629.

Jiang, Albert Q., Alexandre Sablayrolles, Arthur Mensch, et al. 2023. “Mistral 7B.” arXiv Preprint arXiv:2310.06825. https://arxiv.org/abs/2310.06825.

Jiang, Albert Q., Alexandre Sablayrolles, Antoine Roux, et al. 2024. “Mixtral of Experts.” arXiv Preprint arXiv:2401.04088. https://arxiv.org/abs/2401.04088.

Jiang, Minqi, Edward Grefenstette, and Tim Rocktäschel. 2021. “Prioritized Level Replay.” Proceedings of the 38th International Conference on Machine Learning (ICML). https://arxiv.org/abs/2010.03934.

Jimenez, Carlos E., John Yang, Alexander Wettig, et al. 2024. “SWE-bench: Can Language Models Resolve Real-World GitHub Issues?” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2310.06770.

Jin, Bowen, Hansi Zeng, et al. 2025. “Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning.” arXiv Preprint arXiv:2503.09516.

Johnson, Jeff, Matthijs Douze, and Hervé Jégou. 2021. “Billion-Scale Similarity Search with GPUs.” IEEE Transactions on Big Data.

Jones, Michael, John Bradley, and Nat Sakimura. 2015. JSON Web Token (JWT). https://datatracker.ietf.org/doc/html/rfc7519.

Joshi, Mandar, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer. 2017. “TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension.” Proceedings of ACL.

Jumper, John, Richard Evans, Alexander Pritzel, et al. 2021. “Highly Accurate Protein Structure Prediction with AlphaFold.” Nature.

Kadavath, Saurav, Tom Conerly, Amanda Askell, et al. 2022. “Language Models (Mostly) Know What They Know.” arXiv Preprint arXiv:2207.05221. https://arxiv.org/abs/2207.05221.

Kalajdzievski, Damjan. 2023. “A Rank Stabilization Scaling Factor for Fine-Tuning with LoRA.” arXiv Preprint arXiv:2312.03732. https://arxiv.org/abs/2312.03732.

Kaplan, Jared, Sam McCandlish, Tom Henighan, et al. 2020. “Scaling Laws for Neural Language Models.” arXiv Preprint arXiv:2001.08361. https://arxiv.org/abs/2001.08361.

Karpukhin, Vladimir, Barlas Oğuz, Sewon Min, et al. 2020. “Dense Passage Retrieval for Open-Domain Question Answering.” Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://arxiv.org/abs/2004.04906.

Khattab, Omar, Arnav Singhvi, Paridhi Maheshwari, et al. 2024. “DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines.” Proceedings of the 12th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2310.03714.

Khattab, Omar, and Matei Zaharia. 2020. “ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT.” Proceedings of the 43rd International ACM SIGIR Conference. https://arxiv.org/abs/2004.12832.

Kim, Seungone, Se June Jang, et al. 2023. “Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes.” Findings of the ACL. https://arxiv.org/abs/2305.02301.

Kingma, Diederik P., and Jimmy Ba. 2015. “Adam: A Method for Stochastic Optimization.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1412.6980.

Kirkpatrick, James, Razvan Pascanu, Neil Rabinowitz, et al. 2017. “Overcoming Catastrophic Forgetting in Neural Networks.” Proceedings of the National Academy of Sciences.

Kocsis, Levente, and Csaba Szepesvári. 2006. “Bandit Based Monte-Carlo Planning.” European Conference on Machine Learning (ECML).

Koh, Jing Yu, Robert Lo, Lawrence Jang, et al. 2024. “VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks.” Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/2401.13649.

Kojima, Takeshi, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. “Large Language Models Are Zero-Shot Reasoners.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2205.11916.

Kopiczko, Dawid Jan, Tijmen Blankevoort, and Markus Nagel. 2024. “VeRA: Vector-Based Random Matrix Adaptation.” arXiv Preprint arXiv:2310.11454. https://arxiv.org/abs/2310.11454.

Korthikanti, Vijay Anand, Jared Casper, Sangkug Lym, et al. 2023. “Reducing Activation Recomputation in Large Transformer Models.” Proceedings of Machine Learning and Systems (MLSys).

Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton. 2012. “ImageNet Classification with Deep Convolutional Neural Networks.” NeurIPS.

Kuhn, Lorenz, Yarin Gal, and Sebastian Farquhar. 2023. “Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2302.09664.

Küttler, Heinrich, Nantas Nardelli, Alexander H. Miller, et al. 2020. “The NetHack Learning Environment.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2006.13760.

Kwiatkowski, Tom, Jennimaria Palomaki, Olivia Redfield, et al. 2019. “Natural Questions: A Benchmark for Question Answering Research.” Transactions of the Association for Computational Linguistics.

Kwon, Woosuk, Zhuohan Li, Siyuan Zhuang, et al. 2023. “Efficient Memory Management for Large Language Model Serving with PagedAttention.” Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles (SOSP). https://arxiv.org/abs/2309.06180.

Lacroix, Timothée, Guillaume Obozinski, and Nicolas Usunier. 2020. “Tensor Decompositions for Temporal Knowledge Base Completion.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2004.04926.

Lála, Jakub, Odhran O’Donoghue, Aleksandar Shtedritski, Sam Cox, Samuel G. Rodriques, and Andrew D. White. 2023. “PaperQA: Retrieval-Augmented Generative Agent for Scientific Research.” arXiv Preprint arXiv:2312.07559. https://arxiv.org/abs/2312.07559.

Lambert, Nathan, Jacob Morrison, Valentina Pyatkin, et al. 2024. “Tülu 3: Pushing Frontiers in Open Language Model Post-Training.” arXiv Preprint arXiv:2411.15124. https://arxiv.org/abs/2411.15124.

Lazaridou, Angeliki, and Marco Baroni. 2020. “Emergent Multi-Agent Communication in the Deep Learning Era.” arXiv Preprint arXiv:2006.02419. https://arxiv.org/abs/2006.02419.

Le, Hung, Yue Wang, Akhilesh Deepak Gotmare, Silvio Savarese, and Steven Hoi. 2023. “CodeRL: Mastering Code Generation Through Pretrained Models and Deep Reinforcement Learning.” Advances in Neural Information Processing Systems (NeurIPS).

Le Sellier De Chezelles, Thibault, Maxime Gasse, Alexandre Drouin, Massimo Caccia, et al. 2024. “The BrowserGym Ecosystem for Web Agent Research.” arXiv Preprint arXiv:2412.05467. https://arxiv.org/abs/2412.05467.

Lee, Chankyu, Rajarshi Roy, Menber Xu, et al. 2024. “NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models.” arXiv Preprint arXiv:2405.17428.

Lee, Katherine, Daphne Ippolito, Andrew Nystrom, et al. 2022. “Deduplicating Training Data Makes Language Models Better.” Proceedings of the 60th Annual Meeting of the ACL. https://arxiv.org/abs/2107.06499.

Lester, Brian, Rami Al-Rfou, and Noah Constant. 2021. “The Power of Scale for Parameter-Efficient Prompt Tuning.” Proceedings of the 2021 Conference on EMNLP. https://arxiv.org/abs/2104.08691.

Leviathan, Yaniv, Matan Kalman, and Yossi Matias. 2023. “Fast Inference from Transformers via Speculative Decoding.” Proceedings of the 40th International Conference on Machine Learning (ICML). https://arxiv.org/abs/2211.17192.

Lewis, Mike, Yinhan Liu, Naman Goyal, et al. 2020. “BART: Denoising Sequence-to-Sequence Pre-Training for Natural Language Generation, Translation, and Comprehension.” Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/1910.13461.

Lewis, Mike, Denis Yarats, Yann N. Dauphin, Devi Parikh, and Dhruv Batra. 2017. “Deal or No Deal? End-to-End Learning for Negotiation Dialogues.” Proceedings of EMNLP.

Lewis, Patrick, Ethan Perez, Aleksandra Piktus, et al. 2020. “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2005.11401.

Li, Shen, Yanli Zhao, Rohan Varma, et al. 2020. “PyTorch Distributed: Experiences on Accelerating Data Parallel Training.” Proceedings of the VLDB Endowment.

Li, Xiang Lisa, and Percy Liang. 2021. “Prefix-Tuning: Optimizing Continuous Prompts for Generation.” Proceedings of the 59th Annual Meeting of the ACL. https://arxiv.org/abs/2101.00190.

Li, Xian, Ari Holtzman, Daniel Fried, et al. 2023. “Contrastive Decoding: Open-Ended Text Generation as Optimization.” ACL.

Li, Yuhui, Fangyun Wei, Chao Zhang, and Hongyang Zhang. 2024. “EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty.” Proceedings of the 41st International Conference on Machine Learning (ICML). https://arxiv.org/abs/2401.15077.

Li, Zehan, Xin Zhang, Yanzhao Zhang, Dingkun Long, Pengjun Xie, and Meishan Zhang. 2023. “Towards General Text Embeddings with Multi-Stage Contrastive Learning.” arXiv Preprint arXiv:2308.03281.

Lightman, Hunter, Vineet Kosaraju, Yura Burda, et al. 2023. “Let’s Verify Step by Step.” arXiv Preprint arXiv:2305.20050.

Lin, Chin-Yew. 2004. “ROUGE: A Package for Automatic Evaluation of Summaries.” Text Summarization Branches Out: Proceedings of the ACL-04 Workshop. https://aclanthology.org/W04-1013/.

Lin, Ji, Jiaming Tang, Haotian Tang, et al. 2024. “AWQ: Activation-Aware Weight Quantization for LLM Compression and Acceleration.” Proceedings of Machine Learning and Systems (MLSys). https://arxiv.org/abs/2306.00978.

Lin, Kevin, Charlie Snell, Yu Wang, et al. 2025. “Sleep-Time Compute: Beyond Inference Scaling at Test-Time.” arXiv Preprint arXiv:2504.13171. https://arxiv.org/abs/2504.13171.

Lin, Long-Ji. 1992. “Self-Improving Reactive Agents Based on Reinforcement Learning, Planning and Teaching.” Machine Learning.

Lin, Xiaoqiang, Aritra Ghosh, Bryan Kian Hsiang Low, Anshumali Shrivastava, and Vijai Mohan. 2025. “REFRAG: Rethinking RAG Based Decoding.” arXiv Preprint arXiv:2509.01092.

Liu, Haokun, Derek Tam, Mohammed Muqeeth, et al. 2022. “Few-Shot Parameter-Efficient Fine-Tuning Is Better and Cheaper Than in-Context Learning.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2205.05638.

Liu, Hao, Matei Zaharia, and Pieter Abbeel. 2023. “Ring Attention with Blockwise Transformers for Near-Infinite Context.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2310.01889.

Liu, Jiachang, Dinghan Shen, Yizhe Zhang, Bill Dolan, Lawrence Carin, and Weizhu Chen. 2022. “What Makes Good in-Context Examples for GPT-3?” Proceedings of Deep Learning Inside Out (DeeLIO), ACL Workshop. https://arxiv.org/abs/2101.06804.

Liu, Nelson F., Kevin Lin, John Hewitt, et al. 2024b. “Lost in the Middle: How Language Models Use Long Contexts.” Transactions of the Association for Computational Linguistics. https://arxiv.org/abs/2307.03172.

Liu, Nelson F., Kevin Lin, John Hewitt, et al. 2024a. “Lost in the Middle: How Language Models Use Long Contexts.” Transactions of the Association for Computational Linguistics. https://arxiv.org/abs/2307.03172.

Liu, Qiguang et al. 2025. “Answer Convergence as a Signal for Early Stopping in Reasoning.” Proceedings of EMNLP. https://aclanthology.org/2025.emnlp-main.904/.

Liu, Shih-Yang, Chien-Yi Wang, Hongxu Yin, et al. 2024. “DoRA: Weight-Decomposed Low-Rank Adaptation.” arXiv Preprint arXiv:2402.09353. https://arxiv.org/abs/2402.09353.

Liu, Xiao, Hao Yu, Hanchen Zhang, et al. 2023. “AgentBench: Evaluating LLMs as Agents.” arXiv Preprint arXiv:2308.03688.

Liu, Xingyu et al. 2025. “Learning Like Humans: Advancing LLM Reasoning Capabilities via Adaptive Difficulty Curriculum Learning.” arXiv Preprint arXiv:2505.08364. https://arxiv.org/abs/2505.08364.

Liu, Yang, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. 2023. “G-Eval: NLG Evaluation Using GPT-4 with Better Human Alignment.” Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://arxiv.org/abs/2303.16634.

Liu, Yihao, Lefan Han, Yifan Tan, et al. 2025. “Understanding and Mitigating the Pretraining Distribution Bias in GRPO.” arXiv Preprint arXiv:2505.07888. https://arxiv.org/abs/2505.07888.

Liu, Yinhan, Myle Ott, Naman Goyal, et al. 2019. “RoBERTa: A Robustly Optimized BERT Pretraining Approach.” arXiv Preprint arXiv:1907.11692. https://arxiv.org/abs/1907.11692.

Liu, Zechun, Barlas Oguz, Changsheng Zhao, et al. 2023. “LLM-QAT: Data-Free Quantization Aware Training for Large Language Models.” arXiv Preprint arXiv:2305.17888. https://arxiv.org/abs/2305.17888.

Liu, Zhuokai, Hao Dong, et al. 2025. “DLER: Doing Length Penalty Right—Incentivizing More Intelligence Per Token.” arXiv Preprint arXiv:2510.15110. https://arxiv.org/abs/2510.15110.

Liu, Zirui, Jiayi Yuan, Hongye Jin, et al. 2024. “KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache.” International Conference on Machine Learning (ICML). https://arxiv.org/abs/2402.02750.

Loshchilov, Ilya, and Frank Hutter. 2019. “Decoupled Weight Decay Regularization.” arXiv Preprint arXiv:1711.05101. https://arxiv.org/abs/1711.05101.

Lowe, Ryan, Yi Wu, Aviv Tamar, Jean Harb, Pieter Abbeel, and Igor Mordatch. 2017. “Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1706.02275.

Lu, Chris, Cong Lu, Robert Tjarko Lange, Jakob Foerster, Jeff Clune, and David Ha. 2024. “The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery.” arXiv Preprint arXiv:2408.06292. https://arxiv.org/abs/2408.06292.

Lu, Yao, Max Bartolo, Alastair Moore, Sebastian Riedel, and Pontus Stenetorp. 2022. “Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity.” Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/2104.08786.

Luo, Zhenyu, Ziyan Chen, Yulun Jiang, et al. 2025. “ScaleRL: Scaling Reinforcement Learning for LLM Reasoning.” arXiv Preprint arXiv:2505.16356. https://arxiv.org/abs/2505.16356.

Luo, Zhixun, Jiaqi Shi, Tao Yu, and Minlie Chen. 2025. “VESPO: Variational Sequence-Level Soft Policy Optimization for LLM Alignment.” arXiv Preprint arXiv:2505.07508. https://arxiv.org/abs/2505.07508.

Madaan, Aman, Niket Tandon, Prakhar Gupta, et al. 2023. “Self-Refine: Iterative Refinement with Self-Feedback.” Advances in Neural Information Processing Systems (NeurIPS).

Maharana, Adyasha, Dong-Ho Lee, Sergey Tuber, Mohit Ruber, Francesco Barbieri, and Mohit Bansal. 2024. “LoCoMo: Long-Context Conversation with Memory Operations.” Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP).

Malkov, Yu. A., and D. A. Yashunin. 2020. “Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World Graphs.” IEEE Transactions on Pattern Analysis and Machine Intelligence.

Manakul, Potsawee, Adian Liusie, and Mark J. F. Gales. 2023. “SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models.” Proceedings of EMNLP. https://arxiv.org/abs/2303.08896.

McCandlish, Sam, Jared Kaplan, Dario Amodei, and OpenAI Dota Team. 2018. “An Empirical Model of Large-Batch Training.” arXiv Preprint arXiv:1812.06162.

Mei, Jiangfei et al. 2025. “APRIL: Active Partial Rollouts in Reinforcement Learning to Tame Long-Tail Generation.” arXiv Preprint arXiv:2509.18521. https://arxiv.org/abs/2509.18521.

Meng, Yu, Mengzhou Xia, and Danqi Chen. 2024. “SimPO: Simple Preference Optimization with a Reference-Free Reward.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2405.14734.

Mialon, Grégoire, Clémentine Fourrier, Craig Swift, Thomas Wolf, Yann LeCun, and Thomas Scialom. 2024. “GAIA: A Benchmark for General AI Assistants.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2311.12983.

Micikevicius, Paulius, Sharan Narang, Jonah Alben, et al. 2018. “Mixed Precision Training.” International Conference on Learning Representations (ICLR).

Microsoft. 2023. Semantic Kernel: SDK for Integrating AI Models into Applications. https://github.com/microsoft/semantic-kernel.

Min, Sewon, Xinxi Lyu, Ari Holtzman, et al. 2022. “Rethinking the Role of Demonstrations: What Makes in-Context Learning Work?” Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://arxiv.org/abs/2202.12837.

Mnih, Volodymyr, Adrià Puigdomènech Badia, Mehdi Mirza, et al. 2016. “Asynchronous Methods for Deep Reinforcement Learning.” Proceedings of the 33rd International Conference on Machine Learning (ICML). https://arxiv.org/abs/1602.01783.

Mnih, Volodymyr, Koray Kavukcuoglu, David Silver, et al. 2015. “Human-Level Control Through Deep Reinforcement Learning.” Nature. https://www.nature.com/articles/nature14236.

MosaicML. 2023. “MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs.” MosaicML Blog. https://www.mosaicml.com/blog/mpt-7b.

Moura, João. 2023. CrewAI: Framework for Orchestrating Role-Playing Autonomous AI Agents. https://github.com/crewAIInc/crewAI.

Nakano, Reiichiro, Jacob Hilton, Suchir Balaji, et al. 2021. “WebGPT: Browser-Assisted Question-Answering with Human Feedback.” arXiv Preprint arXiv:2112.09332. https://arxiv.org/abs/2112.09332.

Narayanan, Deepak, Aaron Harlap, Amar Phanishayee, et al. 2019. “PipeDream: Generalized Pipeline Parallelism for DNN Training.” Proceedings of the 27th ACM Symposium on Operating Systems Principles (SOSP).

Narayanan, Deepak, Mohammad Shoeybi, Jared Casper, et al. 2021. “Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM.” arXiv Preprint arXiv:2104.04473.

Ng, Andrew Y., Daishi Harada, and Stuart J. Russell. 1999. “Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping.” Proceedings of the 16th International Conference on Machine Learning (ICML).

Nguyen, Minh. 2024. “Min-p Sampling: A Simple Baseline for Better LLM Decoding.” arXiv Preprint arXiv:2310.06022.

Nisan, Noam, Tim Roughgarden, Éva Tardos, and Vijay V. Vazirani. 2007. Algorithmic Game Theory. https://www.cs.cmu.edu/~sandholm/cs15-892F13/algorithmic-game-theory.pdf.

Nogueira, Rodrigo, and Kyunghyun Cho. 2019. “Passage Re-Ranking with BERT.” arXiv Preprint arXiv:1901.04085.

Nogueira, Rodrigo, Zhiying Jiang, Ronak Pradeep, and Jimmy Lin. 2020. “Document Ranking with a Pretrained Sequence-to-Sequence Model.” Findings of EMNLP.

Nye, Maxwell, Anders Johan Andreassen, Guy Gur-Ari, et al. 2021. “Show Your Work: Scratchpads for Intermediate Computation with Language Models.” arXiv Preprint arXiv:2112.00114. https://arxiv.org/abs/2112.00114.

Olsson, Catherine, Nelson Elhage, Neel Nanda, et al. 2022. “In-Context Learning and Induction Heads.” Transformer Circuits Thread. https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html.

OpenAI. 2023. “GPT-4 Technical Report.” arXiv Preprint arXiv:2303.08774.

OpenAI. 2024a. Learning to Reason with LLMs. https://openai.com/index/learning-to-reason-with-llms/.

OpenAI. 2024b. Swarm: An Educational Framework for Lightweight Multi-Agent Orchestration. https://github.com/openai/swarm.

OpenAI. 2025a. OpenAI Agents SDK. https://github.com/openai/openai-agents-python.

OpenAI. 2025b. OpenAI o3 and o4-mini System Card. https://openai.com/index/o3-and-o4-mini-system-card/.

Ouyang, Long, Jeffrey Wu, Xu Jiang, et al. 2022. “Training Language Models to Follow Instructions with Human Feedback.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2203.02155.

Packer, Charles, Vivian Fang, Shishir G. Patil, Kevin Lin, Sarah Wooders, and Joseph E. Gonzalez. 2023. “MemGPT: Towards LLMs as Operating Systems.” arXiv Preprint arXiv:2310.08560. https://arxiv.org/abs/2310.08560.

Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. “BLEU: A Method for Automatic Evaluation of Machine Translation.” Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL). https://aclanthology.org/P02-1040/.

Parasuraman, Raja, and Victor Riley. 1997. “Humans and Automation: Use, Misuse, Disuse, Abuse.” Human Factors. https://doi.org/10.1518/001872097778543886.

Park, Joon Sung, Joseph C. O’Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2023. “Generative Agents: Interactive Simulacra of Human Behavior.” Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST). https://arxiv.org/abs/2304.03442.

Pathak, Deepak, Pulkit Agrawal, Alexei A. Efros, and Trevor Darrell. 2017. “Curiosity-Driven Exploration by Self-Supervised Prediction.” Proceedings of the 34th International Conference on Machine Learning (ICML).

Patil, Shishir G., Tianjun Zhang, Xin Wang, and Joseph E. Gonzalez. 2024. “Gorilla: Large Language Model Connected with Massive APIs.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2305.15334.

Peng, Bo, Eric Alcaide, Quentin Anthony, et al. 2023. “RWKV: Reinventing RNNs for the Transformer Era.” Findings of the Association for Computational Linguistics: EMNLP 2023. https://arxiv.org/abs/2305.13048.

Peng, Bowen, Jeffrey Quesnelle, Honglu Fan, and Enrico Shao. 2023. “YaRN: Efficient Context Window Extension of Large Language Models.” arXiv Preprint arXiv:2309.00071.

Perez, Ethan, Saffron Huang, Francis Song, et al. 2022. “Red Teaming Language Models with Language Models.” Proceedings of EMNLP. https://arxiv.org/abs/2202.03286.

Plackett, R. L. 1975. “The Analysis of Permutations.” Journal of the Royal Statistical Society: Series C (Applied Statistics).

Press, Ofir, Noah A. Smith, and Mike Lewis. 2022. “Train Short, Test Long: Attention with Linear Biases Enables Input Length Generalization.” ICLR.

Preston-Werner, Tom. 2024. Semantic Versioning 2.0.0. https://semver.org/.

Putta, Pranav, Edmund Mills, Naman Garg, et al. 2024. “Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents.” arXiv Preprint arXiv:2408.07199.

Qi, Penghui, Xinyi Wan, Guangxing Huang, and Min Lin. 2023. “Zero Bubble Pipeline Parallelism.” arXiv Preprint arXiv:2401.10241.

Qi, Zhenting, Mingyuan Wan, Jialin Cao, and Min Lin. 2024. “Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers.” arXiv Preprint arXiv:2408.06195.

Qin, Yiwei, Xuefeng Li, Haoyang Zou, et al. 2024. “O1 Replication Journey: A Strategic Progress Report.” arXiv Preprint arXiv:2410.18982. https://arxiv.org/abs/2410.18982.

Qin, Yujia, Shihao Liang, Yining Ye, et al. 2024. “ToolLLM: Facilitating Large Language Models to Master 16000+ Real-World APIs.” Proceedings of the 12th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2307.16789.

Rackauckas, Adrian H. 2024. RAG-Fusion: A New Take on Retrieval-Augmented Generation.

Radford, Alec, Jeffrey Wu, Rewon Child, David Luen, Dario Amodei, and Ilya Sutskever. 2019. “Language Models Are Unsupervised Multitask Learners.” OpenAI Blog. https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf.

Rafailov, Rafael, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn. 2023. “Direct Preference Optimization: Your Language Model Is Secretly a Reward Model.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2305.18290.

Raffel, Colin, Noam Shazeer, Adam Roberts, et al. 2020. “Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.” Journal of Machine Learning Research. https://arxiv.org/abs/1910.10683.

Rajbhandari, Samyam, Jeff Rasley, Olatunji Rber, and Yuxiong He. 2020. “ZeRO: Memory Optimizations Toward Training Trillion Parameter Models.” arXiv Preprint arXiv:1910.02054.

Rajbhandari, Samyam, Olatunji Ruwase, Jeff Rasley, Shaden Smith, and Yuxiong He. 2021. “ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning.” arXiv Preprint arXiv:2104.07857.

Rashid, Tabish, Mikayel Samvelyan, Christian Schroeder de Witt, Gregory Farquhar, Jakob Foerster, and Shimon Whiteson. 2018. “QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning.” Proceedings of the 35th International Conference on Machine Learning (ICML). https://arxiv.org/abs/1803.11605.

Rescorla, Eric. 2018. The Transport Layer Security (TLS) Protocol Version 1.3. https://datatracker.ietf.org/doc/html/rfc8446.

Robbins, Herbert, and Sutton Monro. 1951. “A Stochastic Approximation Method.” The Annals of Mathematical Statistics.

Robertson, Stephen, and Hugo Zaragoza. 2009. “The Probabilistic Relevance Framework: BM25 and Beyond.” Foundations and Trends in Information Retrieval.

Rumelhart, David E., Geoffrey E. Hinton, and Ronald J. Williams. 1986. “Learning Representations by Back-Propagating Errors.” Nature. https://doi.org/10.1038/323533a0.

Rummery, Gavin A., and Mahesan Niranjan. 1994. On-Line q-Learning Using Connectionist Systems.

Sanh, Victor, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. “DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter.” arXiv Preprint arXiv:1910.01108.

Santhanam, Keshav, Omar Khattab, Jon Saad-Falcon, Christopher Potts, and Matei Zaharia. 2022. “ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction.” Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL).

Schaul, Tom, John Quan, Ioannis Antonoglou, and David Silver. 2016. “Prioritized Experience Replay.” Proceedings of the 4th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1511.05952.

Schick, Timo, Jane Dwivedi-Yu, Roberto Dessì, et al. 2023. “Toolformer: Language Models Can Teach Themselves to Use Tools.” Advances in Neural Information Processing Systems.

Schrittwieser, Julian, Ioannis Antonoglou, Thomas Hubert, et al. 2020. “Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model.” Nature. https://arxiv.org/abs/1911.08265.

Schulman, John, Sergey Levine, Pieter Abbeel, Michael Jordan, and Philipp Moritz. 2015. “Trust Region Policy Optimization.” Proceedings of the 32nd International Conference on Machine Learning (ICML). https://arxiv.org/abs/1502.05477.

Schulman, John, Philipp Moritz, Sergey Levine, Michael Jordan, and Pieter Abbeel. 2016. “High-Dimensional Continuous Control Using Generalized Advantage Estimation.” Proceedings of the 4th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1506.02438.

Schulman, John, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. “Proximal Policy Optimization Algorithms.” arXiv Preprint arXiv:1707.06347. https://arxiv.org/abs/1707.06347.

Sennrich, Rico, Barry Haddow, and Alexandra Birch. 2016. “Neural Machine Translation of Rare Words with Subword Units.” Proceedings of the 54th Annual Meeting of the ACL. https://arxiv.org/abs/1508.07909.

Sergeev, Alexander, and Mike Del Balso. 2018. “Horovod: Fast and Easy Distributed Deep Learning in TensorFlow.” arXiv Preprint arXiv:1802.05799.

Shah, Jay, Ganesh Bikshandi, Ying Zhang, Vijay Thakkar, Pradeep Ramani, and Tri Dao. 2024. “FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-Precision.” arXiv Preprint arXiv:2407.08691. https://arxiv.org/abs/2407.08691.

Shao, Zhihong, Peiyi Wang, Qihao Zhu, et al. 2024. “DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models.” arXiv Preprint arXiv:2402.03300. https://arxiv.org/abs/2402.03300.

Shapley, Lloyd S. 1953. “Stochastic Games.” Proceedings of the National Academy of Sciences. https://www.pnas.org/doi/10.1073/pnas.39.10.1095.

Shazeer, Noam, Azalia Mirhoseini, Krzysztof Maziarz, et al. 2017. “Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1701.06538.

Shinn, Noah, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2023. “Reflexion: Language Agents with Verbal Reinforcement Learning.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2303.11366.

Shoeybi, Mohammad, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro. 2019. “Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.” arXiv Preprint arXiv:1909.08053.

Shoham, Yoav, and Kevin Leyton-Brown. 2008. Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. http://www.masfoundations.org/.

Shridhar, Mohit, Xingdi Yuan, Marc-Alexandre Côté, Yonatan Bisk, Adam Trischler, and Matthew Hausknecht. 2021. “ALFWorld: Aligning Text and Embodied Environments for Interactive Learning.” International Conference on Learning Representations (ICLR).

Silver, David, Aja Huang, Chris J. Maddison, et al. 2016. “Mastering the Game of Go with Deep Neural Networks and Tree Search.” Nature. https://www.nature.com/articles/nature16961.

Silver, David, Julian Schrittwieser, Karen Simonyan, et al. 2017. “Mastering the Game of Go Without Human Knowledge.” Nature. https://www.nature.com/articles/nature24270.

Skalse, Joar, Nikolaus Howe, Dmitrii Krasheninnikov, and David Krueger. 2022. “Defining and Characterizing Reward Hacking.” Advances in Neural Information Processing Systems. https://arxiv.org/abs/2209.13085.

Smith, Reid G. 1980. “The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver.” IEEE Transactions on Computers. https://doi.org/10.1109/TC.1980.1675516.

Snell, Charlie, Jaehoon Lee, Kelvin Xu, and Aviral Kumar. 2024. “Scaling LLM Test-Time Compute Optimally Can Be More Effective Than Scaling Model Parameters.” arXiv Preprint arXiv:2408.03314.

Sparck Jones, Karen. 1972. “A Statistical Interpretation of Term Specificity and Its Application in Retrieval.” Journal of Documentation.

Squire, Larry R. 1992. “Declarative and Nondeclarative Memory: Multiple Brain Systems Supporting Learning and Memory.” Journal of Cognitive Neuroscience. https://doi.org/10.1162/jocn.1992.4.3.232.

Stiennon, Nisan, Long Ouyang, Jeffrey Wu, et al. 2020. “Learning to Summarize from Human Feedback.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2009.01325.

Su, Jianlin, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. 2024. “RoFormer: Enhanced Transformer with Rotary Position Embedding.” Neurocomputing.

Su, Jianlin, Jiarun Cao, Weijie Liu, and Yangyiwen Ou. 2021. “Whitening Sentence Representations for Better Semantics and Faster Retrieval.” arXiv Preprint arXiv:2103.15316. https://arxiv.org/abs/2103.15316.

Sukhbaatar, Sainbayar, Arthur Szlam, and Rob Fergus. 2016. “Learning Multiagent Communication with Backpropagation.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1605.07736.

Sukhbaatar, Sainbayar, Arthur Szlam, Jason Weston, and Rob Fergus. 2015. “End-to-End Memory Networks.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1503.08895.

Sumers, Theodore R., Shunyu Yao, Karthik Narasimhan, and Thomas L. Griffiths. 2024. “Cognitive Architectures for Language Agents.” Transactions on Machine Learning Research (TMLR). https://arxiv.org/abs/2309.02427.

Sun, Mingjie, Zhuang Liu, Anna Bair, and J. Zico Kolter. 2024. “A Simple and Effective Pruning Approach for Large Language Models.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2306.11695.

Sutton, Richard S. 1988. “Learning to Predict by the Methods of Temporal Differences.” Machine Learning.

Sutton, Richard S., and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction. http://incompleteideas.net/book/the-book-2nd.html.

Team, Meta PyTorch. 2025. TorchForge: PyTorch-Native Post-Training at Scale. https://github.com/meta-pytorch/torchforge.

Team, PyTorch. 2024. Torchtune: PyTorch Native Post-Training Library. https://github.com/pytorch/torchtune.

Team, Qwen. 2024a. “Qwen2.5: A Party of Foundation Models.” arXiv Preprint arXiv:2412.15115. https://arxiv.org/abs/2412.15115.

Team, Qwen. 2024b. “QwQ: Reflect Deeply on the Boundaries of the Unknown.” Qwen Blog. https://qwenlm.github.io/blog/qwq-32b-preview/.

Team, Qwen. 2025. “Qwen3 Technical Report.” arXiv Preprint arXiv:2505.09388.

Templeton, Adly, Tom Conerly, Jonathan Marcus, et al. 2024. “Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet.” Transformer Circuits Thread. https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html.

Todd, Eric, Millicent L. Li, Arnab Sen Sharma, Aaron Mueller, Byron C. Wallace, and David Bau. 2024. “Function Vectors in Large Language Models.” Proceedings of the 12th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2310.15213.

Towers, Mark, Ariel Kwiatkowski, Jordan Terry, et al. 2024. “Gymnasium: A Standard Interface for Reinforcement Learning Environments.” NeurIPS Datasets and Benchmarks. https://arxiv.org/abs/2407.17032.

Tulving, Endel. 1985. “Memory and Consciousness.” Canadian Psychology / Psychologie Canadienne.

Vaswani, Ashish, Noam Shazeer, Niki Parmar, et al. 2017. “Attention Is All You Need.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1706.03762.

Vercel. 2024. Vercel AI SDK. https://sdk.vercel.ai.

Vig, Jesse. 2019. “A Multiscale Visualization of Attention in the Transformer Model.” Proceedings of the 57th ACL: System Demonstrations. https://arxiv.org/abs/1906.05714.

Vijayakumar, Ashwin K., Michael Cogswell, Ramprasaath R. Selvaraju, et al. 2018. “Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models.” AAAI.

Voita, Elena, David Talbot, Fedor Moiseev, Rico Sennrich, and Ivan Titov. 2019. “Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned.” Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/1905.09418.

Wang, Guanzhi, Yuqi Xie, Yunfan Jiang, et al. 2023. “Voyager: An Open-Ended Embodied Agent with Large Language Models.” arXiv Preprint arXiv:2305.16291. https://arxiv.org/abs/2305.16291.

Wang, Junkang, Jianfei Duan, Yue Liu, Zhangchen Yue, Hanghang Tong, and James Wang. 2024. “Beyond Reverse KL: Generalizing Direct Preference Optimization with Diverse Divergence Constraints.” Proceedings of the 12th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2309.16240.

Wang, Lei, Wanyu Xu, Yiber Lan, et al. 2023. “Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models.” Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/2305.04091.

Wang, Peiyi, Lei Li, Zhihong Shao, et al. 2024. “Math-Shepherd: Verify and Reinforce LLMs Step-by-Step Without Human Annotations.” arXiv Preprint arXiv:2312.08935. https://arxiv.org/abs/2312.08935.

Wang, Xingyao, Boxuan Ding, Ziniu Hoang, et al. 2024. “OpenHands: An Open Platform for AI Software Developers as Generalist Agents.” arXiv Preprint arXiv:2407.16741.

Wang, Xuezhi, Jason Wei, Dale Schuurmans, Quoc Le, et al. 2023. “Self-Consistency Improves Chain of Thought Reasoning in Language Models.” Proceedings of the 11th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2203.11171.

Wang, Xuezhi, Jason Wei, Dale Schuurmans, Quoc V. Le, et al. 2023. “Self-Consistency Improves Chain of Thought Reasoning in Language Models.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2203.11171.

Wang, Yifan et al. 2025. “Improving Data Efficiency for LLM Reinforcement Fine-Tuning via Difficulty-Targeted Online Data Selection.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2506.05316.

Wang, Yizhong, Yeganeh Kordi, Swaroop Mishra, et al. 2022. “Self-Instruct: Aligning Language Models with Self-Generated Instructions.” arXiv Preprint arXiv:2212.10560. https://arxiv.org/abs/2212.10560.

Watkins, Christopher J. C. H. 1989. Learning from Delayed Rewards.

Wei, Jason, Xuezhi Wang, Dale Schuurmans, et al. 2022. “Chain-of-Thought Prompting Elicits Reasoning in Large Language Models.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2201.11903.

Weiss, Gerhard. 1999. Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence.

Werra, Leandro von, Younes Belkada, Lewis Tunstall, et al. 2022. TRL: Transformer Reinforcement Learning. https://github.com/huggingface/trl.

Weston, Jason, Sumit Chopra, and Antoine Bordes. 2015. “Memory Networks.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1410.3916.

Willard, Brandon T., and Rémi Louf. 2023. “Efficient Guided Generation for Large Language Models.” arXiv Preprint arXiv:2307.09702. https://arxiv.org/abs/2307.09702.

Williams, Ronald J. 1992. “Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning.” Machine Learning. https://link.springer.com/article/10.1007/BF00992696.

Wilson, Edwin B. 1927. “Probable Inference, the Law of Succession, and Statistical Inference.” Journal of the American Statistical Association. https://www.jstor.org/stable/2276774.

Wooldridge, Michael. 2009. An Introduction to MultiAgent Systems.

Wooldridge, Michael, Nicholas R. Jennings, and David Kinny. 2000. “The Gaia Methodology for Agent-Oriented Analysis and Design.” Autonomous Agents and Multi-Agent Systems.

Workshop, BigScience. 2023. “BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.” arXiv Preprint arXiv:2211.05100. https://arxiv.org/abs/2211.05100.

Wu, Di, Hongwei Wang, Wenhao Yu, Yuwei Zhang, Kai-Wei Chang, and Dong Yu. 2025. “LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2410.10813.

Wu, Qingyun, Gagan Bansal, Jieyu Zhang, et al. 2023. “AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation.” arXiv Preprint arXiv:2308.08155.

Wu, Zhengbao, Aman Arora, Zhiqiang Wang, Byung-Gon Kim, and Tian Huang. 2024. “Retrieval Head Mechanistically Explains Long-Context Factuality.” arXiv Preprint arXiv:2404.15574. https://arxiv.org/abs/2404.15574.

Wu, Zhenyu, Qinghua Hu, Yin Zhang, Yiming Gao, and Jiangtao Chen. 2024. “An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models.” arXiv Preprint arXiv:2408.00724.

Xi, Zhiheng, Yiwen Ding, Wenxiang Chen, et al. 2024. “AgentGym: Evolving Large Language Model-Based Agents Across Diverse Environments.” arXiv Preprint arXiv:2406.04151. https://arxiv.org/abs/2406.04151.

Xia, Fen, Tie-Yan Liu, Jue Wang, Wensheng Zhang, and Hang Li. 2008. “Listwise Approach to Learning to Rank: Theory and Algorithm.” Proceedings of the 25th International Conference on Machine Learning (ICML).

Xiao, Guangxuan, Ji Lin, Mickael Seznec, Hao Wu, Julien Demouth, and Song Han. 2023. “SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models.” Proceedings of the 40th International Conference on Machine Learning (ICML). https://arxiv.org/abs/2211.10438.

Xiao, Guangxuan, Yuandong Tian, Beidi Chen, Song Han, and Mike Lewis. 2024a. “Efficient Streaming Language Models with Attention Sinks.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2309.17453.

Xiao, Guangxuan, Yuandong Tian, Beidi Chen, Song Han, and Mike Lewis. 2024b. “Efficient Streaming Language Models with Attention Sinks.” Proceedings of the 12th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2309.17453.

Xiao, Shitao, Zheng Liu, Peitian Zhang, and Niklas Muennighoff. 2023. “C-Pack: Packaged Resources to Advance General Chinese Embedding.” arXiv Preprint arXiv:2309.07597.

Xie, Sang Michael, Aditi Raghunathan, Percy Liang, and Tengyu Ma. 2022. “An Explanation of in-Context Learning as Implicit Bayesian Inference.” Proceedings of the 10th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2111.02080.

Xie, Tianbao, Danyang Zhang, Jixuan Chen, et al. 2024. “OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments.” Advances in Neural Information Processing Systems.

Xu, Can, Qingfeng Sun, Kai Zheng, et al. 2023. “WizardLM: Empowering Large Language Models to Follow Complex Instructions.” arXiv Preprint arXiv:2304.12244. https://arxiv.org/abs/2304.12244.

Xu, Haoxiang, Hongyuan Zhao, Ying Liu, and Dong Wei. 2025. “It Takes Two: Pairwise Preference Optimization with Two Rollouts.” arXiv Preprint arXiv:2505.07856. https://arxiv.org/abs/2505.07856.

Xu, Wujiang, Zujie Liang, Kai Mei, Hang Gao, Juntao Tan, and Yongfeng Zhang. 2025. “A-Mem: Agentic Memory for LLM Agents.” Advances in Neural Information Processing Systems (NeurIPS).

Yan, Shi-Qi, Jia-Chen Gu, Yun Zhu, and Zhen-Hua Ling. 2024. “Corrective Retrieval Augmented Generation.” arXiv Preprint arXiv:2401.15884. https://arxiv.org/abs/2401.15884.

Yang, Chengrun, Xuezhi Wang, Yifeng Lu, et al. 2024. “Large Language Models as Optimizers.” Proceedings of the 12th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2309.03409.

Yang, Jingwen, Yuxuan Zhu, Binyuan Wang, et al. 2025. “ARQ: Attentive Reasoning Queries for Multi-Hop Question Answering over Long Contexts.” arXiv Preprint arXiv:2501.08290. https://arxiv.org/abs/2501.08290.

Yang, John, Carlos E. Jimenez, Alexander Wettig, et al. 2024. “SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2405.15793.

Yang, Zhilin, Zihang Dai, Yiming Yang, Jaime Carbonell, Ruslan Salakhutdinov, and Quoc V. Le. 2019. “XLNet: Generalized Autoregressive Pretraining for Language Understanding.” Advances in Neural Information Processing Systems (NeurIPS).

Yang, Zhilin, Peng Qi, Saizheng Zhang, et al. 2018. “HotpotQA: A Dataset for Diverse, Explainable Multi-Hop Question Answering.” Proceedings of EMNLP.

Yao, Shunyu, Dian Yu, Jeffrey Zhao, et al. 2023. “Tree of Thoughts: Deliberate Problem Solving with Large Language Models.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2305.10601.

Yao, Shunyu, Dian Yu, Jeffrey Zhao, et al. 2024. “Tree of Thoughts: Deliberate Problem Solving with Large Language Models.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2305.10601.

Yao, Shunyu, Jeffrey Zhao, Dian Yu, et al. 2023. “ReAct: Synergizing Reasoning and Acting in Language Models.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2210.03629.

Yao, Zhewei, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al. 2023. “DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-Like Models at All Scales.” arXiv Preprint arXiv:2308.01320.

Yoo, Jaeseok, and Dongmin Shin. 2025. “Adaptive Episode Length Adjustment for Multi-Agent Reinforcement Learning.” Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS).

Yu, Gyeong-In, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, and Byung-Gon Chun. 2022. “Orca: A Distributed Serving System for Transformer-Based Generative Models.” Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI).

Yu, Qiying, Zheng Sun, Shang Wen, et al. 2025. “DAPO: An Open-Source LLM Reinforcement Learning System.” arXiv Preprint arXiv:2503.14476. https://arxiv.org/abs/2503.14476.

Yu, Xiao, Baolin Peng, Ruize Xu, et al. 2026. “Reinforcement World Model Learning for LLM-Based Agents.” arXiv Preprint arXiv:2602.05842.

Zadouri, Ted, Jay Shah, Ganesh Bikshandi, and Tri Dao. 2026. “FlashAttention-4: Hardware-Efficient Attention on Blackwell GPUs with Minimal Software Design.” arXiv Preprint arXiv:2603.05451. https://arxiv.org/abs/2603.05451.

Zaheer, Manzil, Guru Guruganesh, Kumar Avinava Dubey, et al. 2020. “Big Bird: Transformers for Longer Sequences.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2007.14062.

Zaken, Elad Ben, Shauli Ravfogel, and Yoav Goldberg. 2022. “BitFit: Simple Parameter-Efficient Fine-Tuning for Transformer-Based Masked Language-Models.” Proceedings of the 60th Annual Meeting of the ACL. https://arxiv.org/abs/2106.10199.

Zelikman, Eric, Georges Harik, Yijia Shao, Varuna Jayasiri, Nick Haber, and Noah D. Goodman. 2024. “Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking.” arXiv Preprint arXiv:2403.09629. https://arxiv.org/abs/2403.09629.

Zelikman, Eric, Yuhuai Wu, Jesse Mu, and Noah D. Goodman. 2022. “STaR: Bootstrapping Reasoning with Reasoning.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2203.14465.

Zhang, Alex L., Seyyed Hasan Mahdavi, Percy Liang, and Tatsunori Hashimoto. 2025. “Recursive Language Models.” arXiv Preprint arXiv:2512.24601. https://arxiv.org/abs/2512.24601.

Zhang, Biao, and Rico Sennrich. 2019. “Root Mean Square Layer Normalization.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1910.07467.

Zhang, Jiayi, Simon Yu, Derek Chong, et al. 2025. “Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity.” arXiv Preprint arXiv:2510.01171. https://arxiv.org/abs/2510.01171.

Zhang, Kaiqing, Zhuoran Yang, and Tamer Başar. 2021. “Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms.” Handbook of Reinforcement Learning and Control. https://arxiv.org/abs/1911.10635.

Zhang, Qingru, Minshuo Chen, Alexander Bukharin, et al. 2023. “AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning.” arXiv Preprint arXiv:2303.10512. https://arxiv.org/abs/2303.10512.

Zhang, Tianjun, Shishir G. Patil, Naman Jain, et al. 2024. “RAFT: Adapting Language Model to Domain Specific RAG.” arXiv Preprint arXiv:2403.10131. https://arxiv.org/abs/2403.10131.

Zhang, Tianyi, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020. “BERTScore: Evaluating Text Generation with BERT.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1904.09675.

Zhang, Xinrong, Yingfa Chen, Shengding Hu, et al. 2024. “InfiniteBench: Extending Long Context Evaluation Beyond 100K Tokens.” Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL). https://arxiv.org/abs/2402.13718.

Zhang, Zhenyu, Ying Sheng, Tianyi Zhou, et al. 2023. “H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2306.14048.

Zhao, Yanli, Andrew Gu, Rohan Varma, et al. 2023. “PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.” Proceedings of the VLDB Endowment.

Zhao, Yao, Rishabh Joshi, Tianqi Liu, Misha Khalman, Mohammad Saleh, and Peter J. Liu. 2023. “SLiC-HF: Sequence Likelihood Calibration with Human Feedback.” arXiv Preprint arXiv:2305.10425. https://arxiv.org/abs/2305.10425.

Zheng, Lianmin, Wei-Lin Chiang, Ying Sheng, et al. 2023. “Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2306.05685.

Zhong, Yanqi, Yifu Chen, Zijun Li, and Minlie Chen. 2025. “Importance Sampling Corrections for Large Language Model Alignment with Asynchronous Generation.” arXiv Preprint arXiv:2503.09057. https://arxiv.org/abs/2503.09057.

Zhong, Yanqi, Jiaqi Shi, Yifu Chen, and Minlie Chen. 2025. “GDPO: Learning to Directly Align Language Models with Group-Decoupled Reward.” arXiv Preprint arXiv:2501.17888. https://arxiv.org/abs/2501.17888.

Zhou, Andy, Kai Yan, Michal Shlapentokh-Rothman, Haohan Wang, and Yu-Xiong Wang. 2024. “Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models.” arXiv Preprint arXiv:2310.04406.

Zhou, Chunting, Pengfei Liu, Puxin Xu, et al. 2023. “LIMA: Less Is More for Alignment.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2305.11206.

Zhou, Shuyan, Frank F. Xu, Hao Zhu, et al. 2024. “WebArena: A Realistic Web Environment for Building Autonomous Agents.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2307.13854.

Zhou, Yongchao, Andrei Ioan Muresanu, Ziwen Han, et al. 2023. “Large Language Models Are Human-Level Prompt Engineers.” Proceedings of the 11th International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2211.01910.

Ziegler, Daniel M., Nisan Stiennon, Jeffrey Wu, et al. 2019. “Fine-Tuning Language Models from Human Preferences.” arXiv Preprint arXiv:1909.08593. https://arxiv.org/abs/1909.08593.

Zou, Andy, Zifan Wang, J. Zico Kolter, and Matt Fredrikson. 2023. “Universal and Transferable Adversarial Attacks on Aligned Language Models.” arXiv Preprint arXiv:2307.15043. https://arxiv.org/abs/2307.15043.