--- title: "Beyond End-to-End — paper by Wu et al. (2026)" description: "Their framework, CHAINFED, replaces end-to-end updates with a sequential chain: one layer's adapter… 3 references, cited by 2 papers here." authors: ["Yebo Wu", "Jingguang Li", "Chunlin Tian", "KaHou Tam", "Zhijiang Guo", "Li Li"] year: 2026 venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)" source: "https://aclanthology.org/2026.acl-long.839/" doi: "10.18653/v1/2026.acl-long.839" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/wu-2026-beyond-end-end-dynamic-chain/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wu-2026-beyond-end-end-dynamic-chain/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/7/) / Beyond End-to-End: Dynamic Chain Optimization for Private LLM Adaptation on the Edge # Beyond End-to-End: Dynamic Chain Optimization for Private LLM Adaptation on the Edge **Authors:** [Yebo Wu](https://md.research.elamur.ai/free/en/authors/yebo-wu/), Jingguang Li, Chunlin Tian, KaHou Tam, [Zhijiang Guo](https://md.research.elamur.ai/free/en/authors/zhijiang-guo/) and [Li Li](https://md.research.elamur.ai/free/en/authors/li-li/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.839/) · [PDF](https://aclanthology.org/2026.acl-long.839.pdf) · [DOI 10.18653/v1/2026.acl-long.839](https://doi.org/10.18653/v1/2026.acl-long.839) · [OpenAlex](https://openalex.org/W7166846147) **Citations:** 0 citations (OpenAlex, 2026-10-14) · [2](https://md.research.elamur.ai/free/en/papers/wu-2026-beyond-end-end-dynamic-chain/cited-by/) in our library, of the 149,439 papers whose bibliographies we read ## Summary Federated fine-tuning lets LLMs be adapted to private data that never leaves user devices. However, even adapter-based approaches still require the whole model in memory, which excludes phones and other edge hardware with roughly 4–12GB. The authors show that frozen base weights, not activations or adapters, dominate this footprint. Their framework, CHAINFED, replaces end-to-end updates with a sequential chain: one layer's adapter is trained to convergence, frozen, and the next layer is then added, so only a small part of the network is active at once. Three components address weaknesses of this layer-wise scheme: - **Dynamic Layer Co-Tuning** jointly trains a sliding window of neighbouring adapters to close semantic gaps. - **Globally Perceptive Optimization** blends the full-model objective into each local loss. - **Function-Oriented Adaptive Tuning** decides at which layer tuning should begin. On text classification (e.g., YELP-P, AGNEWS) and instruction tuning with LLaMA models, CHAINFED beats existing methods by up to 46.46% average accuracy while cutting peak memory several-fold. This makes federated LLM adaptation feasible on edge devices. ## Key points - Memory profiling with adapters: LLaMA2-7B needs about 27.1GB (base parameters 91.2%, activations 6.9%, adapter 1.9%), and LLaMA2-13B needs about 50.8GB (parameters 94.1%). - In BERT experiments, memory-constrained participation lowers accuracy on YELP-P by 8.5% (IID) and 11.8% (non-IID) compared with an idealized setting. - Tuning only upper layers (threshold T = 0.8) works better than tuning the full chain, by up to 4.43% on AGNEWS. On that dataset it also exceeds idealized Full Adapters by 3.29%, with 2.02× faster convergence and 3.47× less communication. - Instruction tuning (MMLU, BBH, DROP, CRASS): - LLaMA2-7B with Q = 6 cuts peak memory by 4.29× while improving on all four benchmarks. - LLaMA3.1-8B gains up to 10.71% average accuracy with 3.45× less memory. - Ablation on DistilBERT: removing DLCT, GPO, or FOAT lowers average accuracy by 11.64%, 13.73%, and 6.52%, respectively. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Hong Kong University of Science and Technology](https://md.research.elamur.ai/free/en/universities/hong-kong-university-of-science-and-technology/) — University, Hong Kong, China · 170 works · 26,341 citations - [University of Macau](https://md.research.elamur.ai/free/en/universities/university-of-macau/) — University, Macao, China · 43 works · 2,368 citations - [The Hong Kong University of Science and Technology (Guangzhou)](https://md.research.elamur.ai/free/en/universities/the-hong-kong-university-of-science-and-technology-guangzhou/) — University, Guangzhou, China · 67 works · 1,765 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works 🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works ## Cite Cite as: Yebo Wu, Jingguang Li, Chunlin Tian, KaHou Tam, Zhijiang Guo and Li Li. 2026. Beyond End-to-End: Dynamic Chain Optimization for Private LLM Adaptation on the Edge. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{wu2026beyond, title = {{Beyond End-to-End: Dynamic Chain Optimization for Private LLM Adaptation on the Edge}}, author = {Yebo Wu, Jingguang Li, Chunlin Tian, KaHou Tam, Zhijiang Guo and Li Li}, booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}, year = {2026}, doi = {10.18653/v1/2026.acl-long.839}, url = {https://doi.org/10.18653/v1/2026.acl-long.839} } ``` - [← previous Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agents](https://md.research.elamur.ai/free/en/papers/su-2026-beyond-dialogue-time-temporal-semantic/) - [next → Beyond English and Evasion: A Human-Annotated Multi-Domain Benchmark for High-Stakes LLM Safety Evaluation in Chinese](https://md.research.elamur.ai/free/en/papers/zaghouani-2026-beyond-english-evasion-human-annotated/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/7/) ## References 3 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, et al. 2023. [Qwen technical report](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/). arXiv preprint arXiv:2309.16609. 2. Jieming Bian, Yuanzhe Peng, Lei Wang, Yin Huang, and Jie Xu. 2025. A survey on parameter-efficient fine-tuning for foundation models in federated learning. arXiv preprint arXiv:2504.21099. — [arXiv:2504.21099](https://arxiv.org/abs/2504.21099) [find](https://scholar.google.com/scholar?q=Jieming+Bian%2C+Yuanzhe+Peng%2C+Lei+Wang%2C+Yin+Huang%2C+and+Jie+Xu%2E+2025%2E+A+survey+on+parameter%2Defficient+fine%2Dtuning+for+foundation+models+in+federated+learning%2E+arXiv+preprint+arXiv%3A2504%2E21099%2E+%E2%80%94+%5BarXiv%3A25) 3. Dongqi Cai, Yaozong Wu, Shangguang Wang, Felix Xiaozhu Lin, and Mengwei Xu. 2022. Fedadapter: Efficient federated learning for modern nlp. arXiv preprint arXiv:2205.10162. \#\# Ethical Considerations — [arXiv:2205.10162](https://arxiv.org/abs/2205.10162) [find](https://scholar.google.com/scholar?q=Dongqi+Cai%2C+Yaozong+Wu%2C+Shangguang+Wang%2C+Felix+Xiaozhu+Lin%2C+and+Mengwei+Xu%2E+2022%2E+Fedadapter%3A+Efficient+federated+learning+for+modern+nlp%2E+arXiv+preprint+arXiv%3A2205%2E10162%2E+%5C%23%5C%23+Ethical+Considerations+) *Updated 2 November 2026*