--- title: "From Standard Transformers to Modern LLMs: Bringing Dialogue" description: "This TeachNLP 2026 paper describes the second edition of an open university course on Transformer-based LLMs and… 5 references." authors: ["Maria Tikhonova", "Viktoriia A. Chekalina", "Artem Chervyakov", "Alexey Zaytsev", "Alexander Panchenko"] year: 2026 venue: "Proceedings of the Seventh Workshop on Teaching Natural Language Processing (TeachNLP 2026)" source: "https://aclanthology.org/2026.teachingnlp-1.8/" doi: "10.18653/v1/2026.teachingnlp-1.8" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/tikhonova-2026-standard-transformers-modern-llms-bringing/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/tikhonova-2026-standard-transformers-modern-llms-bringing/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/31/) / From Standard Transformers to Modern LLMs: Bringing Dialogue Models, RAG, and Agents to the Classroom # From Standard Transformers to Modern LLMs: Bringing Dialogue Models, RAG, and Agents to the Classroom **Authors:** [Maria Tikhonova](https://md.research.elamur.ai/free/en/authors/maria-tikhonova/), [Viktoriia A. Chekalina](https://md.research.elamur.ai/free/en/authors/viktoriia-a-chekalina/), Artem Chervyakov, Alexey Zaytsev and [Alexander Panchenko](https://md.research.elamur.ai/free/en/authors/alexander-panchenko/) · **Year:** 2026 · **Venue:** [Proceedings of the Seventh Workshop on Teaching Natural Language Processing (TeachNLP 2026)](https://md.research.elamur.ai/free/en/venues/teachingnlp/) ([Workshop on Teaching Natural Language Processing 2026](https://md.research.elamur.ai/free/en/venues/teachingnlp/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.teachingnlp-1.8/) · [PDF](https://aclanthology.org/2026.teachingnlp-1.8.pdf) · [DOI 10.18653/v1/2026.teachingnlp-1.8](https://doi.org/10.18653/v1/2026.teachingnlp-1.8) · [OpenAlex](https://openalex.org/W7140140623) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary This TeachNLP 2026 paper describes the second edition of an open university course on Transformer-based LLMs and multimodal models, first presented by Nikishina et al. (2024). The authors argue that knowing Transformer internals no longer prepares students for industry work. Practitioners now mostly assemble complete LLM systems: they ground answers through retrieval, coordinate tools with agents, call models through APIs, and manage serving costs. The revised curriculum has 14 sessions for learners who know Python and ML/DL but have little experience with LLMs. Each session pairs a lecture with Jupyter notebook exercises. New or reworked material covers: - modern architectural components (RoPE, GQA/MQA); - long-context modeling and KV-cache efficiency; - RAG pipelines; - ReAct-style agents; - an API-based practical track; - uncertainty estimation for white-box and black-box LLMs; - multimodal dialogue grounding with vLLM-based inference. The paper reports no empirical evaluation. Its contribution is a modular, openly released set of teaching materials that instructors can adopt in full or in part. ## Key points - The course has 14 sessions and is hosted on GitHub (s-nlp/transformers-course). Slides and notebooks are modular, and homework and quizzes are available from the authors on request. - Session 7 (RAG) compares frozen RAG, RePlug-style augmentation and classical RAG (Lewis et al., 2020). Session 8 has students build ReAct agents with tool wrappers and stopping criteria, and analyze failures such as looping and brittle parsing. - The API track in Sessions 7–8 uses GigaChat and covers authentication, rate limits, error handling and cost-aware usage. - Session 6 covers long-context problems such as KV-cache memory and needle-in-a-haystack retrieval, along with Transformer-XL, RMT and a Russian long-context benchmark. Sessions 9–10 cover uncertainty estimation, with practical work in LM-Polygraph. - Session 12 covers multimodal dialogue grounding, with vLLM for efficient serving and MERA Multi for evaluation. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [National Research University Higher School of Economics](https://md.research.elamur.ai/free/en/universities/national-research-university-higher-school-of-economics/) — University, Moscow, Russia · 23 works · 39,585 citations - [Lomonosov Moscow State University](https://md.research.elamur.ai/free/en/universities/lomonosov-moscow-state-university/) — University, Moscow, Russia · 14 works · 2,430 citations - [AIRI - Artificial Intelligence Research Institute](https://md.research.elamur.ai/free/en/ngos/airi-artificial-intelligence-research-institute/) — Nonprofit, Moscow, Russia · 5 works · 29 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works 🧭 Topics (2): [🗨️ Dialogue systems](https://md.research.elamur.ai/free/en/topics/dialogue-systems/) · 624 works · [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 657 works ## Cite Cite as: Maria Tikhonova, Viktoriia A. Chekalina, Artem Chervyakov, Alexey Zaytsev and Alexander Panchenko. 2026. From Standard Transformers to Modern LLMs: Bringing Dialogue Models, RAG, and Agents to the Classroom. Proceedings of the Seventh Workshop on Teaching Natural Language Processing (TeachNLP 2026). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{tikhonova2026standard, title = {{From Standard Transformers to Modern LLMs: Bringing Dialogue Models, RAG, and Agents to the Classroom}}, author = {Maria Tikhonova, Viktoriia A. Chekalina, Artem Chervyakov, Alexey Zaytsev and Alexander Panchenko}, booktitle = {Proceedings of the Seventh Workshop on Teaching Natural Language Processing (TeachNLP 2026)}, year = {2026}, doi = {10.18653/v1/2026.teachingnlp-1.8}, url = {https://doi.org/10.18653/v1/2026.teachingnlp-1.8} } ``` - [← previous From Short Video to Clickable Search: RLVR-Enabled Listwise Query Suggestion with Retrieval-Augmented Context](https://md.research.elamur.ai/free/en/papers/tian-2026-short-video-clickable-search-rlvr/) - [next → From sunblock to softblock: Analyzing the correlates of neology in published writing and on social media](https://md.research.elamur.ai/free/en/papers/ryskina-2026-sunblock-softblock-analyzing-correlates-neology/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/31/) ## References 5 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Aydar Bulatov, Yury Kuratov, and Mikhail Burtsev. 2022. Recurrent memory transformer. In Advances in Neural Information Processing Systems, volume 35. [find](https://scholar.google.com/scholar?q=Aydar+Bulatov%2C+Yury+Kuratov%2C+and+Mikhail+Burtsev%2E+2022%2E+Recurrent+memory+transformer%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+volume+35%2E) 2. Irina Nikishina, Maria Tikhonova, Viktoriia Chekalina, Alexey Zaytsev, Artem Vazhentsev, and Alexander Panchenko. 2024. Industry vs academia: Running a course on transformers in two setups. In Proceedings of the Sixth Workshop on Teaching NLP. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Irina+Nikishina%2C+Maria+Tikhonova%2C+Viktoriia+Chekalina%2C+Alexey+Zaytsev%2C+Artem+Vazhentsev%2C+and+Alexander+Panchenko%2E+2024%2E+Industry+vs+academia%3A+Running+a+course+on+transformers+in+two+setups%2E+In+Proceed) 3. Artem Chervyakov, Ulyana Isaeva, Anton Emelyanov, Artem Safin, Maria Tikhonova, Alexander Kharitonov, Yulia Lyakh, Petr Surovtsev, Denis Shevelev, Vildan Saburov, Vasily Konovalov, Elisei Rykov, Ivan Sviridov, Amina Miftakhova, Ilseyar Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Richard… — [REPLUG: Retrieval-Augmented Black-Box Language Models](https://md.research.elamur.ai/free/en/papers/shi-2023-replug-retrieval-augmented-black-box/) 4. Roman Vashurin, Ekaterina Fadeeva, Artem Vazhentsev, Lyudmila Rvanova, Daniil Vasilev, Akim Tsvigun, Sergey Petrakov, Rui Xing, Abdelrahman Sadallah, Kirill Grishchenkov, Alexander Panchenko, Timothy Baldwin, Preslav Nakov, Maxim Panov, and Artem Shelmanov. 2025. [Benchmarking uncertainty quantificat…](https://md.research.elamur.ai/free/en/papers/vashurin-2025-benchmarking-uncertainty-quantification-methods-large/) 5. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2022. [ReAct: Synergizing reasoning and acting in language models](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/). arXiv preprint arXiv:2210.03629. *Updated 1 November 2026*