---
title: "Improving Socratic Question Generation using Data"
description: "Socratic tutoring helps learners fix their own mistakes through a sequence of guiding questions… 40 references, cited by 14 papers here."
authors: ["Nischal Ashok Kumar", "Andrew Lan"]
year: 2024
venue: "Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024)"
source: "https://aclanthology.org/2024.bea-1.10/"
arxiv: "2403.00199"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/kumar-2024-improving-socratic-question-generation-data/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/kumar-2024-improving-socratic-question-generation-data/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/12/) / Improving Socratic Question Generation using Data Augmentation and Preference Optimization

# Improving Socratic Question Generation using Data Augmentation and Preference Optimization

**Authors:** [Nischal Ashok Kumar](https://md.research.elamur.ai/free/en/authors/nischal-ashok-kumar/) and [Andrew Lan](https://md.research.elamur.ai/free/en/authors/andrew-lan/) · **Year:** 2024 · **Venue:** [Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024)](https://md.research.elamur.ai/free/en/venues/bea/) ([BEA 2024](https://md.research.elamur.ai/free/en/venues/bea/2024/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2024.bea-1.10/) · [PDF](https://aclanthology.org/2024.bea-1.10.pdf) · [arXiv 2403.00199](https://arxiv.org/abs/2403.00199) · [OpenAlex](https://openalex.org/W4392425883)

**Citations:** 2 citations (OpenAlex, 2026-10-14) · [14](https://md.research.elamur.ai/free/en/papers/kumar-2024-improving-socratic-question-generation-data/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Socratic tutoring helps learners fix their own mistakes through a sequence of guiding questions instead of handing over answers. Writing such questions by hand is demanding for instructors. Prompting proprietary models like GPT-3.5 or GPT-4 often produces questions that are off-topic, repeat earlier turns, or give away the fix too early.

The authors address this for programming education, using the Socratic code-debugging dataset of Al-Hossami et al. Borrowing ideas from RLAIF, they ask GPT-4 to write deliberately flawed instructor questions and filter them with a consistency check. Each flawed question is paired with a human-written valid one, forming a preference dataset. They then train the open-source Llama 2-7B on these pairs with direct preference optimization (DPO) and compare it against supervised fine-tuning (SFT).

The DPO-tuned model surpasses GPT-based chain-of-thought prompting baselines on Rouge-L and roughly matches them on BERTScore, despite being about 25 times smaller. Case studies show it avoids invalid questions more reliably than SFT. The work points to a cheaper, locally runnable, privacy-friendlier route to automated Socratic tutoring.

## Key points
- **Data:** The Socratic debugging dataset (Al-Hossami et al., 2023/2024) contains:
  - 38 programming problems;
  - over 50 distinct student bugs;
  - more than 1900 dialogue turns;
  - a split of 135 training and 16 test dialogues.
- **Augmentation:** GPT-4 generates negative examples in four invalidity categories, such as irrelevant, repetitive, premature, or solution-revealing questions. A consistency check filters these examples. GPT-4 is called only once, at this stage.
- **Training:** Llama 2-7B is optimized with DPO, an RL-free alternative to PPO-based preference learning, and compared with an SFT baseline.
- **Results:**
  - DPO beats GPT-3.5/GPT-4 prompting on Rouge-L and is comparable on BERTScore.
  - DPO consistently outperforms SFT.
  - Sampled DPO outputs are both valid and diverse.
- **Resources and future work:**
  - Code is released at github.com/umass-ml4ed/socratic-quest-gen.
  - Training took about 10 hours on an A100 GPU.
  - Planned future work includes human evaluation, models larger than 7B, KTO, and knowledge-aware question generation.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Massachusetts Amherst](https://md.research.elamur.ai/free/en/universities/university-of-massachusetts-amherst/) — University, Amherst Center, United States · 122 works · 69,574 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 19,503 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 18,805 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,888 works · [🖥️ Computer Science Applications](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-science-applications/) · 184 works

🧭 Topics (1): [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 491 works

## Cite

Cite as: Nischal Ashok Kumar and Andrew Lan. 2024. Improving Socratic Question Generation using Data Augmentation and Preference Optimization. Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{kumar2024improving,
  title = {{Improving Socratic Question Generation using Data Augmentation and Preference Optimization}},
  author = {Nischal Ashok Kumar and Andrew Lan},
  booktitle = {Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024)},
  year = {2024},
  eprint = {2403.00199},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2403.00199}
}
```

- [← previous Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models](https://md.research.elamur.ai/free/en/papers/xiong-2024-improving-scientific-hypothesis-generation-knowledge/)
- [next → Inductive or Deductive? Rethinking the Fundamental Reasoning Abilities of LLMs](https://md.research.elamur.ai/free/en/papers/cheng-2024-inductive-deductive-rethinking-fundamental-reasoning/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/12/)

## References

40 references, 18 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Our work proposes a method for preference optimizing open-source LLMs like LLama 2 for the task of Socratic question generation for student code debugging. We use only LLama 2 as the base model for carrying out preference optimization, and not other open-source models like Mistral (Jiang et al., 202… — [Can Language Models Employ the Socratic Method? Experiments with Code Debugging](https://md.research.elamur.ai/free/en/papers/al-hossami-2023-language-models-employ-socratic-method/)
2. Erfan Al-Hossami, Razvan Bunescu, Ryan Teehan, Laurel Powell, Khyati Mahajan, and Mohsen Dorodchi. 2023. [Socratic questioning of novice debuggers: A benchmark dataset and preliminary evaluations](https://md.research.elamur.ai/free/en/papers/hossami-2023-socratic-questioning-novice-debuggers-benchmark/). In Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA…
3. Nischal Ashok Kumar, Nigel Fernandez, Zichao Wang, and Andrew Lan. 2023. Improving reading comprehension question generation with data augmentation and overgenerate-and-rank. In Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023), pages 247– 259… [find](https://scholar.google.com/scholar?q=Nischal+Ashok+Kumar%2C+Nigel+Fernandez%2C+Zichao+Wang%2C+and+Andrew+Lan%2E+2023%2E+Improving+reading+comprehension+question+generation+with+data+augmentation+and+overgenerate%2Dand%2Drank%2E+In+Proceedings+of+the+18t)
4. Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023. [Sparks of artificial general intelligence: Early experiments with gpt-4](https://md.research.elamur.ai/free/en/papers/bubeck-2023-sparks-artificial-general-intelligence-early/). arXiv preprint arXiv:2303.12712.
5. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. 2021. [Evaluating large language models trained on code](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/). arXiv preprint arXiv:2107.03374.
6. Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al. 2022. Scaling instruction-finetuned language models. arXiv preprint arXiv:2210.11416. [find](https://scholar.google.com/scholar?q=Hyung+Won+Chung%2C+Le+Hou%2C+Shayne+Longpre%2C+Barret+Zoph%2C+Yi+Tay%2C+William+Fedus%2C+Yunxuan+Li%2C+Xuezhi+Wang%2C+Mostafa+Dehghani%2C+Siddhartha+Brahma%2C+et+al%2E+2022%2E+Scaling+instruction%2Dfinetuned+language+models%2E+a)
7. Yuhao Dan, Zhikai Lei, Yiyang Gu, Yong Li, Jianghao Yin, Jiaju Lin, Linhao Ye, Zhiyan Tie, Yougen Zhou, Yilei Wang, et al. 2023. [Educhat: A large-scale language model-based chatbot system for intelligent education](https://md.research.elamur.ai/free/en/papers/dan-2023-educhat-large-scale-language-model/). arXiv preprint arXiv:2308.02773.
8. Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. [Qlora: Efficient finetuning of quantized llms](https://md.research.elamur.ai/free/en/papers/dettmers-2023-qlora-efficient-finetuning-quantized-llms/). arXiv preprint arXiv:2305.14314.
9. Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff, Dan Jurafsky, and Douwe Kiela. 2024. Kto: Model alignment as prospect theoretic optimization. arXiv preprint arXiv:2402.01306. [find](https://scholar.google.com/scholar?q=Kawin+Ethayarajh%2C+Winnie+Xu%2C+Niklas+Muennighoff%2C+Dan+Jurafsky%2C+and+Douwe+Kiela%2E+2024%2E+Kto%3A+Model+alignment+as+prospect+theoretic+optimization%2E+arXiv+preprint+arXiv%3A2402%2E01306%2E)
10. Zvi Galil. 1986. Efficient algorithms for finding maximum matching in graphs. ACM Computing Surveys (CSUR), 18(1):23–38. [find](https://scholar.google.com/scholar?q=Zvi+Galil%2E+1986%2E+Efficient+algorithms+for+finding+maximum+matching+in+graphs%2E+ACM+Computing+Surveys+%28CSUR%29%2C+18%281%29%3A23%E2%80%9338%2E)
11. Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2021. [Deberta: Decoding-enhanced bert with disentangled attention](https://md.research.elamur.ai/free/en/papers/he-2020-deberta-decoding-enhanced-bert-disentangled/). In International Conference on Learning Representations.
12. Yann Hicke, Anmol Agarwal, Qianou Ma, and Paul Denny. 2023. Chata: Towards an intelligent question-answer teaching assistant using open-source llms. arXiv preprint arXiv:2311.02775. [find](https://scholar.google.com/scholar?q=Yann+Hicke%2C+Anmol+Agarwal%2C+Qianou+Ma%2C+and+Paul+Denny%2E+2023%2E+Chata%3A+Towards+an+intelligent+question%2Danswer+teaching+assistant+using+open%2Dsource+llms%2E+arXiv+preprint+arXiv%3A2311%2E02775%2E)
13. Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al. 2023. Mistral 7b. arXiv preprint arXiv:2310.06825. [find](https://scholar.google.com/scholar?q=Albert+Q+Jiang%2C+Alexandre+Sablayrolles%2C+Arthur+Mensch%2C+Chris+Bamford%2C+Devendra+Singh+Chaplot%2C+Diego+de+las+Casas%2C+Florian+Bressand%2C+Gianna+Lengyel%2C+Guillaume+Lample%2C+Lucile+Saulnier%2C+et+al%2E+2023%2E+Mist)
14. James M Joyce. 2011. Kullback-leibler divergence. In International encyclopedia of statistical science, pages 720–722. Springer. [find](https://scholar.google.com/scholar?q=James+M+Joyce%2E+2011%2E+Kullback%2Dleibler+divergence%2E+In+International+encyclopedia+of+statistical+science%2C+pages+720%E2%80%93722%2E+Springer%2E)
15. Majeed Kazemitabaar, Runlong Ye, Xiaoning Wang, Austin Z Henley, Paul Denny, Michelle Craig, and Tovi Grossman. 2024. [Codeaid: Evaluating a classroom deployment of an llm-based programming assistant that balances student and educator needs](https://md.research.elamur.ai/free/en/papers/kazemitabaar-2024-codeaid-evaluating-classroom-deployment-llm/). arXiv preprint arXiv:2401.11314.
16. Julia Kreutzer, Joshua Uyheng, and Stefan Riezler. 2018. [Reliability and learnability of human bandit feedback for sequence-to-sequence reinforcement learning](https://md.research.elamur.ai/free/en/papers/kreutzer-2018-reliability-learnability-human-bandit-feedback/). In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1777–1788, Melbour…
17. Nischal Ashok Kumar and Andrew Lan. 2024. Using large language models for student-code guided test case generation in computer science education. arXiv preprint arXiv:2402.07081. — [arXiv:2402.07081](https://arxiv.org/abs/2402.07081) [find](https://scholar.google.com/scholar?q=Nischal+Ashok+Kumar+and+Andrew+Lan%2E+2024%2E+Using+large+language+models+for+student%2Dcode+guided+test+case+generation+in+computer+science+education%2E+arXiv+preprint+arXiv%3A2402%2E07081%2E+%E2%80%94+%5BarXiv%3A2402%2E07081%5D%28)
18. Harrison Lee, Samrat Phatale, Hassan Mansoor, Kellie Lu, Thomas Mesnard, Colton Bishop, Victor Carbune, and Abhinav Rastogi. 2023. Rlaif: Scaling reinforcement learning from human feedback with ai feedback. arXiv preprint arXiv:2309.00267. [find](https://scholar.google.com/scholar?q=Harrison+Lee%2C+Samrat+Phatale%2C+Hassan+Mansoor%2C+Kellie+Lu%2C+Thomas+Mesnard%2C+Colton+Bishop%2C+Victor+Carbune%2C+and+Abhinav+Rastogi%2E+2023%2E+Rlaif%3A+Scaling+reinforcement+learning+from+human+feedback+with+ai+fee)
19. Chin-Yew Lin. 2004. [Rouge: A package for automatic evaluation of summaries](https://md.research.elamur.ai/free/en/papers/lin-2004-rouge-package-automatic-evaluation-summaries/). In Text summarization branches out, pages 74–81.
20. Naiming Liu, Zichao Wang, Richard Baraniuk, and Andrew Lan. 2022. Open-ended knowledge tracing for computer science education. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 3849–3862. [find](https://scholar.google.com/scholar?q=Naiming+Liu%2C+Zichao+Wang%2C+Richard+Baraniuk%2C+and+Andrew+Lan%2E+2022%2E+Open%2Dended+knowledge+tracing+for+computer+science+education%2E+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods+in+Natural+Lan)
21. Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. 2023. [G-eval: NLG evaluation using gpt-4 with better human alignment](https://md.research.elamur.ai/free/en/papers/liu-2023-g-eval-nlg-evaluation-gpt/). In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 2511–2522, Singapore. Association for Computational Lin…
22. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. [Training language models to follow instructions with human feedback](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/). Advances in Neural Information Processing Systems, 35:27730–27744.
23. Richard Paul and Linda Elder. 2007. Critical thinking: The art of socratic questioning. Journal of developmental education, 31(1):36. [find](https://scholar.google.com/scholar?q=Richard+Paul+and+Linda+Elder%2E+2007%2E+Critical+thinking%3A+The+art+of+socratic+questioning%2E+Journal+of+developmental+education%2C+31%281%29%3A36%2E)
24. Chris Quintana, Brian J Reiser, Elizabeth A Davis, Joseph Krajcik, Eric Fretz, Ravit Golan Duncan, Eleni Kyza, Daniel Edelson, and Elliot Soloway. 2018. A scaffolding design framework for software to support science inquiry. In Scaffolding, pages 337–386. Psychology Press. [find](https://scholar.google.com/scholar?q=Chris+Quintana%2C+Brian+J+Reiser%2C+Elizabeth+A+Davis%2C+Joseph+Krajcik%2C+Eric+Fretz%2C+Ravit+Golan+Duncan%2C+Eleni+Kyza%2C+Daniel+Edelson%2C+and+Elliot+Soloway%2E+2018%2E+A+scaffolding+design+framework+for+software+to+)
25. Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. 2023. [Direct preference optimization: Your language model is secretly a reward model](https://md.research.elamur.ai/free/en/papers/rafailov-2023-direct-preference-optimization-language-model/). In Thirty-seventh Conference on Neural Information Processing Systems. fifth annual ACM conference on learning…
26. Baptiste Roziere, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Xiaoqing Ellen Tan, Yossi Adi, Jingyu Liu, Tal Remez, Jérémy Rapin, et al. 2023. [Code llama: Open foundation models for code](https://md.research.elamur.ai/free/en/papers/roziere-2024-code-llama-open-foundation-models/). arXiv preprint arXiv:2308.12950.
27. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in Neural Information Processing Systems, 35:24824–24837.
28. Sami Sarsa, Paul Denny, Arto Hellas, and Juho Leinonen. 2022. Automatic generation of programming exercises and code explanations using large language models. In Proceedings of the 2022 ACM Conference on International Computing Education Research-Volume 1, pages 27–43. [find](https://scholar.google.com/scholar?q=Sami+Sarsa%2C+Paul+Denny%2C+Arto+Hellas%2C+and+Juho+Leinonen%2E+2022%2E+Automatic+generation+of+programming+exercises+and+code+explanations+using+large+language+models%2E+In+Proceedings+of+the+2022+ACM+Conference)
29. Ronald J Williams. 1992. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning, 8:229–256. [find](https://scholar.google.com/scholar?q=Ronald+J+Williams%2E+1992%2E+Simple+statistical+gradient%2Dfollowing+algorithms+for+connectionist+reinforcement+learning%2E+Machine+learning%2C+8%3A229%E2%80%93256%2E)
30. Alexander Scarlatos, Digory Smith, Simon Woodhead, and Andrew Lan. 2024. [Improving the validity of automatically generated feedback via reinforcement learning](https://md.research.elamur.ai/free/en/papers/scarlatos-2024-improving-validity-automatically-generated-feedback/). arXiv preprint arXiv:2403.01304.
31. John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347. [find](https://scholar.google.com/scholar?q=John+Schulman%2C+Filip+Wolski%2C+Prafulla+Dhariwal%2C+Alec+Radford%2C+and+Oleg+Klimov%2E+2017%2E+Proximal+policy+optimization+algorithms%2E+arXiv+preprint+arXiv%3A1707%2E06347%2E)
32. Kumar Shridhar, Jakub Macina, Mennatallah El-Assady, Tanmay Sinha, Manu Kapur, and Mrinmaya Sachan. 2022. [Automatic generation of socratic subquestions for teaching math word problems](https://md.research.elamur.ai/free/en/papers/shridhar-2022-automatic-generation-socratic-subquestions-teaching/). In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 4136–4149, Abu Dha…
33. David Wood, Jerome S Bruner, and Gail Ross. 1976. The role of tutoring in problem solving. Journal of child psychology and psychiatry, 17(2):89–100. [find](https://scholar.google.com/scholar?q=David+Wood%2C+Jerome+S+Bruner%2C+and+Gail+Ross%2E+1976%2E+The+role+of+tutoring+in+problem+solving%2E+Journal+of+child+psychology+and+psychiatry%2C+17%282%29%3A89%E2%80%93100%2E)
34. Tianyi Zhang*, Varsha Kishore*, Felix Wu*, Kilian Q. Weinberger, and Yoav Artzi. 2020. Bertscore: Evaluating text generation with bert. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2A%2C+Varsha+Kishore%2A%2C+Felix+Wu%2A%2C+Kilian+Q%2E+Weinberger%2C+and+Yoav+Artzi%2E+2020%2E+Bertscore%3A+Evaluating+text+generation+with+bert%2E+In+International+Conference+on+Learning+Representations%2E)
35. Daniel M Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B Brown, Alec Radford, Dario Amodei, Paul Christiano, and Geoffrey Irving. 2019. Fine-tuning language models from human preferences. arXiv preprint arXiv:1909.08593. [find](https://scholar.google.com/scholar?q=Daniel+M+Ziegler%2C+Nisan+Stiennon%2C+Jeffrey+Wu%2C+Tom+B+Brown%2C+Alec+Radford%2C+Dario+Amodei%2C+Paul+Christiano%2C+and+Geoffrey+Irving%2E+2019%2E+Fine%2Dtuning+language+models+from+human+preferences%2E+arXiv+preprint+ar)
36. Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. 2020. Learning to summarize with human feedback. Advances in Neural Information Processing Systems, 33:3008– 3021. [find](https://scholar.google.com/scholar?q=Nisan+Stiennon%2C+Long+Ouyang%2C+Jeffrey+Wu%2C+Daniel+Ziegler%2C+Ryan+Lowe%2C+Chelsea+Voss%2C+Alec+Radford%2C+Dario+Amodei%2C+and+Paul+F+Christiano%2E+2020%2E+Learning+to+summarize+with+human+feedback%2E+Advances+in+Neural)
37. Henansh Tanwar, Kunal Shrivastva, Rahul Singh, and Dhruv Kumar. 2024. Opinebot: Class feedback reimagined using a conversational llm. arXiv preprint arXiv:2401.15589. — [arXiv:2401.15589](https://arxiv.org/abs/2401.15589) [find](https://scholar.google.com/scholar?q=Henansh+Tanwar%2C+Kunal+Shrivastva%2C+Rahul+Singh%2C+and+Dhruv+Kumar%2E+2024%2E+Opinebot%3A+Class+feedback+reimagined+using+a+conversational+llm%2E+arXiv+preprint+arXiv%3A2401%2E15589%2E+%E2%80%94+%5BarXiv%3A2401%2E15589%5D%28https%3A%2F%2Farxi)
38. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023. [Llama: Open and efficient foundation language models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/). arXiv preprint arXiv:2302.13971.
39. Zichao Wang, Andrew Lan, and Richard Baraniuk. 2021. Math word problem generation with mathematical consistency and problem context constraints. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 5986– 5999, Online and Punta Cana, Dominican Republic. Ass… [find](https://scholar.google.com/scholar?q=Zichao+Wang%2C+Andrew+Lan%2C+and+Richard+Baraniuk%2E+2021%2E+Math+word+problem+generation+with+mathematical+consistency+and+problem+context+constraints%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Meth)
40. Zichao Wang, Andrew S Lan, Weili Nie, Andrew E Waters, Phillip J Grimaldi, and Richard G Baraniuk. 2018. Qg-net: a data-driven question generation model for educational content. In Proceedings of the [find](https://scholar.google.com/scholar?q=Zichao+Wang%2C+Andrew+S+Lan%2C+Weili+Nie%2C+Andrew+E+Waters%2C+Phillip+J+Grimaldi%2C+and+Richard+G+Baraniuk%2E+2018%2E+Qg%2Dnet%3A+a+data%2Ddriven+question+generation+model+for+educational+content%2E+In+Proceedings+of+the)

*Updated 3 November 2026*