---
title: "Unleashing the potential of prompt engineering for large language"
description: "It does not introduce new data or experiments. 305 references, cited by 46 papers here. Among them: 490."
authors: ["Banghao Chen", "Zhaofeng Zhang", "Nicolas Langrene", "Shengxin Zhu"]
year: 2023
venue: "arXiv:2310.14735 · Patterns 6(6) 101260 (2025)"
source: "https://arxiv.org/abs/2310.14735"
doi: "10.1016/j.patter.2025.101260"
arxiv: "2310.14735"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/chen-2023-unleashing-potential-prompt-engineering-large/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/chen-2023-unleashing-potential-prompt-engineering-large/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/) / Unleashing the potential of prompt engineering for large language models

# Unleashing the potential of prompt engineering for large language models

**Authors:** Banghao Chen, Zhaofeng Zhang, Nicolas Langrene and Shengxin Zhu · **Year:** 2023 · **Venue:** arXiv:2310.14735 · Patterns 6(6) 101,260 (2025) · **Publisher:** [Elsevier BV](https://md.research.elamur.ai/free/en/publishers/elsevier-bv/) · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://doi.org/10.1016/j.patter.2025.101260) · [PDF](https://arxiv.org/pdf/2310.14735) · [DOI 10.1016/j.patter.2025.101260](https://doi.org/10.1016/j.patter.2025.101260) · [arXiv 2310.14735](https://arxiv.org/abs/2310.14735) · [OpenAlex](https://openalex.org/W4410202262)

**Citations:** 490 citations (OpenAlex, 2026-10-14) · [46](https://md.research.elamur.ai/free/en/papers/chen-2023-unleashing-potential-prompt-engineering-large/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
This survey asks how users can get more reliable, accurate and relevant output from large language models by shaping their inputs. It does not introduce new data or experiments. Instead, it organizes existing prompting research into a structured overview. It first traces how input design has mattered across AI history, from rule-based systems in the 1950s to the transformer era, which is the review's main focus. It then covers:
- basic tactics, such as precise instructions, role-prompting and iterative refinement, illustrated with GPT-4 outputs;
- advanced strategies, such as chain-of-thought, self-consistency and generated knowledge;
- learnable prompting for vision-language models.

The review also covers how prompt methods are evaluated, where they are applied, and how adversarial prompts threaten LLM security. Its main conclusion is that careful prompt design substantially improves model behaviour and can reduce hallucinations. It also argues that defences such as adversarial training are needed. The authors see better understanding of model internals and AI agents as the next frontier. The paper is a practical map for anyone building LLM-based NLP tools.

## Key points
- All illustrative examples were generated with GPT-4. The paper notes that GPT-4 is estimated to be far larger than GPT-3's 175 billion parameters.
- VLM prompting methods reviewed include CoOp (Context Optimization), CoCoOp (Conditional Context Optimization) and MaPLe (Multimodal Prompt Learning), with CLIP and ALIGN as reference models.
- Prompt methods are assessed through both subjective (human) and objective (metric-based) evaluation. Applications discussed include education, content creation, programming and reasoning.
- The authors describe agent evolution in five stages: models, prompt templates, chains, agents and multi-agents. They define an agent as a large model combined with memory, planning and tool use.
- The paper was published in *Patterns* 6(6), 101,260 (2025). It was supported by the Natural Science Foundation of China (grant 12,271,047).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [National University of Singapore](https://md.research.elamur.ai/free/en/universities/national-university-of-singapore/) — University, Singapore, Singapore · 84 works · 32,204 citations
- [University of Michigan](https://md.research.elamur.ai/free/en/universities/university-of-michigan/) — University, Ann Arbor, United States · 36 works · 12,181 citations
- [Beijing Normal University](https://md.research.elamur.ai/free/en/universities/beijing-normal-university/) — University, Beijing, China · 6 works · 3,107 citations

Also on the byline: [Beijing Normal-Hong Kong Baptist University](https://ror.org/04snvc712).

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works

🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 1,343 works

## Cite

Cite as: Banghao Chen, Zhaofeng Zhang, Nicolas Langrene and Shengxin Zhu. 2023. Unleashing the potential of prompt engineering for large language models. arXiv:2310.14735 · Patterns 6(6) 101,260 (2025).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{chen2023unleashing,
  title = {{Unleashing the potential of prompt engineering for large language models}},
  author = {Banghao Chen, Zhaofeng Zhang, Nicolas Langrene and Shengxin Zhu},
  year = {2023},
  doi = {10.1016/j.patter.2025.101260},
  eprint = {2310.14735},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.1016/j.patter.2025.101260}
}
```

- [← previous How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection](https://md.research.elamur.ai/free/en/papers/guo-2023-close-chatgpt-human-experts-comparison/)
- [next → Jailbreaking Black Box Large Language Models in Twenty Queries](https://md.research.elamur.ai/free/en/papers/chao-2023-jailbreaking-black-box-large-language/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/)

## References

305 references, 106 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. [Attention is all you need](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/). In: Proceedings of the 31st International Conference on Neural Information Processing Systems. NIPS’17; 2017. p. 6000–6010.
2. Bender EM, Gebru T, McMillan-Major A, Shmitchell S. On the dangers of stochastic parrots: can language models be too big? In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency; 2021. p. 610–623. [find](https://scholar.google.com/scholar?q=Bender+EM%2C+Gebru+T%2C+McMillan%2DMajor+A%2C+Shmitchell+S%2E+On+the+dangers+of+stochastic+parrots%3A+can+language+models+be+too+big%3F+In%3A+Proceedings+of+the+2021+ACM+Conference+on+Fairness%2C+Accountability%2C+and+Tr)
3. Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, et al. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). In: Proceedings of the 34th International Conference on Neural Information Processing Systems. NIPS’20; 2020. p. 1877–1901.
4. OpenAI, Achiam J, Adler S, Agarwal S, Ahmad L, Akkaya I, et al. [GPT-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/); 2024. ArXiv:2303.08774.
5. Team G, Anil R, Borgeaud S, Alayrac JB, Yu J, Soricut R, et al. [Gemini: a family of highly capable multimodal models](https://md.research.elamur.ai/free/en/papers/gemini-team-2023-gemini-family-highly-capable-multimodal/); 2024. ArXiv:2312.11805.
6. Google.: Google Gemini: next-generation model. Available from: [https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/](https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/) \#sundar-note. [↗](https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/)
7. Hulbert D.: Tree of knowledge: ToK aka Tree of Knowledge dataset for large language models LLM. Accessed: 2023-8-15. [https://github.com/dave1010/](https://github.com/dave1010/) tree-of-thought-prompting. [↗](https://github.com/dave1010/)
8. Anthropic. The Claude 3 model family: Opus, Sonnet, Haiku. Anthropic; 2024. [https://paperswithcode.com/paper/](https://paperswithcode.com/paper/) the-claude-3-model-family-opus-sonnet-haiku. [↗](https://paperswithcode.com/paper/)
9. Anthropic.: Claude 3 model. Available from: [https://www.anthropic.com/news/](https://www.anthropic.com/news/) claude-3-family. [↗](https://www.anthropic.com/news/)
10. Touvron H, Martin L, Stone K, Albert P, Almahairi A, Babaei Y, et al. Llama 2: open foundation and fine-tuned chat models; 2023. ArXiv:2307.09288. [find](https://scholar.google.com/scholar?q=Touvron+H%2C+Martin+L%2C+Stone+K%2C+Albert+P%2C+Almahairi+A%2C+Babaei+Y%2C+et+al%2E+Llama+2%3A+open+foundation+and+fine%2Dtuned+chat+models%3B+2023%2E+ArXiv%3A2307%2E09288%2E)
11. Dubey A, Jauhri A, Pandey A, Kadian A, Al-Dahle A, Letman A, et al. The Llama 3 herd of models; 2024. ArXiv2407.21783. [find](https://scholar.google.com/scholar?q=Dubey+A%2C+Jauhri+A%2C+Pandey+A%2C+Kadian+A%2C+Al%2DDahle+A%2C+Letman+A%2C+et+al%2E+The+Llama+3+herd+of+models%3B+2024%2E+ArXiv2407%2E21783%2E)
12. Sarkhel R, Huang B, Lockard C, Shiralkar P. Self-training for label-efficient information extraction from semi-structured web-pages. Proceedings of the VLDB Endowment. 2023;16(11):3098–3110. [find](https://scholar.google.com/scholar?q=Sarkhel+R%2C+Huang+B%2C+Lockard+C%2C+Shiralkar+P%2E+Self%2Dtraining+for+label%2Defficient+information+extraction+from+semi%2Dstructured+web%2Dpages%2E+Proceedings+of+the+VLDB+Endowment%2E+2023%3B16%2811%29%3A3098%E2%80%933110%2E)
13. Ramesh A, Pavlov M, Goh G, Gray S, Voss C, Radford A, et al. [Zero-shot text-to-image generation](https://md.research.elamur.ai/free/en/papers/ramesh-2021-zero-shot-text-image-generation/); 2021. ArXiv:2102.12092.
14. Marcus G, Davis E, Aaronson S. A very preliminary analysis of DALL-E 2; 2022. ArXiv:2204.13807. — [arXiv:2204.13807](https://arxiv.org/abs/2204.13807) [find](https://scholar.google.com/scholar?q=Marcus+G%2C+Davis+E%2C+Aaronson+S%2E+A+very+preliminary+analysis+of+DALL%2DE+2%3B+2022%2E+ArXiv%3A2204%2E13807%2E+%E2%80%94+%5BarXiv%3A2204%2E13807%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2204%2E13807%29)
15. OpenAI.: DALL·E: creating images from text. dall-e/. [https://openai.com/index/](https://openai.com/index/) [↗](https://openai.com/index/)
16. Radford A, Kim JW, Hallacy C, Ramesh A, Goh G, Agarwal S, et al. [Learning transferable visual models from natural language supervision](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/). In: International Conference on Machine Learning; 2021. p. 8748–8763.
17. Li Y, Liang F, Zhao L, Cui Y, Ouyang W, Shao J, et al. Supervision exists everywhere: a data efficient contrastive language-image pre-training paradigm. In: Tenth International Conference on Learning Representations; 2022. . [find](https://scholar.google.com/scholar?q=Li+Y%2C+Liang+F%2C+Zhao+L%2C+Cui+Y%2C+Ouyang+W%2C+Shao+J%2C+et+al%2E+Supervision+exists+everywhere%3A+a+data+efficient+contrastive+language%2Dimage+pre%2Dtraining+paradigm%2E+In%3A+Tenth+International+Conference+on+Learning+)
18. OpenAI.: Hello GPT-4o. Accessed: 2024-08-04. [https://openai.com/index/](https://openai.com/index/) hello-gpt-4o/. [↗](https://openai.com/index/)
19. Moore O.: Announcing GPT-4o in the API! Accessed: 2024-05-22. Available from: [https://community.openai.com/t/announcing-gpt-4o-in-the-api/744700](https://community.openai.com/t/announcing-gpt-4o-in-the-api/744700). [↗](https://community.openai.com/t/announcing-gpt-4o-in-the-api/744700)
20. Kaddour J, Harris J, Mozes M, Bradley H, Raileanu R, McHardy R. [Challenges and applications of large language models](https://md.research.elamur.ai/free/en/papers/kaddour-2023-challenges-applications-large-language-models/); 2023. ArXiv:2307.10169.
21. Lu Y, Bartolo M, Moore A, Riedel S, Stenetorp P. [Fantastically ordered prompts and where to find them: overcoming few-shot prompt order sensitivity](https://md.research.elamur.ai/free/en/papers/lu-2022-fantastically-ordered-prompts-where-find/). In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics; 2022. p. 8086–8098.
22. Webson A, Pavlick E. [Do prompt-based models really understand the meaning of their prompts?](https://md.research.elamur.ai/free/en/papers/webson-2022-do-prompt-based-models-really/) In: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies; 2022. p. 2300–2344.
23. Wei J, Wang X, Schuurmans D, Bosma M, Ichter B, Xia F, et al. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). In: Advances in Neural Information Processing Systems. vol. 35; 2022. p. 24824–24837.
24. Wang X, Wei J, Schuurmans D, Le QV, Chi EH, Narang S, et al. [Self-consistency improves chain of thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/). In: Eleventh International Conference on Learning Representations; 2023. .
25. Shanahan M, McDonell K, Reynolds L. [Role-play with large language models](https://md.research.elamur.ai/free/en/papers/shanahan-2023-role-play-large-language-models/); 2023. ArXiv:2305.16367.
26. Maynez J, Narayan S, Bohnet B, McDonald R. On faithfulness and factuality in abstractive summarization. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics; 2020. p. 1906–1919. [find](https://scholar.google.com/scholar?q=Maynez+J%2C+Narayan+S%2C+Bohnet+B%2C+McDonald+R%2E+On+faithfulness+and+factuality+in+abstractive+summarization%2E+In%3A+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%3B+202)
27. Bubeck S, Chandrasekaran V, Eldan R, Gehrke J, Horvitz E, Kamar E, et al. [Sparks of artificial general intelligence: early experiments with GPT-4](https://md.research.elamur.ai/free/en/papers/bubeck-2023-sparks-artificial-general-intelligence-early/); 2023. ArXiv:2303.12712.
28. Yong G, Jeon K, Gil D, Lee G. Prompt engineering for zero-shot and few-shot defect detection and classification using a visual-language pretrained model. Computer-Aided Civil and Infrastructure Engineering. 2022;38(11):1536–1554. [find](https://scholar.google.com/scholar?q=Yong+G%2C+Jeon+K%2C+Gil+D%2C+Lee+G%2E+Prompt+engineering+for+zero%2Dshot+and+few%2Dshot+defect+detection+and+classification+using+a+visual%2Dlanguage+pretrained+model%2E+Computer%2DAided+Civil+and+Infrastructure+Engine)
29. Wang J, Liu Z, Zhao L, Wu Z, Ma C, Yu S, et al. Review of large vision models and visual prompt engineering. Meta-Radiology. 2023;1(3):100047. [find](https://scholar.google.com/scholar?q=Wang+J%2C+Liu+Z%2C+Zhao+L%2C+Wu+Z%2C+Ma+C%2C+Yu+S%2C+et+al%2E+Review+of+large+vision+models+and+visual+prompt+engineering%2E+Meta%2DRadiology%2E+2023%3B1%283%29%3A100047%2E)
30. Christiano PF, Leike J, Brown T, Martic M, Legg S, Amodei D. Deep reinforcement learning from human preferences. Advances in neural information processing systems. 2017;30. [find](https://scholar.google.com/scholar?q=Christiano+PF%2C+Leike+J%2C+Brown+T%2C+Martic+M%2C+Legg+S%2C+Amodei+D%2E+Deep+reinforcement+learning+from+human+preferences%2E+Advances+in+neural+information+processing+systems%2E+2017%3B30%2E)
31. Stiennon N, Ouyang L, Wu J, Ziegler D, Lowe R, Voss C, et al. Learning to summarize with human feedback. Advances in Neural Information Processing Systems. 2020;33:3008–3021. [find](https://scholar.google.com/scholar?q=Stiennon+N%2C+Ouyang+L%2C+Wu+J%2C+Ziegler+D%2C+Lowe+R%2C+Voss+C%2C+et+al%2E+Learning+to+summarize+with+human+feedback%2E+Advances+in+Neural+Information+Processing+Systems%2E+2020%3B33%3A3008%E2%80%933021%2E)
32. Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I, et al.: Language models are unsupervised multitask learners. Assessed: 2019-02-07. [https://cdn.openai.com/better-language-models/language](https://cdn.openai.com/better-language-models/language) models are unsupervised multitask learners.pdf. [↗](https://cdn.openai.com/better-language-models/language)
33. Radford A, Narasimhan K, Salimans T, Sutskever I, et al. Improving language understanding by generative pre-training; 2018. Https://openai.com/research/language-unsupervised. [find](https://scholar.google.com/scholar?q=Radford+A%2C+Narasimhan+K%2C+Salimans+T%2C+Sutskever+I%2C+et+al%2E+Improving+language+understanding+by+generative+pre%2Dtraining%3B+2018%2E+Https%3A%2F%2Fopenai%2Ecom%2Fresearch%2Flanguage%2Dunsupervised%2E)
34. Holtzman A, Buys J, Du L, Forbes M, Choi Y. The curious case of neural text degeneration. In: Ninth International Conference on Learning Representations; 2020. . [find](https://scholar.google.com/scholar?q=Holtzman+A%2C+Buys+J%2C+Du+L%2C+Forbes+M%2C+Choi+Y%2E+The+curious+case+of+neural+text+degeneration%2E+In%3A+Ninth+International+Conference+on+Learning+Representations%3B+2020%2E+%2E)
35. Welleck S, Kulikov I, Roller S, Dinan E, Cho K, Weston J. [Neural text generation with unlikelihood training](https://md.research.elamur.ai/free/en/papers/welleck-2019-neural-text-generation-unlikelihood-training/); 2019. ArXiv:1908.04319.
36. Xu X, Tao C, Shen T, Xu C, Xu H, Long G, et al. Re-reading improves reasoning in language models; 2023. ArXiv:2309.06275. — [arXiv:2309.06275](https://arxiv.org/abs/2309.06275) [find](https://scholar.google.com/scholar?q=Xu+X%2C+Tao+C%2C+Shen+T%2C+Xu+C%2C+Xu+H%2C+Long+G%2C+et+al%2E+Re%2Dreading+improves+reasoning+in+language+models%3B+2023%2E+ArXiv%3A2309%2E06275%2E+%E2%80%94+%5BarXiv%3A2309%2E06275%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2309%2E06275%29)
37. YanSong S, JingLi Tencent A. Joint learning embeddings for Chinese words and their components via ladder structured networks. In: Proceedings of the Twenty-Seventh International Joint Conference on Artifificial Intelligence (IJCAI-18); 2018. p. 4375–4381. [find](https://scholar.google.com/scholar?q=YanSong+S%2C+JingLi+Tencent+A%2E+Joint+learning+embeddings+for+Chinese+words+and+their+components+via+ladder+structured+networks%2E+In%3A+Proceedings+of+the+Twenty%2DSeventh+International+Joint+Conference+on+Ar)
38. Luo L, Ao X, Song Y, Li J, Yang X, He Q, et al. Unsupervised neural aspect extraction with sememes. In: IJCAI; 2019. p. 5123–5129. [find](https://scholar.google.com/scholar?q=Luo+L%2C+Ao+X%2C+Song+Y%2C+Li+J%2C+Yang+X%2C+He+Q%2C+et+al%2E+Unsupervised+neural+aspect+extraction+with+sememes%2E+In%3A+IJCAI%3B+2019%2E+p%2E+5123%E2%80%935129%2E)
39. Yang M, Qu Q, Tu W, Shen Y, Zhao Z, Chen X. Exploring human-like reading strategy for abstractive text summarization. In: Proceedings of the AAAI conference on artificial intelligence. vol. 33; 2019. p. 7362–7369. [find](https://scholar.google.com/scholar?q=Yang+M%2C+Qu+Q%2C+Tu+W%2C+Shen+Y%2C+Zhao+Z%2C+Chen+X%2E+Exploring+human%2Dlike+reading+strategy+for+abstractive+text+summarization%2E+In%3A+Proceedings+of+the+AAAI+conference+on+artificial+intelligence%2E+vol%2E+33%3B+2019%2E+)
40. Zhang Z, Gao J, Dhaliwal RS, Jia-Jun Li T. VISAR: a human-AI argumentative writing assistant with visual programming and rapid draft prototyping; 2023. ArXiv:2304.07810. — [arXiv:2304.07810](https://arxiv.org/abs/2304.07810) [find](https://scholar.google.com/scholar?q=Zhang+Z%2C+Gao+J%2C+Dhaliwal+RS%2C+Jia%2DJun+Li+T%2E+VISAR%3A+a+human%2DAI+argumentative+writing+assistant+with+visual+programming+and+rapid+draft+prototyping%3B+2023%2E+ArXiv%3A2304%2E07810%2E+%E2%80%94+%5BarXiv%3A2304%2E07810%5D%28https%3A%2F%2Fa)
41. Van Buren D. Guided scenarios with simulated expert personae: a remarkable strategy to perform cognitive work; 2023. ArXiv:2306.03104. — [arXiv:2306.03104](https://arxiv.org/abs/2306.03104) [find](https://scholar.google.com/scholar?q=Van+Buren+D%2E+Guided+scenarios+with+simulated+expert+personae%3A+a+remarkable+strategy+to+perform+cognitive+work%3B+2023%2E+ArXiv%3A2306%2E03104%2E+%E2%80%94+%5BarXiv%3A2306%2E03104%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2306%2E03104%29)
42. OpenAI.: Tactic: use delimiters to clearly indicate distinct parts of the input. Accessed: 2023-09-01. [https://platform.openai.com/docs/guides/gpt-best-practices/](https://platform.openai.com/docs/guides/gpt-best-practices/) tactic-use-delimiters-to-clearly-indicate-distinct-parts-of-the-input. [↗](https://platform.openai.com/docs/guides/gpt-best-practices/)
43. Logan IV R, Balažević I, Wallace E, Petroni F, Singh S, Riedel S. [Cutting down on prompts and parameters: simple few-shot learning with language models](https://md.research.elamur.ai/free/en/papers/iv-2022-cutting-down-prompts-parameters-simple/). In: Findings of the Association for Computational Linguistics: ACL 2022; 2022. p. 2824–2835.
44. Shyr C, Hu Y, Harris PA, Xu H. Identifying and extracting rare disease phenotypes with large language models; 2023. ArXiv:2306.12656. — [arXiv:2306.12656](https://arxiv.org/abs/2306.12656) [find](https://scholar.google.com/scholar?q=Shyr+C%2C+Hu+Y%2C+Harris+PA%2C+Xu+H%2E+Identifying+and+extracting+rare+disease+phenotypes+with+large+language+models%3B+2023%2E+ArXiv%3A2306%2E12656%2E+%E2%80%94+%5BarXiv%3A2306%2E12656%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2306%2E12656%29)
45. Reynolds L, McDonell K. [Prompt programming for large language models: beyond the few-shot paradigm](https://md.research.elamur.ai/free/en/papers/reynolds-2021-prompt-programming-large-language-models/). In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems; 2021. p. 1–7.
46. Liu P, Yuan W, Fu J, Jiang Z, Hayashi H, Neubig G. [Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing](https://md.research.elamur.ai/free/en/papers/liu-2021-pre-train-prompt-predict-systematic/). ACM Comput Surv. 2023 jan;55(9).
47. Kojima T, Gu SS, Reid M, Matsuo Y, Iwasawa Y. [Large language models are zero-shot reasoners](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/). Advances in Neural Information Processing Systems. 2022;35:22199–22213.
48. Liu J, Gardner M, Cohen SB, Lapata M. Multi-step inference for reasoning over paragraphs; 2020. ArXiv:2004.02995. [find](https://scholar.google.com/scholar?q=Liu+J%2C+Gardner+M%2C+Cohen+SB%2C+Lapata+M%2E+Multi%2Dstep+inference+for+reasoning+over+paragraphs%3B+2020%2E+ArXiv%3A2004%2E02995%2E)
49. Ackley DH, Hinton GE, Sejnowski TJ. A learning algorithm for Boltzmann machines. Cognitive Science. 1985;9(1):147–169. [find](https://scholar.google.com/scholar?q=Ackley+DH%2C+Hinton+GE%2C+Sejnowski+TJ%2E+A+learning+algorithm+for+Boltzmann+machines%2E+Cognitive+Science%2E+1985%3B9%281%29%3A147%E2%80%93169%2E)
50. Ficler J, Goldberg Y. [Controlling linguistic style aspects in neural language generation](https://md.research.elamur.ai/free/en/papers/ficler-2017-controlling-linguistic-style-aspects-neural/). In: Proceedings of the Workshop on Stylistic Variation; 2017. p. 94–104.
51. Xu C, Guo D, Duan N, McAuley J. RIGA at SemEval-2023 Task 2: NER enhanced with GPT-3. In: Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023); 2023. p. 331–339. [find](https://scholar.google.com/scholar?q=Xu+C%2C+Guo+D%2C+Duan+N%2C+McAuley+J%2E+RIGA+at+SemEval%2D2023+Task+2%3A+NER+enhanced+with+GPT%2D3%2E+In%3A+Proceedings+of+the+17th+International+Workshop+on+Semantic+Evaluation+%28SemEval%2D2023%29%3B+2023%2E+p%2E+331%E2%80%93339%2E)
52. Liesenfeld A, Dingemanse M. Rethinking open source generative AI: open washing and the EU AI Act. In: The 2024 ACM Conference on Fairness, Accountability, and Transparency; 2024. p. 1774–1787. [find](https://scholar.google.com/scholar?q=Liesenfeld+A%2C+Dingemanse+M%2E+Rethinking+open+source+generative+AI%3A+open+washing+and+the+EU+AI+Act%2E+In%3A+The+2024+ACM+Conference+on+Fairness%2C+Accountability%2C+and+Transparency%3B+2024%2E+p%2E+1774%E2%80%931787%2E)
53. Wu S, Shen EM, Badrinath C, Ma J, Lakkaraju H. Analyzing chain-of-thought prompting in large language models via gradient-based feature attributions; 2023. ArXiv:2307.13339. [find](https://scholar.google.com/scholar?q=Wu+S%2C+Shen+EM%2C+Badrinath+C%2C+Ma+J%2C+Lakkaraju+H%2E+Analyzing+chain%2Dof%2Dthought+prompting+in+large+language+models+via+gradient%2Dbased+feature+attributions%3B+2023%2E+ArXiv%3A2307%2E13339%2E)
54. Zhang Z, Zhang A, Li M, Smola A. [Automatic chain of thought prompting in Large language models](https://md.research.elamur.ai/free/en/papers/zhang-2022-automatic-chain-thought-prompting-large/). In: Eleventh International Conference on Learning Representations; 2023. .
55. Lewkowycz A, Andreassen A, Dohan D, Dyer E, Michalewski H, Ramasesh V, et al. [Solving quantitative reasoning problems with language models](https://md.research.elamur.ai/free/en/papers/lewkowycz-2022-solving-quantitative-reasoning-problems-language/). Advances in Neural Information Processing Systems. 2022;35:3843–3857.
56. Zhou H, Nova A, Larochelle H, Courville A, Neyshabur B, Sedghi H. Teaching algorithmic reasoning via in-context learning; 2022. ArXiv:2211.09066. [find](https://scholar.google.com/scholar?q=Zhou+H%2C+Nova+A%2C+Larochelle+H%2C+Courville+A%2C+Neyshabur+B%2C+Sedghi+H%2E+Teaching+algorithmic+reasoning+via+in%2Dcontext+learning%3B+2022%2E+ArXiv%3A2211%2E09066%2E)
57. Lee N, Sreenivasan K, Lee JD, Lee K, Papailiopoulos D. Teaching arithmetic to small transformers; 2023. ArXiv:2307.03381. [find](https://scholar.google.com/scholar?q=Lee+N%2C+Sreenivasan+K%2C+Lee+JD%2C+Lee+K%2C+Papailiopoulos+D%2E+Teaching+arithmetic+to+small+transformers%3B+2023%2E+ArXiv%3A2307%2E03381%2E)
58. Wei J, Wang X, Schuurmans D, Bosma M, Ichter B, Xia F, et al. Large language models perform diagnostic reasoning. In: Eleventh International Conference on Learning Representations; 2022. . [find](https://scholar.google.com/scholar?q=Wei+J%2C+Wang+X%2C+Schuurmans+D%2C+Bosma+M%2C+Ichter+B%2C+Xia+F%2C+et+al%2E+Large+language+models+perform+diagnostic+reasoning%2E+In%3A+Eleventh+International+Conference+on+Learning+Representations%3B+2022%2E+%2E)
59. Zhang H, Parkes DC. Chain-of-thought reasoning is a policy improvement operator; 2023. ArXiv:2309.08589. [find](https://scholar.google.com/scholar?q=Zhang+H%2C+Parkes+DC%2E+Chain%2Dof%2Dthought+reasoning+is+a+policy+improvement+operator%3B+2023%2E+ArXiv%3A2309%2E08589%2E)
60. Cobbe K, Kosaraju V, Bavarian M, Chen M, Jun H, Kaiser L, et al. [Training verifiers to solve math word problems](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/); 2021. ArXiv:2110.14168.
61. Huang S, Dong L, Wang W, Hao Y, Singhal S, Ma S, et al. [Language is not all you need: aligning perception with language models](https://md.research.elamur.ai/free/en/papers/huang-2023-language-all-need-aligning-perception/); 2023. ArXiv:2302.14045.
62. Shum K, Diao S, Zhang T. [Automatic prompt augmentation and selection with chain-of-thought from labeled data](https://md.research.elamur.ai/free/en/papers/shum-2023-automatic-prompt-augmentation-selection-chain/). In: Bouamor H, Pino J, Bali K, editors. Findings of the Association for Computational Linguistics: EMNLP 2023. Singapore: Association for Computational Linguistics; 2023. p. 12113–12139.
63. Del M, Fishel M. True detective: a deep abductive reasoning benchmark undoable for GPT-3 and challenging for GPT-4. In: Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM 2023); 2023. p. 314–322. [find](https://scholar.google.com/scholar?q=Del+M%2C+Fishel+M%2E+True+detective%3A+a+deep+abductive+reasoning+benchmark+undoable+for+GPT%2D3+and+challenging+for+GPT%2D4%2E+In%3A+Proceedings+of+the+12th+Joint+Conference+on+Lexical+and+Computational+Semantics+)
64. Ouyang L, Wu J, Jiang X, Almeida D, Wainwright C, Mishkin P, et al. [Training language models to follow instructions with human feedback](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/). Advances in Neural Information Processing Systems. 2022;35:27730–27744.
65. Saparov A, He H. [Language models are greedy reasoners: a systematic formal analysis of chain-of-thought](https://md.research.elamur.ai/free/en/papers/saparov-2022-language-models-greedy-reasoners-systematic/); 2022. ArXiv:2210.01240.
66. Tafjord O, Dalvi B, Clark P. [ProofWriter: generating implications, proofs, and abductive statements over natural language](https://md.research.elamur.ai/free/en/papers/tafjord-2021-proofwriter-generating-implications-proofs-abductive/). In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021; 2021. p. 3621–3634.
67. Chowdhery A, Narang S, Devlin J, Bosma M, Mishra G, Roberts A, et al. [Palm: scaling language modeling with pathways](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/); 2022. ArXiv:2204.02311.
68. Fan A, Lewis M, Dauphin Y. Hierarchical neural story generation. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers); 2018. p. 889–898. [find](https://scholar.google.com/scholar?q=Fan+A%2C+Lewis+M%2C+Dauphin+Y%2E+Hierarchical+neural+story+generation%2E+In%3A+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+Papers%29%3B+2018%2E+p%2E+889%E2%80%93898%2E)
69. Holtzman A, Buys J, Forbes M, Bosselut A, Golub D, Choi Y. [Learning to write with cooperative discriminators](https://md.research.elamur.ai/free/en/papers/holtzman-2018-learning-write-cooperative-discriminators/). In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers); 2018. p. 1638–1649.
70. Huang J, Gu SS, Hou L, Wu Y, Wang X, Yu H, et al. [Large language models can self-improve](https://md.research.elamur.ai/free/en/papers/huang-2023-large-language-models-can-self/); 2022. ArXiv:2210.11610.
71. Shum K, Diao S, Zhang T. [Automatic prompt augmentation and selection with chain-of-thought from labeled data](https://md.research.elamur.ai/free/en/papers/shum-2023-automatic-prompt-augmentation-selection-chain/); 2023. ArXiv:2302.12822.
72. Khalifa M, Logeswaran L, Lee M, Lee H, Wang L. Discriminator-guided multi-step reasoning with language models; 2023. ArXiv:2305.14934. — [arXiv:2305.14934](https://arxiv.org/abs/2305.14934) [find](https://scholar.google.com/scholar?q=Khalifa+M%2C+Logeswaran+L%2C+Lee+M%2C+Lee+H%2C+Wang+L%2E+Discriminator%2Dguided+multi%2Dstep+reasoning+with+language+models%3B+2023%2E+ArXiv%3A2305%2E14934%2E+%E2%80%94+%5BarXiv%3A2305%2E14934%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2305%2E14934%29)
73. Liu J, Liu A, Lu X, Welleck S, West P, Le Bras R, et al. Generated knowledge prompting for commonsense reasoning. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers); 2022. p. 3154–3169. [find](https://scholar.google.com/scholar?q=Liu+J%2C+Liu+A%2C+Lu+X%2C+Welleck+S%2C+West+P%2C+Le+Bras+R%2C+et+al%2E+Generated+knowledge+prompting+for+commonsense+reasoning%2E+In%3A+Proceedings+of+the+60th+Annual+Meeting+of+the+Association+for+Computational+Lingui)
74. Zhou D, Schärli N, Hou L, Wei J, Scales N, Wang X, et al. [Least-to-most prompting enables complex reasoning in Large language models](https://md.research.elamur.ai/free/en/papers/al-2022-least-most-prompting-enables-complex/). In: Eleventh International Conference on Learning Representations; 2023. .
75. Gao L, Madaan A, Zhou S, Alon U, Liu P, Yang Y, et al. Pal: program-aided language models. In: International Conference on Machine Learning. PMLR; 2023. p. 10764–10799. [find](https://scholar.google.com/scholar?q=Gao+L%2C+Madaan+A%2C+Zhou+S%2C+Alon+U%2C+Liu+P%2C+Yang+Y%2C+et+al%2E+Pal%3A+program%2Daided+language+models%2E+In%3A+International+Conference+on+Machine+Learning%2E+PMLR%3B+2023%2E+p%2E+10764%E2%80%9310799%2E)
76. Patel A, Bhattamishra S, Goyal N. [Are NLP Models really able to Solve Simple Math Word Problems?](https://md.research.elamur.ai/free/en/papers/patel-2021-are-nlp-models-really-able/) In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Online: Association for Computational Linguistics; 2021…
77. Yao S, Yu D, Zhao J, Shafran I, Griffiths TL, Cao Y, et al. Tree of thoughts: deliberate problem solving with large language models; 2023. ArXiv:2305.10601. [find](https://scholar.google.com/scholar?q=Yao+S%2C+Yu+D%2C+Zhao+J%2C+Shafran+I%2C+Griffiths+TL%2C+Cao+Y%2C+et+al%2E+Tree+of+thoughts%3A+deliberate+problem+solving+with+large+language+models%3B+2023%2E+ArXiv%3A2305%2E10601%2E)
78. Long J. Large language model guided tree-of-thought; 2023. ArXiv:2305.08291. [find](https://scholar.google.com/scholar?q=Long+J%2E+Large+language+model+guided+tree%2Dof%2Dthought%3B+2023%2E+ArXiv%3A2305%2E08291%2E)
79. Besta M, Blach N, Kubicek A, Gerstenberger R, Gianinazzi L, Gajda J, et al. Graph of thoughts: solving elaborate problems with large language models; 2023. ArXiv:2308.09687. [find](https://scholar.google.com/scholar?q=Besta+M%2C+Blach+N%2C+Kubicek+A%2C+Gerstenberger+R%2C+Gianinazzi+L%2C+Gajda+J%2C+et+al%2E+Graph+of+thoughts%3A+solving+elaborate+problems+with+large+language+models%3B+2023%2E+ArXiv%3A2308%2E09687%2E)
80. Wang L, Ma C, Feng X, Zhang Z, Yang H, Zhang J, et al. [A survey on large language model based autonomous agents](https://md.research.elamur.ai/free/en/papers/wang-2023-survey-large-language-model-based/); 2023. ArXiv:2308.11432.
81. Khot T, Trivedi H, Finlayson M, Fu Y, Richardson K, Clark P, et al. Decomposed prompting: a modular approach for solving complex tasks; 2023. ArXiv:2210.02406. [find](https://scholar.google.com/scholar?q=Khot+T%2C+Trivedi+H%2C+Finlayson+M%2C+Fu+Y%2C+Richardson+K%2C+Clark+P%2C+et+al%2E+Decomposed+prompting%3A+a+modular+approach+for+solving+complex+tasks%3B+2023%2E+ArXiv%3A2210%2E02406%2E)
82. Diao S, Wang P, Lin Y, Zhang T. Active prompting with chain-of-thought for large language models; 2024. ArXiv:2302.12246. [find](https://scholar.google.com/scholar?q=Diao+S%2C+Wang+P%2C+Lin+Y%2C+Zhang+T%2E+Active+prompting+with+chain%2Dof%2Dthought+for+large+language+models%3B+2024%2E+ArXiv%3A2302%2E12246%2E)
83. Li XL, Liang P. Prefix-tuning: optimizing continuous prompts for generation. In: Zong C, Xia F, Li W, Navigli R, editors. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long… [find](https://scholar.google.com/scholar?q=Li+XL%2C+Liang+P%2E+Prefix%2Dtuning%3A+optimizing+continuous+prompts+for+generation%2E+In%3A+Zong+C%2C+Xia+F%2C+Li+W%2C+Navigli+R%2C+editors%2E+Proceedings+of+the+59th+Annual+Meeting+of+the+Association+for+Computational+Li)
84. Sahoo P, Singh AK, Saha S, Jain V, Mondal S, Chadha A. [A systematic survey of prompt engineering in large language models: techniques and applications](https://md.research.elamur.ai/free/en/papers/sahoo-2024-systematic-survey-prompt-engineering-large/); 2024. ArXiv:2402.07927.
85. Settles B.: [Active learning literature survey](https://md.research.elamur.ai/free/en/papers/settles-2009-active-learning-literature-survey/). University of Wisconsin-Madison Department of Computer Sciences.
86. Culotta A, McCallum A. Reducing labeling effort for structured prediction tasks. In: Proceedings of the 20th National Conference on Artificial Intelligence - Volume 2. AAAI’05. AAAI Press; 2005. p. 746–751. [find](https://scholar.google.com/scholar?q=Culotta+A%2C+McCallum+A%2E+Reducing+labeling+effort+for+structured+prediction+tasks%2E+In%3A+Proceedings+of+the+20th+National+Conference+on+Artificial+Intelligence+%2D+Volume+2%2E+AAAI%E2%80%9905%2E+AAAI+Press%3B+2005%2E+p%2E+74)
87. White J, Fu Q, Hays S, Sandborn M, Olea C, Gilbert H, et al. [A prompt pattern catalog to enhance prompt engineering with ChatGPT](https://md.research.elamur.ai/free/en/papers/white-2023-prompt-pattern-catalog-enhance-prompt/); 2023. ArXiv:2302.11382.
88. Desmond M, Brachman M. Exploring prompt engineering practices in the enterprise; 2024. ArXiv:2403.08950. — [arXiv:2403.08950](https://arxiv.org/abs/2403.08950) [find](https://scholar.google.com/scholar?q=Desmond+M%2C+Brachman+M%2E+Exploring+prompt+engineering+practices+in+the+enterprise%3B+2024%2E+ArXiv%3A2403%2E08950%2E+%E2%80%94+%5BarXiv%3A2403%2E08950%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2403%2E08950%29)
89. Mondal S, Bappon SD, Roy CK. Enhancing user interaction in ChatGPT: characterizing and consolidating multiple prompts for issue resolution; 2024. ArXiv:2402.04568. — [arXiv:2402.04568](https://arxiv.org/abs/2402.04568) [find](https://scholar.google.com/scholar?q=Mondal+S%2C+Bappon+SD%2C+Roy+CK%2E+Enhancing+user+interaction+in+ChatGPT%3A+characterizing+and+consolidating+multiple+prompts+for+issue+resolution%3B+2024%2E+ArXiv%3A2402%2E04568%2E+%E2%80%94+%5BarXiv%3A2402%2E04568%5D%28https%3A%2F%2Farxiv%2Eo)
90. White J, Hays S, Fu Q, Spencer-Smith J, Schmidt DC. ChatGPT prompt patterns for improving code quality, refactoring, requirements elicitation, and software design; 2023. ArXiv:2303.07839. — [arXiv:2303.07839](https://arxiv.org/abs/2303.07839) [find](https://scholar.google.com/scholar?q=White+J%2C+Hays+S%2C+Fu+Q%2C+Spencer%2DSmith+J%2C+Schmidt+DC%2E+ChatGPT+prompt+patterns+for+improving+code+quality%2C+refactoring%2C+requirements+elicitation%2C+and+software+design%3B+2023%2E+ArXiv%3A2303%2E07839%2E+%E2%80%94+%5BarXiv%3A230)
91. Pryzant R, Iter D, Li J, Lee Y, Zhu C, Zeng M. Automatic prompt optimization with “gradient descent” and beam search. In: Bouamor H, Pino J, Bali K, editors. Proceedings of the 2023 [Conference on Empirical Methods in Natural Language Processing](https://md.research.elamur.ai/free/en/papers/pryzant-2023-automatic-prompt-optimization-gradient-descent/). Singapore: Association for Computational Linguistics;…
92. Chen Y, Wen Z, Fan G, Chen Z, Wu W, Liu D, et al. MAPO: boosting large language model performance with model-adaptive prompt optimization. In: Bouamor H, Pino J, Bali K, editors. Findings of the Association for Computational Linguistics: EMNLP 2023. Singapore: Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=Chen+Y%2C+Wen+Z%2C+Fan+G%2C+Chen+Z%2C+Wu+W%2C+Liu+D%2C+et+al%2E+MAPO%3A+boosting+large+language+model+performance+with+model%2Dadaptive+prompt+optimization%2E+In%3A+Bouamor+H%2C+Pino+J%2C+Bali+K%2C+editors%2E+Findings+of+the+Assoc)
93. Cheng J, Liu X, Zheng K, Ke P, Wang H, Dong Y, et al. Black-box prompt optimization: aligning large language models without model training. In: Ku LW, Martins A, Srikumar V, editors. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Bang… [find](https://scholar.google.com/scholar?q=Cheng+J%2C+Liu+X%2C+Zheng+K%2C+Ke+P%2C+Wang+H%2C+Dong+Y%2C+et+al%2E+Black%2Dbox+prompt+optimization%3A+aligning+large+language+models+without+model+training%2E+In%3A+Ku+LW%2C+Martins+A%2C+Srikumar+V%2C+editors%2E+Proceedings+of+th)
94. Wang X, Li C, Wang Z, Bai F, Luo H, Zhang J, et al. PromptAgent: strategic planning with language models enables expert-level prompt optimization; 2023. ArXiv:2310.16427. [find](https://scholar.google.com/scholar?q=Wang+X%2C+Li+C%2C+Wang+Z%2C+Bai+F%2C+Luo+H%2C+Zhang+J%2C+et+al%2E+PromptAgent%3A+strategic+planning+with+language+models+enables+expert%2Dlevel+prompt+optimization%3B+2023%2E+ArXiv%3A2310%2E16427%2E)
95. Bach SH, Sanh V, Yong ZX, Webson A, Raffel C, Nayak NV, et al. [Promptsource: an integrated development environment and repository for natural language prompts](https://md.research.elamur.ai/free/en/papers/bach-2022-promptsource-integrated-development-environment-repository/); 2022. ArXiv:2202.01279.
96. Deng M, Wang J, Hsieh CP, Wang Y, Guo H, Shu T, et al. [RLPrompt: optimizing discrete text prompts with reinforcement learning](https://md.research.elamur.ai/free/en/papers/deng-2022-rlprompt-optimizing-discrete-text-prompts/). In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing; 2022. p. 3369–3391.
97. Awal R, Zhang L, Agrawal A. Investigating prompting techniques for zero- and few-shot visual question answering; 2024. ArXiv:2306.09996. — [arXiv:2306.09996](https://arxiv.org/abs/2306.09996) [find](https://scholar.google.com/scholar?q=Awal+R%2C+Zhang+L%2C+Agrawal+A%2E+Investigating+prompting+techniques+for+zero%2D+and+few%2Dshot+visual+question+answering%3B+2024%2E+ArXiv%3A2306%2E09996%2E+%E2%80%94+%5BarXiv%3A2306%2E09996%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2306%2E09996%29)
98. OpenAI.: ChatGPT plugins. Accessed: 2023-10-15. [https://openai.com/blog/](https://openai.com/blog/) chatgpt-plugins. [↗](https://openai.com/blog/)
99. OpenAI.: GPTs: introducing the latest in conversational AI. Accessed: 2024-05-22. Available from: [https://openai.com/index/introducing-gpts/](https://openai.com/index/introducing-gpts/). [↗](https://openai.com/index/introducing-gpts/)
100. Bisson S.: Microsoft build 2023: Microsoft extends its copilots with open standard plugins. Accessed: 2023-05-25. [https://www.techrepublic.com/article/](https://www.techrepublic.com/article/) microsoft-extends-copilot-with-open-standard-plugins/. [↗](https://www.techrepublic.com/article/)
101. Ng A.: ChatGPT prompt engineering for developers. Accessed: 2023-07-18. [https://www.deeplearning.ai/short-courses/](https://www.deeplearning.ai/short-courses/) chatgpt-prompt-engineering-for-developers/. [↗](https://www.deeplearning.ai/short-courses/)
102. Roller S, Dinan E, Goyal N, Ju D, Williamson M, Liu Y, et al. [Recipes for building an open-domain chatbot](https://md.research.elamur.ai/free/en/papers/roller-2021-recipes-building-open-domain-chatbot/). In: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume; 2021. p. 300–325.
103. whatplugin.ai.: Prompt enhancer & ChatGPT plugins for AI development tools like prompt enhancer. Accessed: 2023-09-14. [https://www.whatplugin.ai/](https://www.whatplugin.ai/) plugins/prompt-enhancer. [↗](https://www.whatplugin.ai/)
104. AISEO.ai.: AISEO. Accessed: 2023-8-15. [https://aiseo.ai/](https://aiseo.ai/). [↗](https://aiseo.ai/)
105. ChatGPT for Search Engines.: Prompt perfect plugin for ChatGPT. Accessed: 2023-10-15. [https://chatonai.org/prompt-perfect-chatgpt-plugin](https://chatonai.org/prompt-perfect-chatgpt-plugin). [↗](https://chatonai.org/prompt-perfect-chatgpt-plugin)
106. Prompt Perfect.: Terms of service. Accessed: 2023-09-20. [https://promptperfect.xyz/static/terms.html](https://promptperfect.xyz/static/terms.html). [↗](https://promptperfect.xyz/static/terms.html)
107. Lee K, Firat O, Agarwal A, Fannjiang C, Sussillo D. Hallucinations in neural machine translation; 2018. Https://openreview.net/forum?id=SkxJ-309FQ. [find](https://scholar.google.com/scholar?q=Lee+K%2C+Firat+O%2C+Agarwal+A%2C+Fannjiang+C%2C+Sussillo+D%2E+Hallucinations+in+neural+machine+translation%3B+2018%2E+Https%3A%2F%2Fopenreview%2Enet%2Fforum%3Fid%3DSkxJ%2D309FQ%2E)
108. Ji Z, Lee N, Frieske R, Yu T, Su D, Xu Y, et al. [Survey of hallucination in natural language generation](https://md.research.elamur.ai/free/en/papers/ji-2022-survey-hallucination-natural-language-generation/). ACM Computing Surveys. 2023;55(12):1–38.
109. Lazaridou A, Gribovskaya E, Stokowiec W, Grigorev N. [Internet-augmented language models through few-shot prompting for open-domain question answering](https://md.research.elamur.ai/free/en/papers/lazaridou-2022-internet-augmented-language-models-through/); 2022. ArXiv:2203.05115.
110. Jiang Z, Xu FF, Gao L, Sun Z, Liu Q, Dwivedi-Yu J, et al. Active retrieval augmented generation; 2023. ArXiv:2305.06983. [find](https://scholar.google.com/scholar?q=Jiang+Z%2C+Xu+FF%2C+Gao+L%2C+Sun+Z%2C+Liu+Q%2C+Dwivedi%2DYu+J%2C+et+al%2E+Active+retrieval+augmented+generation%3B+2023%2E+ArXiv%3A2305%2E06983%2E)
111. Ram O, Levine Y, Dalmedigos I, Muhlgay D, Shashua A, Leyton-Brown K, et al. In-context retrieval-augmented language models; 2023. ArXiv:2302.00083. [find](https://scholar.google.com/scholar?q=Ram+O%2C+Levine+Y%2C+Dalmedigos+I%2C+Muhlgay+D%2C+Shashua+A%2C+Leyton%2DBrown+K%2C+et+al%2E+In%2Dcontext+retrieval%2Daugmented+language+models%3B+2023%2E+ArXiv%3A2302%2E00083%2E)
112. Shuster K, Poff S, Chen M, Kiela D, Weston J. [Retrieval augmentation reduces hallucination in conversation](https://md.research.elamur.ai/free/en/papers/shuster-2021-retrieval-augmentation-reduces-hallucination-conversation/); 2021. ArXiv:2104.07567.
113. Lewis P, Perez E, Piktus A, Petroni F, Karpukhin V, Goyal N, et al. Retrieval-augmented generation for knowledge-intensive NLP tasks. Advances in Neural Information Processing Systems. 2020;33:9459–9474. [find](https://scholar.google.com/scholar?q=Lewis+P%2C+Perez+E%2C+Piktus+A%2C+Petroni+F%2C+Karpukhin+V%2C+Goyal+N%2C+et+al%2E+Retrieval%2Daugmented+generation+for+knowledge%2Dintensive+NLP+tasks%2E+Advances+in+Neural+Information+Processing+Systems%2E+2020%3B33%3A9459%E2%80%9394)
114. Izacard G, Grave E. [Leveraging passage retrieval with generative models for open domain question answering](https://md.research.elamur.ai/free/en/papers/izacard-2021-leveraging-passage-retrieval-generative-models/); 2020. ArXiv:2007.01282.
115. Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, et al. [BART: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension](https://md.research.elamur.ai/free/en/papers/lewis-2020-bart-denoising-sequence-sequence-pre/). In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics; 2020. p. 7871–7880.
116. Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, et al. [Exploring the limits of transfer learning with a unified text-to-text transformer](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/). Journal of Machine Learning Research. 2020;21(1):5485–5551.
117. Roller S, Dinan E, Goyal N, Ju D, Williamson M, Liu Y, et al. [Recipes for building an open-domain chatbot](https://md.research.elamur.ai/free/en/papers/roller-2021-recipes-building-open-domain-chatbot/). In: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume; 2021. p. 300–325.
118. Dhuliawala S, Komeili M, Xu J, Raileanu R, Li X, Celikyilmaz A, et al. [Chain-of-verification reduces hallucination in large language models](https://md.research.elamur.ai/free/en/papers/dhuliawala-2023-chain-verification-reduces-hallucination-large/); 2023. ArXiv:2309.11495.
119. Li J, Tang T, Zhao WX, Wang J, Nie JY, Wen JR. The web can be your oyster for improving Large Language Models; 2023. ArXiv:2305.10998. — [arXiv:2305.10998](https://arxiv.org/abs/2305.10998) [find](https://scholar.google.com/scholar?q=Li+J%2C+Tang+T%2C+Zhao+WX%2C+Wang+J%2C+Nie+JY%2C+Wen+JR%2E+The+web+can+be+your+oyster+for+improving+Large+Language+Models%3B+2023%2E+ArXiv%3A2305%2E10998%2E+%E2%80%94+%5BarXiv%3A2305%2E10998%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2305%2E10998%29)
120. Paranjape B, Lundberg S, Singh S, Hajishirzi H, Zettlemoyer L, Ribeiro MT. ART: automatic multi-step reasoning and tool-use for large language models; 2023. ArXiv:2303.09014. [find](https://scholar.google.com/scholar?q=Paranjape+B%2C+Lundberg+S%2C+Singh+S%2C+Hajishirzi+H%2C+Zettlemoyer+L%2C+Ribeiro+MT%2E+ART%3A+automatic+multi%2Dstep+reasoning+and+tool%2Duse+for+large+language+models%3B+2023%2E+ArXiv%3A2303%2E09014%2E)
121. Greyling C.: 12 prompt engineering techniques. Available from: [https://cobusgreyling.medium.com/12-prompt-engineering-techniques-644481c857aa](https://cobusgreyling.medium.com/12-prompt-engineering-techniques-644481c857aa). [↗](https://cobusgreyling.medium.com/12-prompt-engineering-techniques-644481c857aa)
122. Vinija.: Prompt engineering. prompt-engineering/. Available from: [https://vinija.ai/nlp/](https://vinija.ai/nlp/) [↗](https://vinija.ai/nlp/)
123. Badhan M.: Advanced prompt engineering techniques. Accessed: 2024-05-22. Available from: [https://www.mercity.ai/blog-post/](https://www.mercity.ai/blog-post/) advanced-prompt-engineering-techniques. [↗](https://www.mercity.ai/blog-post/)
124. Yao S, Zhao J, Yu D, Du N, Shafran I, Narasimhan K, et al. [ReAct: synergizing reasoning and acting in language models](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/); 2023. ArXiv:2210.03629.
125. Li A.: ReAct: a new framework for prompt engineering in large language models. Available from: [https://www.perxeive.com/blog/](https://www.perxeive.com/blog/) react-a-new-framework-for-prompt-engineering-in-large-language-models. [↗](https://www.perxeive.com/blog/)
126. Roberts A.: How to ReAct to simple AI agents. Available from: [https://arize.com/blog-course/react-agent-llm/](https://arize.com/blog-course/react-agent-llm/). [↗](https://arize.com/blog-course/react-agent-llm/)
127. Antol S, Agrawal A, Lu J, Mitchell M, Batra D, Zitnick CL, et al. VQA: visual question answering. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV); 2015. p. 2425–2433. [find](https://scholar.google.com/scholar?q=Antol+S%2C+Agrawal+A%2C+Lu+J%2C+Mitchell+M%2C+Batra+D%2C+Zitnick+CL%2C+et+al%2E+VQA%3A+visual+question+answering%2E+In%3A+Proceedings+of+the+IEEE+International+Conference+on+Computer+Vision+%28ICCV%29%3B+2015%2E+p%2E+2425%E2%80%932433%2E)
128. Wu Q, Teney D, Wang P, Shen C, Dick A, van den Hengel A. Visual question answering: a survey of methods and datasets. Computer Vision and Image Understanding. 2017;163:21–40. Language in Vision. [find](https://scholar.google.com/scholar?q=Wu+Q%2C+Teney+D%2C+Wang+P%2C+Shen+C%2C+Dick+A%2C+van+den+Hengel+A%2E+Visual+question+answering%3A+a+survey+of+methods+and+datasets%2E+Computer+Vision+and+Image+Understanding%2E+2017%3B163%3A21%E2%80%9340%2E+Language+in+Vision%2E)
129. Wang P, Wu Q, Shen C, Dick A, van den Hengel A. FVQA: fact-based visual question answering. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2018;40(10):2413–2427. [find](https://scholar.google.com/scholar?q=Wang+P%2C+Wu+Q%2C+Shen+C%2C+Dick+A%2C+van+den+Hengel+A%2E+FVQA%3A+fact%2Dbased+visual+question+answering%2E+IEEE+Transactions+on+Pattern+Analysis+and+Machine+Intelligence%2E+2018%3B40%2810%29%3A2413%E2%80%932427%2E)
130. Kafle K, Kanan C. Visual question answering: datasets, algorithms, and future challenges. Computer Vision and Image Understanding. 2017;163:3–20. Language in Vision. [find](https://scholar.google.com/scholar?q=Kafle+K%2C+Kanan+C%2E+Visual+question+answering%3A+datasets%2C+algorithms%2C+and+future+challenges%2E+Computer+Vision+and+Image+Understanding%2E+2017%3B163%3A3%E2%80%9320%2E+Language+in+Vision%2E)
131. Yin S, Fu C, Zhao S, Li K, Sun X, Xu T, et al. [A survey on multimodal large language models](https://md.research.elamur.ai/free/en/papers/yin-2023-survey-multimodal-large-language-models/); 2024. ArXiv:2306.13549.
132. Wu J, Gan W, Chen Z, Wan S, Yu PS. Multimodal [large language models: a survey](https://md.research.elamur.ai/free/en/papers/minaee-2024-large-language-models-survey/). In: 2023 IEEE International Conference on Big Data; 2023. p. 2247–2256.
133. Zhang R, Wei Z, Fang R, Gao P, Li K, Dai J, et al. Tip-adapter: training-free adaption of CLIP for few-shot classification; 2022. ArXiv:2207.09519. — [arXiv:2207.09519](https://arxiv.org/abs/2207.09519) [find](https://scholar.google.com/scholar?q=Zhang+R%2C+Wei+Z%2C+Fang+R%2C+Gao+P%2C+Li+K%2C+Dai+J%2C+et+al%2E+Tip%2Dadapter%3A+training%2Dfree+adaption+of+CLIP+for+few%2Dshot+classification%3B+2022%2E+ArXiv%3A2207%2E09519%2E+%E2%80%94+%5BarXiv%3A2207%2E09519%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2207%2E0951)
134. Ju C, Han T, Zheng K, Zhang Y, Xie W. Prompting visual-language models for efficient video understanding. In: Computer Vision – ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXXV. Berlin, Heidelberg: Springer-Verlag; 2022. p. 105–124. [find](https://scholar.google.com/scholar?q=Ju+C%2C+Han+T%2C+Zheng+K%2C+Zhang+Y%2C+Xie+W%2E+Prompting+visual%2Dlanguage+models+for+efficient+video+understanding%2E+In%3A+Computer+Vision+%E2%80%93+ECCV+2022%3A+17th+European+Conference%2C+Tel+Aviv%2C+Israel%2C+October+23%E2%80%9327%2C+20)
135. Zhou K, Yang J, Loy CC, Liu Z. Learning to prompt for vision-language models. International Journal of Computer Vision. 2022 jul;130(9):2337–2348. [find](https://scholar.google.com/scholar?q=Zhou+K%2C+Yang+J%2C+Loy+CC%2C+Liu+Z%2E+Learning+to+prompt+for+vision%2Dlanguage+models%2E+International+Journal+of+Computer+Vision%2E+2022+jul%3B130%289%29%3A2337%E2%80%932348%2E)
136. Jia C, Yang Y, Xia Y, Chen YT, Parekh Z, Pham H, et al. [Scaling up visual and vision-language representation learning with noisy text supervision](https://md.research.elamur.ai/free/en/papers/jia-2021-scaling-up-visual-vision-language/). In: Meila M, Zhang T, editors. Proceedings of the 38th International Conference on Machine Learning. vol. 139 of Proceedings of Machine Learning Research…
137. Ma C, Liu Y, Deng J, Xie L, Dong W, Xu C. Understanding and mitigating overfitting in prompt tuning for vision-language models; 2023. ArXiv:2211.02219. — [arXiv:2211.02219](https://arxiv.org/abs/2211.02219) [find](https://scholar.google.com/scholar?q=Ma+C%2C+Liu+Y%2C+Deng+J%2C+Xie+L%2C+Dong+W%2C+Xu+C%2E+Understanding+and+mitigating+overfitting+in+prompt+tuning+for+vision%2Dlanguage+models%3B+2023%2E+ArXiv%3A2211%2E02219%2E+%E2%80%94+%5BarXiv%3A2211%2E02219%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2211%2E)
138. Agnolucci L, Baldrati A, Todino F, Becattini F, Bertini M, Bimbo AD. ECO: ensembling context optimization for vision-language models; 2023. ArXiv:2307.14063. — [arXiv:2307.14063](https://arxiv.org/abs/2307.14063) [find](https://scholar.google.com/scholar?q=Agnolucci+L%2C+Baldrati+A%2C+Todino+F%2C+Becattini+F%2C+Bertini+M%2C+Bimbo+AD%2E+ECO%3A+ensembling+context+optimization+for+vision%2Dlanguage+models%3B+2023%2E+ArXiv%3A2307%2E14063%2E+%E2%80%94+%5BarXiv%3A2307%2E14063%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs)
139. Chowdhury S, Nag S, Manocha D. APoLLo : unified adapter and prompt learning for vision language models. In: Bouamor H, Pino J, Bali K, editors. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. Singapore: Association for Computational Linguistics; 2023. p. 10173… [find](https://scholar.google.com/scholar?q=Chowdhury+S%2C+Nag+S%2C+Manocha+D%2E+APoLLo+%3A+unified+adapter+and+prompt+learning+for+vision+language+models%2E+In%3A+Bouamor+H%2C+Pino+J%2C+Bali+K%2C+editors%2E+Proceedings+of+the+2023+Conference+on+Empirical+Methods+)
140. Zhou K, Yang J, Loy CC, Liu Z. Conditional prompt learning for vision-language models; 2022. ArXiv:2203.05557. — [arXiv:2203.05557](https://arxiv.org/abs/2203.05557) [find](https://scholar.google.com/scholar?q=Zhou+K%2C+Yang+J%2C+Loy+CC%2C+Liu+Z%2E+Conditional+prompt+learning+for+vision%2Dlanguage+models%3B+2022%2E+ArXiv%3A2203%2E05557%2E+%E2%80%94+%5BarXiv%3A2203%2E05557%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2203%2E05557%29)
141. Ma S, Xie CW, Wei Y, Sun S, Fan J, Bao X, et al. Understanding the multi-modal prompts of the pre-trained vision-language model; 2024. ArXiv:2312.11570. — [arXiv:2312.11570](https://arxiv.org/abs/2312.11570) [find](https://scholar.google.com/scholar?q=Ma+S%2C+Xie+CW%2C+Wei+Y%2C+Sun+S%2C+Fan+J%2C+Bao+X%2C+et+al%2E+Understanding+the+multi%2Dmodal+prompts+of+the+pre%2Dtrained+vision%2Dlanguage+model%3B+2024%2E+ArXiv%3A2312%2E11570%2E+%E2%80%94+%5BarXiv%3A2312%2E11570%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2312)
142. Khattak MU, Wasim ST, Naseer M, Khan S, Yang MH, Khan FS. Self-regulating prompts: foundational model adaptation without forgetting; 2023. ArXiv:2307.06948. — [arXiv:2307.06948](https://arxiv.org/abs/2307.06948) [find](https://scholar.google.com/scholar?q=Khattak+MU%2C+Wasim+ST%2C+Naseer+M%2C+Khan+S%2C+Yang+MH%2C+Khan+FS%2E+Self%2Dregulating+prompts%3A+foundational+model+adaptation+without+forgetting%3B+2023%2E+ArXiv%3A2307%2E06948%2E+%E2%80%94+%5BarXiv%3A2307%2E06948%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F)
143. Khattak MU, Rasheed H, Maaz M, Khan S, Khan FS. MaPLe: multi-modal prompt learning; 2023. ArXiv:2210.03117. — [arXiv:2210.03117](https://arxiv.org/abs/2210.03117) [find](https://scholar.google.com/scholar?q=Khattak+MU%2C+Rasheed+H%2C+Maaz+M%2C+Khan+S%2C+Khan+FS%2E+MaPLe%3A+multi%2Dmodal+prompt+learning%3B+2023%2E+ArXiv%3A2210%2E03117%2E+%E2%80%94+%5BarXiv%3A2210%2E03117%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2210%2E03117%29)
144. Gu J, Han Z, Chen S, Beirami A, He B, Zhang G, et al. A systematic survey of prompt engineering on vision-language foundation models; 2023. ArXiv:2307.12980. — [arXiv:2307.12980](https://arxiv.org/abs/2307.12980) [find](https://scholar.google.com/scholar?q=Gu+J%2C+Han+Z%2C+Chen+S%2C+Beirami+A%2C+He+B%2C+Zhang+G%2C+et+al%2E+A+systematic+survey+of+prompt+engineering+on+vision%2Dlanguage+foundation+models%3B+2023%2E+ArXiv%3A2307%2E12980%2E+%E2%80%94+%5BarXiv%3A2307%2E12980%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs)
145. Shen L, Tan W, Zheng B, Khashabi D. Flatness-aware prompt selection improves accuracy and sample efficiency; 2023. ArXiv:2305.10713. [find](https://scholar.google.com/scholar?q=Shen+L%2C+Tan+W%2C+Zheng+B%2C+Khashabi+D%2E+Flatness%2Daware+prompt+selection+improves+accuracy+and+sample+efficiency%3B+2023%2E+ArXiv%3A2305%2E10713%2E)
146. Paul D, Ismayilzada M, Peyrard M, Borges B, Bosselut A, West R, et al. [Refiner: reasoning feedback on intermediate representations](https://md.research.elamur.ai/free/en/papers/paul-2023-refiner-reasoning-feedback-intermediate-representations/); 2023. ArXiv:2304.01904.
147. Ananthakrishnan R, Bhattacharyya P, Sasikumar M, Shah RM. Some issues in automatic evaluation of English-Hindi MT: more blues for BLEU. Icon. 2007;64. [find](https://scholar.google.com/scholar?q=Ananthakrishnan+R%2C+Bhattacharyya+P%2C+Sasikumar+M%2C+Shah+RM%2E+Some+issues+in+automatic+evaluation+of+English%2DHindi+MT%3A+more+blues+for+BLEU%2E+Icon%2E+2007%3B64%2E)
148. Callison-Burch C, Osborne M, Koehn P. [Re-evaluating the role of BLEU in machine translation research](https://md.research.elamur.ai/free/en/papers/burch-2006-re-evaluating-role-bleu-machine/). In: 11th Conference of the European Chapter of the Association for Computational Linguistics; 2006. p. 249–256.
149. Stent A, Marge M, Singhai M. Evaluating evaluation methods for generation in the presence of variation. In: International Conference on Intelligent Text Processing and Computational Linguistics. Springer; 2005. p. 341–351. [find](https://scholar.google.com/scholar?q=Stent+A%2C+Marge+M%2C+Singhai+M%2E+Evaluating+evaluation+methods+for+generation+in+the+presence+of+variation%2E+In%3A+International+Conference+on+Intelligent+Text+Processing+and+Computational+Linguistics%2E+Sprin)
150. Adams G, Fabbri A, Ladhak F, Lehman E, Elhadad N. From sparse to dense: GPT-4 summarization with chain of density prompting; 2023. ArXiv:2309.04269. [find](https://scholar.google.com/scholar?q=Adams+G%2C+Fabbri+A%2C+Ladhak+F%2C+Lehman+E%2C+Elhadad+N%2E+From+sparse+to+dense%3A+GPT%2D4+summarization+with+chain+of+density+prompting%3B+2023%2E+ArXiv%3A2309%2E04269%2E)
151. Stiennon N, Ouyang L, Wu J, Ziegler D, Lowe R, Voss C, et al. Learning to summarize with human feedback. Advances in Neural Information Processing Systems. 2020;33:3008–3021. [find](https://scholar.google.com/scholar?q=Stiennon+N%2C+Ouyang+L%2C+Wu+J%2C+Ziegler+D%2C+Lowe+R%2C+Voss+C%2C+et+al%2E+Learning+to+summarize+with+human+feedback%2E+Advances+in+Neural+Information+Processing+Systems%2E+2020%3B33%3A3008%E2%80%933021%2E)
152. Wang R, Wang H, Mi F, Chen Y, Xue B, Wong KF, et al. Enhancing Large Language Models Against Inductive Instructions with Dual-critique Prompting; 2023. ArXiv:2305.13733. [find](https://scholar.google.com/scholar?q=Wang+R%2C+Wang+H%2C+Mi+F%2C+Chen+Y%2C+Xue+B%2C+Wong+KF%2C+et+al%2E+Enhancing+Large+Language+Models+Against+Inductive+Instructions+with+Dual%2Dcritique+Prompting%3B+2023%2E+ArXiv%3A2305%2E13733%2E)
153. Lee M, Srivastava M, Hardy A, Thickstun J, Durmus E, Paranjape A, et al. Evaluating human-language model interaction; 2022. ArXiv:2212.09746. — [arXiv:2212.09746](https://arxiv.org/abs/2212.09746) [find](https://scholar.google.com/scholar?q=Lee+M%2C+Srivastava+M%2C+Hardy+A%2C+Thickstun+J%2C+Durmus+E%2C+Paranjape+A%2C+et+al%2E+Evaluating+human%2Dlanguage+model+interaction%3B+2022%2E+ArXiv%3A2212%2E09746%2E+%E2%80%94+%5BarXiv%3A2212%2E09746%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2212%2E09746%29)
154. Papineni K, Roukos S, Ward T, Zhu WJ. [BLEU: a method for automatic evaluation of machine translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics; 2002. p. 311–318.
155. Chin-Yew L. [ROUGE: a package for automatic evaluation of summaries](https://md.research.elamur.ai/free/en/papers/lin-2004-rouge-package-automatic-evaluation-summaries/). In: Text Summarization Branches Out; 2004. p. 74–81.
156. Banerjee S, Lavie A. [METEOR: an automatic metric for MT evaluation with improved correlation with human judgments](https://md.research.elamur.ai/free/en/papers/banerjee-2005-meteor-automatic-metric-mt-evaluation/). In: Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization; 2005. p. 65–72.
157. Zhang T, Kishore V, Wu F, Weinberger KQ, Artzi Y. BERTScore: evaluating text generation with BERT. In: Ninth International Conference on Learning Representations; 2020. . [find](https://scholar.google.com/scholar?q=Zhang+T%2C+Kishore+V%2C+Wu+F%2C+Weinberger+KQ%2C+Artzi+Y%2E+BERTScore%3A+evaluating+text+generation+with+BERT%2E+In%3A+Ninth+International+Conference+on+Learning+Representations%3B+2020%2E+%2E)
158. Sai AB, Mohankumar AK, Khapra MM. A survey of evaluation metrics used for NLG systems. ACM Computing Surveys (CSUR). 2022;55(2):1–39. [find](https://scholar.google.com/scholar?q=Sai+AB%2C+Mohankumar+AK%2C+Khapra+MM%2E+A+survey+of+evaluation+metrics+used+for+NLG+systems%2E+ACM+Computing+Surveys+%28CSUR%29%2E+2022%3B55%282%29%3A1%E2%80%9339%2E)
159. Srivastava A, Rastogi A, Rao A, Shoeb AAM, Abid A, Fisch A, et al. [Beyond the imitation game: quantifying and extrapolating the capabilities of language models](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/); 2023. ArXiv:2206.04615.
160. Srivastava A, Rastogi A, Rao A, Shoeb AAM, Abid A, Fisch A, et al. [Beyond the imitation game: quantifying and extrapolating the capabilities of language models](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/); 2022. ArXiv:2206.04615.
161. Chang Y, Wang X, Wang J, Wu Y, Yang L, Zhu K, et al. [A survey on evaluation of large language models](https://md.research.elamur.ai/free/en/papers/chang-2023-survey-evaluation-large-language-models/). ACM Transactions on Intelligent Systems and Technology. 2024;15(3):1–45.
162. Wang Y, Liu X, Shi S. Deep neural solver for math word problems. In: Proceedings of the 2017 conference on empirical methods in natural language processing; 2017. p. 845–854. [find](https://scholar.google.com/scholar?q=Wang+Y%2C+Liu+X%2C+Shi+S%2E+Deep+neural+solver+for+math+word+problems%2E+In%3A+Proceedings+of+the+2017+conference+on+empirical+methods+in+natural+language+processing%3B+2017%2E+p%2E+845%E2%80%93854%2E)
163. Qin J, Lin L, Liang X, Zhang R, Lin L. Semantically-aligned universal tree-structured solver for math word problems; 2020. ArXiv:2010.06823. [find](https://scholar.google.com/scholar?q=Qin+J%2C+Lin+L%2C+Liang+X%2C+Zhang+R%2C+Lin+L%2E+Semantically%2Daligned+universal+tree%2Dstructured+solver+for+math+word+problems%3B+2020%2E+ArXiv%3A2010%2E06823%2E)
164. Shi S, Wang Y, Lin CY, Liu X, Rui Y. Automatically solving number word problems by semantic parsing and reasoning. In: Proceedings of the 2015 conference on empirical methods in natural language processing; 2015. p. 1132–1142. [find](https://scholar.google.com/scholar?q=Shi+S%2C+Wang+Y%2C+Lin+CY%2C+Liu+X%2C+Rui+Y%2E+Automatically+solving+number+word+problems+by+semantic+parsing+and+reasoning%2E+In%3A+Proceedings+of+the+2015+conference+on+empirical+methods+in+natural+language+proce)
165. Hosseini MJ, Hajishirzi H, Etzioni O, Kushman N. [Learning to Solve Arithmetic Word Problems with Verb Categorization](https://md.research.elamur.ai/free/en/papers/hosseini-2014-learning-solve-arithmetic-word-problems/). In: Moschitti A, Pang B, Daelemans W, editors. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha, Qatar: Association for Computatio…
166. Roy S, Roth D. [Unit dependency graph and its application to arithmetic word problem solving](https://md.research.elamur.ai/free/en/papers/roy-2017-unit-dependency-graph-arithmetic/). In: Proceedings of the AAAI conference on artificial intelligence. vol. 31; 2017. .
167. Koncel-Kedziorski R, Roy S, Amini A, Kushman N, Hajishirzi H. MAWPS: a math word problem repository. In: Proceedings of the 2016 conference of the north american chapter of the association for computational linguistics: human language technologies; 2016. p. 1152–1157. [find](https://scholar.google.com/scholar?q=Koncel%2DKedziorski+R%2C+Roy+S%2C+Amini+A%2C+Kushman+N%2C+Hajishirzi+H%2E+MAWPS%3A+a+math+word+problem+repository%2E+In%3A+Proceedings+of+the+2016+conference+of+the+north+american+chapter+of+the+association+for+computa)
168. Miao SY, Liang CC, Su KY. A diverse corpus for evaluating and developing English math word problem solvers; 2021. ArXiv:2106.15772. [find](https://scholar.google.com/scholar?q=Miao+SY%2C+Liang+CC%2C+Su+KY%2E+A+diverse+corpus+for+evaluating+and+developing+English+math+word+problem+solvers%3B+2021%2E+ArXiv%3A2106%2E15772%2E)
169. Goswami M, Sanil V, Choudhry A, Srinivasan A, Udompanyawit C, Dubrawski A. AQuA: a benchmarking tool for label quality assessment; 2024. ArXiv:2306.09467. — [arXiv:2306.09467](https://arxiv.org/abs/2306.09467) [find](https://scholar.google.com/scholar?q=Goswami+M%2C+Sanil+V%2C+Choudhry+A%2C+Srinivasan+A%2C+Udompanyawit+C%2C+Dubrawski+A%2E+AQuA%3A+a+benchmarking+tool+for+label+quality+assessment%3B+2024%2E+ArXiv%3A2306%2E09467%2E+%E2%80%94+%5BarXiv%3A2306%2E09467%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F23)
170. Amini A, Gabriel S, Lin P, Koncel-Kedziorski R, Choi Y, Hajishirzi H. [Mathqa: Towards interpretable math word problem solving with operation-based formalisms](https://md.research.elamur.ai/free/en/papers/amini-2019-mathqa-interpretable-math-word-problem/); 2019. ArXiv:1905.13319.
171. Koncel-Kedziorski R, Hajishirzi H, Sabharwal A, Etzioni O, Ang SD. Parsing algebraic word problems into equations. Transactions of the Association for Computational Linguistics. 2015;3:585–597. [find](https://scholar.google.com/scholar?q=Koncel%2DKedziorski+R%2C+Hajishirzi+H%2C+Sabharwal+A%2C+Etzioni+O%2C+Ang+SD%2E+Parsing+algebraic+word+problems+into+equations%2E+Transactions+of+the+Association+for+Computational+Linguistics%2E+2015%3B3%3A585%E2%80%93597%2E)
172. Roy S, Roth D. ArXiv:1608.01413. [Solving general arithmetic word problems](https://md.research.elamur.ai/free/en/papers/roy-2015-solving-general-arithmetic-word-problems/); 2016.
173. Hendrycks D, Burns C, Kadavath S, Arora A, Basart S, Tang E, et al. [Measuring mathematical problem solving with the math dataset](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/); 2021. ArXiv:2103.03874.
174. Lightman H, Kosaraju V, Burda Y, Edwards H, Baker B, Lee T, et al. Let’s verify step by step; 2023. [ArXiv:2305.20050](https://md.research.elamur.ai/free/en/papers/lightman-2023-let-s-verify-step-step/).
175. Hendrycks D, Burns C, Basart S, Zou A, Mazeika M, Song D, et al. [Measuring massive multitask language understanding](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/); 2020. ArXiv:2009.03300.
176. Thorne J, Vlachos A, Christodoulopoulos C, Mittal A. [FEVER: a large-scale dataset for fact extraction and VERification](https://md.research.elamur.ai/free/en/papers/thorne-2018-fever-large-scale-dataset-fact/); 2018. ArXiv:1803.05355.
177. Feng S, Shi W, Bai Y, Balachandran V, He T, Tsvetkov Y. Knowledge card: filling LLMs’ knowledge gaps with plug-in specialized Language Models; 2023. ArXiv:2305.09955. [find](https://scholar.google.com/scholar?q=Feng+S%2C+Shi+W%2C+Bai+Y%2C+Balachandran+V%2C+He+T%2C+Tsvetkov+Y%2E+Knowledge+card%3A+filling+LLMs%E2%80%99+knowledge+gaps+with+plug%2Din+specialized+Language+Models%3B+2023%2E+ArXiv%3A2305%2E09955%2E)
178. Kočiskỳ T, Schwarz J, Blunsom P, Dyer C, Hermann KM, Melis G, et al. [The narrativeqa reading comprehension challenge](https://md.research.elamur.ai/free/en/papers/kocisky-2018-narrativeqa-reading-comprehension-challenge/). Transactions of the Association for Computational Linguistics. 2018;6:317–328.
179. Pang RY, Parrish A, Joshi N, Nangia N, Phang J, Chen A, et al. [QuALITY: question answering with long input texts, yes!](https://md.research.elamur.ai/free/en/papers/pang-2022-quality-question-answering-long-input/) In: North American Chapter of the Association for Computational Linguistics; 2021. p. 5336–5358.
180. Talmor A, Herzig J, Lourie N, Berant J. [Commonsenseqa: a question answering challenge targeting commonsense knowledge](https://md.research.elamur.ai/free/en/papers/talmor-2019-commonsenseqa-question-answering-challenge-targeting/); 2018. ArXiv:1811.00937.
181. Talmor A, Herzig J, Lourie N, Berant J. [CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge](https://md.research.elamur.ai/free/en/papers/talmor-2019-commonsenseqa-question-answering-challenge-targeting/). In: Burstein J, Doran C, Solorio T, editors. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techno…
182. Speer R, Chin J, Havasi C. Conceptnet 5.5: An open multilingual graph of general knowledge. In: Proceedings of the AAAI conference on artificial intelligence. vol. 31; 2017. . [find](https://scholar.google.com/scholar?q=Speer+R%2C+Chin+J%2C+Havasi+C%2E+Conceptnet+5%2E5%3A+An+open+multilingual+graph+of+general+knowledge%2E+In%3A+Proceedings+of+the+AAAI+conference+on+artificial+intelligence%2E+vol%2E+31%3B+2017%2E+%2E)
183. Yang Z, Qi P, Zhang S, Bengio Y, Cohen WW, Salakhutdinov R, et al. [HotpotQA: a dataset for diverse, explainable multi-hop question answering](https://md.research.elamur.ai/free/en/papers/yang-2018-hotpotqa-dataset-diverse-explainable-multi/). In: Conference on Empirical Methods in Natural Language Processing; 2018. p. 2369–2380.
184. Clark P, Cowhey I, Etzioni O, Khot T, Sabharwal A, Schoenick C, et al. Think you have solved question answering? try arc, the ai2 reasoning challenge; 2018. ArXiv:1803.05457. [find](https://scholar.google.com/scholar?q=Clark+P%2C+Cowhey+I%2C+Etzioni+O%2C+Khot+T%2C+Sabharwal+A%2C+Schoenick+C%2C+et+al%2E+Think+you+have+solved+question+answering%3F+try+arc%2C+the+ai2+reasoning+challenge%3B+2018%2E+ArXiv%3A1803%2E05457%2E)
185. Huang L, Cao S, Parulian N, Ji H, Wang L. [Efficient attentions for long document summarization](https://md.research.elamur.ai/free/en/papers/huang-2021-efficient-attentions-long-document-summarization/); 2021. ArXiv:2104.02112.
186. Voorhees EM, Tice DM. Building a question answering test collection. In: Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval; 2000. p. 200–207. [find](https://scholar.google.com/scholar?q=Voorhees+EM%2C+Tice+DM%2E+Building+a+question+answering+test+collection%2E+In%3A+Proceedings+of+the+23rd+annual+international+ACM+SIGIR+conference+on+Research+and+development+in+information+retrieval%3B+2000%2E+p)
187. Socher R, Perelygin A, Wu J, Chuang J, Manning CD, Ng AY, et al. Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 conference on empirical methods in natural language processing; 2013. p. 1631–1642. [find](https://scholar.google.com/scholar?q=Socher+R%2C+Perelygin+A%2C+Wu+J%2C+Chuang+J%2C+Manning+CD%2C+Ng+AY%2C+et+al%2E+Recursive+deep+models+for+semantic+compositionality+over+a+sentiment+treebank%2E+In%3A+Proceedings+of+the+2013+conference+on+empirical+meth)
188. Chen M, Chu Z, Wiseman S, Gimpel K. [Summscreen: a dataset for abstractive screenplay summarization](https://md.research.elamur.ai/free/en/papers/chen-2022-summscreen-dataset-abstractive-screenplay-summarization/); 2021. ArXiv:2104.07091.
189. Zhang X, Zhao J, LeCun Y. [Character-level convolutional networks for text classification](https://md.research.elamur.ai/free/en/papers/zhang-2015-character-level-convolutional-networks-text/). Advances in neural information processing systems. 2015;28.
190. Zhang W, Deng Y, Liu B, Pan SJ, Bing L. [Sentiment analysis in the era of large language models: a reality check](https://md.research.elamur.ai/free/en/papers/zhang-2023-sentiment-analysis-era-large-language/); 2023. ArXiv:2305.15005.
191. Hu M, Liu B. Mining and summarizing customer reviews. In: Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining; 2004. p. 168–177. [find](https://scholar.google.com/scholar?q=Hu+M%2C+Liu+B%2E+Mining+and+summarizing+customer+reviews%2E+In%3A+Proceedings+of+the+tenth+ACM+SIGKDD+international+conference+on+Knowledge+discovery+and+data+mining%3B+2004%2E+p%2E+168%E2%80%93177%2E)
192. Pang B, Lee L. [Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales](https://md.research.elamur.ai/free/en/papers/pang-2005-seeing-stars-exploiting-class-relationships/); 2005. Cs/0506075.
193. Tang L, Peng Y, Wang Y, Ding Y, Durrett G, Rousseau JF. Less likely brainstorming: Using language models to generate alternative hypotheses. In: Proceedings of the conference. Association for Computational Linguistics. Meeting. vol. 2023. NIH Public Access; 2023. p. 12532. [find](https://scholar.google.com/scholar?q=Tang+L%2C+Peng+Y%2C+Wang+Y%2C+Ding+Y%2C+Durrett+G%2C+Rousseau+JF%2E+Less+likely+brainstorming%3A+Using+language+models+to+generate+alternative+hypotheses%2E+In%3A+Proceedings+of+the+conference%2E+Association+for+Computat)
194. Raunak V, Post M, Menezes A. SALTED: a framework for SAlient long-tail translation error detection; 2022. ArXiv:2205.09988. [find](https://scholar.google.com/scholar?q=Raunak+V%2C+Post+M%2C+Menezes+A%2E+SALTED%3A+a+framework+for+SAlient+long%2Dtail+translation+error+detection%3B+2022%2E+ArXiv%3A2205%2E09988%2E)
195. Yu L, Poirson P, Yang S, Berg AC, Berg TL. [Modeling context in referring expressions](https://md.research.elamur.ai/free/en/papers/yu-2016-modeling-context-referring-expressions/). In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14. Springer; 2016. p. 69–85.
196. Mao J, Huang J, Toshev A, Camburu O, Yuille AL, Murphy K. [Generation and comprehension of unambiguous object descriptions](https://md.research.elamur.ai/free/en/papers/mao-2015-generation-comprehension-unambiguous-object-descriptions/). In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. p. 11–20.
197. Jain N, Saifullah K, Wen Y, Kirchenbauer J, Shu M, Saha A, et al. Bring your own data! Self-supervised evaluation for large language models; 2023. ArXiv:2306.13651. — [arXiv:2306.13651](https://arxiv.org/abs/2306.13651) [find](https://scholar.google.com/scholar?q=Jain+N%2C+Saifullah+K%2C+Wen+Y%2C+Kirchenbauer+J%2C+Shu+M%2C+Saha+A%2C+et+al%2E+Bring+your+own+data%21+Self%2Dsupervised+evaluation+for+large+language+models%3B+2023%2E+ArXiv%3A2306%2E13651%2E+%E2%80%94+%5BarXiv%3A2306%2E13651%5D%28https%3A%2F%2Farxiv%2E)
198. Wang Y, Yu Z, Zeng Z, Yang L, Wang C, Chen H, et al. [PandaLM: an automatic evaluation benchmark for LLM instruction tuning optimization](https://md.research.elamur.ai/free/en/papers/wang-2023-pandalm-automatic-evaluation-benchmark-llm/); 2023. ArXiv:2306.05087.
199. Lin YT, Chen YN. [LLM-eval: unified multi-dimensional automatic evaluation for open-domain conversations with large language models](https://md.research.elamur.ai/free/en/papers/lin-2023-llm-eval-unified-multi-dimensional/); 2023. ArXiv:2305.13711.
200. Dehghani M, Tay Y, Gritsenko AA, Zhao Z, Houlsby N, Diaz F, et al. The benchmark lottery; 2021. ArXiv:2107.07002. [find](https://scholar.google.com/scholar?q=Dehghani+M%2C+Tay+Y%2C+Gritsenko+AA%2C+Zhao+Z%2C+Houlsby+N%2C+Diaz+F%2C+et+al%2E+The+benchmark+lottery%3B+2021%2E+ArXiv%3A2107%2E07002%2E)
201. Kiela D, Bartolo M, Nie Y, Kaushik D, Geiger A, Wu Z, et al. Dynabench: rethinking benchmarking in NLP; 2021. ArXiv:2104.14337. [find](https://scholar.google.com/scholar?q=Kiela+D%2C+Bartolo+M%2C+Nie+Y%2C+Kaushik+D%2C+Geiger+A%2C+Wu+Z%2C+et+al%2E+Dynabench%3A+rethinking+benchmarking+in+NLP%3B+2021%2E+ArXiv%3A2104%2E14337%2E)
202. Xu W, Banburski-Fahey A, Jojic N. Reprompting: automated chain-of-thought prompt inference through gibbs sampling; 2023. ArXiv:2305.09993. — [arXiv:2305.09993](https://arxiv.org/abs/2305.09993) [find](https://scholar.google.com/scholar?q=Xu+W%2C+Banburski%2DFahey+A%2C+Jojic+N%2E+Reprompting%3A+automated+chain%2Dof%2Dthought+prompt+inference+through+gibbs+sampling%3B+2023%2E+ArXiv%3A2305%2E09993%2E+%E2%80%94+%5BarXiv%3A2305%2E09993%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2305%2E09993%29)
203. Wang L, Xu W, Lan Y, Hu Z, Lan Y, Lee RKW, et al. Plan-and-solve prompting: improving zero-shot chain-of-thought reasoning by large language models; 2023. ArXiv:2305.04091. [find](https://scholar.google.com/scholar?q=Wang+L%2C+Xu+W%2C+Lan+Y%2C+Hu+Z%2C+Lan+Y%2C+Lee+RKW%2C+et+al%2E+Plan%2Dand%2Dsolve+prompting%3A+improving+zero%2Dshot+chain%2Dof%2Dthought+reasoning+by+large+language+models%3B+2023%2E+ArXiv%3A2305%2E04091%2E)
204. Mishra S, Khashabi D, Baral C, Hajishirzi H. Cross-task generalization via natural language crowdsourcing instructions; 2021. ArXiv:2104.08773. [find](https://scholar.google.com/scholar?q=Mishra+S%2C+Khashabi+D%2C+Baral+C%2C+Hajishirzi+H%2E+Cross%2Dtask+generalization+via+natural+language+crowdsourcing+instructions%3B+2021%2E+ArXiv%3A2104%2E08773%2E)
205. Pryzant R, Iter D, Li J, Lee YT, Zhu C, Zeng M. Automatic prompt optimization with ”gradient descent” and beam search; 2023. [ArXiv:2305.03495](https://md.research.elamur.ai/free/en/papers/pryzant-2023-automatic-prompt-optimization-gradient-descent/).
206. Zhou Y, Muresanu AI, Han Z, Paster K, Pitis S, Chan H, et al. [Large Language Models are human-level prompt engineers](https://md.research.elamur.ai/free/en/papers/zhou-2022-large-language-models-human-level/). In: Eleventh International Conference on Learning Representations; 2022. .
207. Chen H, Pasunuru R, Weston J, Celikyilmaz A. Walking down the memory maze: beyond context limit through interactive reading; 2023. ArXiv:2310.05029. — [arXiv:2310.05029](https://arxiv.org/abs/2310.05029) [find](https://scholar.google.com/scholar?q=Chen+H%2C+Pasunuru+R%2C+Weston+J%2C+Celikyilmaz+A%2E+Walking+down+the+memory+maze%3A+beyond+context+limit+through+interactive+reading%3B+2023%2E+ArXiv%3A2310%2E05029%2E+%E2%80%94+%5BarXiv%3A2310%2E05029%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2310%2E050)
208. Chevalier A, Wettig A, Ajith A, Chen D. [Adapting language models to compress contexts](https://md.research.elamur.ai/free/en/papers/chevalier-2023-adapting-language-models-compress-contexts/); 2023. ArXiv:2305.14788.
209. Bulatov A, Kuratov Y, Kapushev Y, Burtsev MS. Scaling transformer to 1m tokens and beyond with rmt; 2023. ArXiv:2304.11062. — [arXiv:2304.11062](https://arxiv.org/abs/2304.11062) [find](https://scholar.google.com/scholar?q=Bulatov+A%2C+Kuratov+Y%2C+Kapushev+Y%2C+Burtsev+MS%2E+Scaling+transformer+to+1m+tokens+and+beyond+with+rmt%3B+2023%2E+ArXiv%3A2304%2E11062%2E+%E2%80%94+%5BarXiv%3A2304%2E11062%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2304%2E11062%29)
210. Xu J, Szlam A, Weston J. Beyond goldfish memory: Long-term open-domain conversation; 2021. ArXiv:2107.07567. [find](https://scholar.google.com/scholar?q=Xu+J%2C+Szlam+A%2C+Weston+J%2E+Beyond+goldfish+memory%3A+Long%2Dterm+open%2Ddomain+conversation%3B+2021%2E+ArXiv%3A2107%2E07567%2E)
211. Wu Y, Rabe MN, Hutchins D, Szegedy C. Memorizing transformers; 2022. ArXiv:2203.08913. [find](https://scholar.google.com/scholar?q=Wu+Y%2C+Rabe+MN%2C+Hutchins+D%2C+Szegedy+C%2E+Memorizing+transformers%3B+2022%2E+ArXiv%3A2203%2E08913%2E)
212. Izacard G, Grave E. [Leveraging passage retrieval with generative models for open domain question answering](https://md.research.elamur.ai/free/en/papers/izacard-2021-leveraging-passage-retrieval-generative-models/); 2020. ArXiv:2007.01282.
213. Guo Q, Wang R, Guo J, Li B, Song K, Tan X, et al. Connecting large language models with evolutionary algorithms yields powerful prompt optimizers; 2023. ArXiv:2309.08532. [find](https://scholar.google.com/scholar?q=Guo+Q%2C+Wang+R%2C+Guo+J%2C+Li+B%2C+Song+K%2C+Tan+X%2C+et+al%2E+Connecting+large+language+models+with+evolutionary+algorithms+yields+powerful+prompt+optimizers%3B+2023%2E+ArXiv%3A2309%2E08532%2E)
214. Sridhar A, Lo R, Xu FF, Zhu H, Zhou S. Hierarchical prompting assists large language model on web navigation; 2023. ArXiv:2305.14257. [find](https://scholar.google.com/scholar?q=Sridhar+A%2C+Lo+R%2C+Xu+FF%2C+Zhu+H%2C+Zhou+S%2E+Hierarchical+prompting+assists+large+language+model+on+web+navigation%3B+2023%2E+ArXiv%3A2305%2E14257%2E)
215. Yao S, Chen H, Yang J, Narasimhan K. [Webshop: towards scalable real-world web interaction with grounded language agents](https://md.research.elamur.ai/free/en/papers/yao-2022-webshop-towards-scalable-real-world/). Advances in Neural Information Processing Systems. 2022;35:20744–20757.
216. Zhang C, Xiao J, Chen L, Shao J, Chen L. TreePrompt: Learning to Compose Tree Prompts for Explainable Visual Grounding; 2023. ArXiv:2305.11497. — [arXiv:2305.11497](https://arxiv.org/abs/2305.11497) [find](https://scholar.google.com/scholar?q=Zhang+C%2C+Xiao+J%2C+Chen+L%2C+Shao+J%2C+Chen+L%2E+TreePrompt%3A+Learning+to+Compose+Tree+Prompts+for+Explainable+Visual+Grounding%3B+2023%2E+ArXiv%3A2305%2E11497%2E+%E2%80%94+%5BarXiv%3A2305%2E11497%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2305%2E11497%29)
217. Colangeli M, Di Francesco A, Rondoni L. Finite reservoirs and irreversibility corrections to Hamiltonian systems statistics; 2023. ArXiv:2305.14922. — [arXiv:2305.14922](https://arxiv.org/abs/2305.14922) [find](https://scholar.google.com/scholar?q=Colangeli+M%2C+Di+Francesco+A%2C+Rondoni+L%2E+Finite+reservoirs+and+irreversibility+corrections+to+Hamiltonian+systems+statistics%3B+2023%2E+ArXiv%3A2305%2E14922%2E+%E2%80%94+%5BarXiv%3A2305%2E14922%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2305%2E149)
218. Jiang H, Wu Q, Lin CY, Yang Y, Qiu L. [Llmlingua: Compressing prompts for accelerated inference of large language models](https://md.research.elamur.ai/free/en/papers/jiang-2023-llmlingua-compressing-prompts-accelerated-inference/); 2023. ArXiv:2310.05736.
219. Ning X, Lin Z, Zhou Z, Yang H, Wang Y. Skeleton-of-thought: Large language models can do parallel decoding; 2023. ArXiv:2307.15337. [find](https://scholar.google.com/scholar?q=Ning+X%2C+Lin+Z%2C+Zhou+Z%2C+Yang+H%2C+Wang+Y%2E+Skeleton%2Dof%2Dthought%3A+Large+language+models+can+do+parallel+decoding%3B+2023%2E+ArXiv%3A2307%2E15337%2E)
220. Hu H, Lu H, Zhang H, Song YZ, Lam W, Zhang Y. Chain-of-symbol prompting elicits planning in Large Langauge Models; 2023. ArXiv:2305.10276. — [arXiv:2305.10276](https://arxiv.org/abs/2305.10276) [find](https://scholar.google.com/scholar?q=Hu+H%2C+Lu+H%2C+Zhang+H%2C+Song+YZ%2C+Lam+W%2C+Zhang+Y%2E+Chain%2Dof%2Dsymbol+prompting+elicits+planning+in+Large+Langauge+Models%3B+2023%2E+ArXiv%3A2305%2E10276%2E+%E2%80%94+%5BarXiv%3A2305%2E10276%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2305%2E10276%29)
221. Feng S, Shi W, Bai Y, Balachandran V, He T, Tsvetkov Y. Knowledge Card: Filling LLMs’ Knowledge Gaps with Plug-in Specialized Language Models; 2023. ArXiv:2305.09955. [find](https://scholar.google.com/scholar?q=Feng+S%2C+Shi+W%2C+Bai+Y%2C+Balachandran+V%2C+He+T%2C+Tsvetkov+Y%2E+Knowledge+Card%3A+Filling+LLMs%E2%80%99+Knowledge+Gaps+with+Plug%2Din+Specialized+Language+Models%3B+2023%2E+ArXiv%3A2305%2E09955%2E)
222. Krishna S, Ma J, Slack D, Ghandeharioun A, Singh S, Lakkaraju H. Post hoc explanations of language models can improve language models. Advances in Neural Information Processing Systems. 2024;36. [find](https://scholar.google.com/scholar?q=Krishna+S%2C+Ma+J%2C+Slack+D%2C+Ghandeharioun+A%2C+Singh+S%2C+Lakkaraju+H%2E+Post+hoc+explanations+of+language+models+can+improve+language+models%2E+Advances+in+Neural+Information+Processing+Systems%2E+2024%3B36%2E)
223. Sun S, Liu Y, Wang S, Zhu C, Iyyer M. Pearl: Prompting large language models to plan and execute actions over long documents; 2023. ArXiv:2305.14564. [find](https://scholar.google.com/scholar?q=Sun+S%2C+Liu+Y%2C+Wang+S%2C+Zhu+C%2C+Iyyer+M%2E+Pearl%3A+Prompting+large+language+models+to+plan+and+execute+actions+over+long+documents%3B+2023%2E+ArXiv%3A2305%2E14564%2E)
224. Chen W, Ma X, Wang X, Cohen WW. Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks; 2022. ArXiv:2211.12588. [find](https://scholar.google.com/scholar?q=Chen+W%2C+Ma+X%2C+Wang+X%2C+Cohen+WW%2E+Program+of+thoughts+prompting%3A+Disentangling+computation+from+reasoning+for+numerical+reasoning+tasks%3B+2022%2E+ArXiv%3A2211%2E12588%2E)
225. Press O, Zhang M, Min S, Schmidt L, Smith NA, Lewis M. Measuring and narrowing the compositionality gap in language models; 2022. ArXiv:2210.03350. [find](https://scholar.google.com/scholar?q=Press+O%2C+Zhang+M%2C+Min+S%2C+Schmidt+L%2C+Smith+NA%2C+Lewis+M%2E+Measuring+and+narrowing+the+compositionality+gap+in+language+models%3B+2022%2E+ArXiv%3A2210%2E03350%2E)
226. Schick T, Dwivedi-Yu J, Dessı̀ R, Raileanu R, Lomeli M, Hambro E, et al. [Toolformer: Language models can teach themselves to use tools](https://md.research.elamur.ai/free/en/papers/schick-2023-toolformer-language-models-can-teach/). Advances in Neural Information Processing Systems. 2024;36.
227. Zhou Y, Muresanu AI, Han Z, Paster K, Pitis S, Chan H, et al. [Large Language Models Are Human-Level Prompt Engineers](https://md.research.elamur.ai/free/en/papers/zhou-2022-large-language-models-human-level/); 2023. ArXiv:2211.01910.
228. Ajith A, Pan C, Xia M, Deshpande A, Narasimhan K. InstructEval: systematic evaluation of instruction selection methods; 2023. ArXiv:2307.00259. [find](https://scholar.google.com/scholar?q=Ajith+A%2C+Pan+C%2C+Xia+M%2C+Deshpande+A%2C+Narasimhan+K%2E+InstructEval%3A+systematic+evaluation+of+instruction+selection+methods%3B+2023%2E+ArXiv%3A2307%2E00259%2E)
229. Tang J, Zhou X, Wan X, Daley M, Bai Z. ML4STEM professional development program: enriching K-12 STEM teaching with machine learning. International Journal of Artificial Intelligence in Education. 2023;33(1):185–224. [find](https://scholar.google.com/scholar?q=Tang+J%2C+Zhou+X%2C+Wan+X%2C+Daley+M%2C+Bai+Z%2E+ML4STEM+professional+development+program%3A+enriching+K%2D12+STEM+teaching+with+machine+learning%2E+International+Journal+of+Artificial+Intelligence+in+Education%2E+2023)
230. Xie Q, Dai Z, Hovy E, Luong MT, Le QV. [Unsupervised data augmentation for consistency training](https://md.research.elamur.ai/free/en/papers/xie-2019-unsupervised-data-augmentation-consistency-training/). In: Advances in neural information processing systems. vol. 33; 2020. p. 6256–6268.
231. Ariely M, Nazaretsky T, Alexandron G. Machine learning and Hebrew NLP for automated assessment of open-ended questions in biology. International Journal of Artificial Intelligence in Education. 2023;33(1):1–34. [find](https://scholar.google.com/scholar?q=Ariely+M%2C+Nazaretsky+T%2C+Alexandron+G%2E+Machine+learning+and+Hebrew+NLP+for+automated+assessment+of+open%2Dended+questions+in+biology%2E+International+Journal+of+Artificial+Intelligence+in+Education%2E+2023%3B3)
232. Nilsson F, Tuvstedt J. GPT-4 as an automatic grader: the accuracy of grades set by GPT-4 on introductory programming assignments [Bachelor Thesis]. KTH Royal Institute of Technology; 2023. [find](https://scholar.google.com/scholar?q=Nilsson+F%2C+Tuvstedt+J%2E+GPT%2D4+as+an+automatic+grader%3A+the+accuracy+of+grades+set+by+GPT%2D4+on+introductory+programming+assignments+%5BBachelor+Thesis%5D%2E+KTH+Royal+Institute+of+Technology%3B+2023%2E)
233. Schneider J, Richner R, Riser M. Towards trustworthy autograding of short, multi-lingual, multi-type answers. International Journal of Artificial Intelligence in Education. 2023;33(1):88–118. [find](https://scholar.google.com/scholar?q=Schneider+J%2C+Richner+R%2C+Riser+M%2E+Towards+trustworthy+autograding+of+short%2C+multi%2Dlingual%2C+multi%2Dtype+answers%2E+International+Journal+of+Artificial+Intelligence+in+Education%2E+2023%3B33%281%29%3A88%E2%80%93118%2E)
234. Yang K, Tian Y, Peng N, Klein D. Re3: generating longer stories with recursive reprompting and revision. In: Goldberg Y, Kozareva Z, Zhang Y, editors. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Abu Dhabi, United Arab Emirates: Association for Computationa… [find](https://scholar.google.com/scholar?q=Yang+K%2C+Tian+Y%2C+Peng+N%2C+Klein+D%2E+Re3%3A+generating+longer+stories+with+recursive+reprompting+and+revision%2E+In%3A+Goldberg+Y%2C+Kozareva+Z%2C+Zhang+Y%2C+editors%2E+Proceedings+of+the+2022+Conference+on+Empirical+M)
235. Yang K, Klein D, Peng N, Tian Y. [DOC: improving long story coherence with detailed outline control](https://md.research.elamur.ai/free/en/papers/yang-2023-doc-improving-long-story-coherence/). In: Rogers A, Boyd-Graber J, Okazaki N, editors. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Toronto, Canada: Association for Compu…
236. Yang K, Klein D. [FUDGE: controlled text generation with future discriminators](https://md.research.elamur.ai/free/en/papers/yang-2021-fudge-controlled-text-generation-future/). In: Toutanova K, Rumshisky A, Zettlemoyer L, Hakkani-Tur D, Beltagy I, Bethard S, et al., editors. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human L…
237. Elgohary A, Hosseini S, Awadallah AH. Speak to your parser: interactive text-to-SQL with natural language feedback. In: Annual Meeting of the Association for Computational Linguistics; 2020. p. 2065–2077. [find](https://scholar.google.com/scholar?q=Elgohary+A%2C+Hosseini+S%2C+Awadallah+AH%2E+Speak+to+your+parser%3A+interactive+text%2Dto%2DSQL+with+natural+language+feedback%2E+In%3A+Annual+Meeting+of+the+Association+for+Computational+Linguistics%3B+2020%2E+p%2E+2065%E2%80%932)
238. Nijkamp E, Pang B, Hayashi H, Tu L, Wang H, Zhou Y, et al. Codegen: an open large language model for code with multi-turn program synthesis; 2022. ArXiv:2203.13474. [find](https://scholar.google.com/scholar?q=Nijkamp+E%2C+Pang+B%2C+Hayashi+H%2C+Tu+L%2C+Wang+H%2C+Zhou+Y%2C+et+al%2E+Codegen%3A+an+open+large+language+model+for+code+with+multi%2Dturn+program+synthesis%3B+2022%2E+ArXiv%3A2203%2E13474%2E)
239. Shrivastava D, Larochelle H, Tarlow D. Repository-level prompt generation for large language models of code. In: International Conference on Machine Learning; 2023. p. 31693–31715. [find](https://scholar.google.com/scholar?q=Shrivastava+D%2C+Larochelle+H%2C+Tarlow+D%2E+Repository%2Dlevel+prompt+generation+for+large+language+models+of+code%2E+In%3A+International+Conference+on+Machine+Learning%3B+2023%2E+p%2E+31693%E2%80%9331715%2E)
240. Shwartz V, West P, Bras RL, Bhagavatula C, Choi Y. Unsupervised commonsense question answering with self-talk; 2020. ArXiv:2004.05483. [find](https://scholar.google.com/scholar?q=Shwartz+V%2C+West+P%2C+Bras+RL%2C+Bhagavatula+C%2C+Choi+Y%2E+Unsupervised+commonsense+question+answering+with+self%2Dtalk%3B+2020%2E+ArXiv%3A2004%2E05483%2E)
241. Uesato J, Kushman N, Kumar R, Song F, Siegel N, Wang L, et al. Solving math word problems with process-and outcome-based feedback; 2022. [ArXiv:2211.14275](https://md.research.elamur.ai/free/en/papers/uesato-2022-solving-math-word-problems-process/).
242. Roy S, Roth D. [Solving general arithmetic word problems](https://md.research.elamur.ai/free/en/papers/roy-2015-solving-general-arithmetic-word-problems/). In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing; 2015. p. 1743–1752.
243. Li Y, Lin Z, Zhang S, Fu Q, Chen B, Lou JG, et al. [Making language models better reasoners with step-aware verifier](https://md.research.elamur.ai/free/en/papers/li-2023-making-language-models-better-reasoners/). In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Toronto, Canada: Association for Computational Linguistics; 2023.…
244. Ding B, Qin C, Liu L, Bing L, Joty S, Li B. [Is GPT-3 a good data annotator?](https://md.research.elamur.ai/free/en/papers/ding-2022-gpt-3-good-data-annotator/); 2022. ArXiv:2212.10450.
245. Yoo KM, Park D, Kang J, Lee SW, Park W. [GPT3Mix: leveraging large-scale language models for text augmentation](https://md.research.elamur.ai/free/en/papers/yoo-2021-gpt3mix-leveraging-large-scale-language/). In: Findings of the Association for Computational Linguistics: EMNLP 2021; 2021. p. 2225–2239.
246. Liu Y, Deng G, Xu Z, Li Y, Zheng Y, Zhang Y, et al. [Jailbreaking ChatGPT via prompt engineering: an empirical study](https://md.research.elamur.ai/free/en/papers/liu-2023-jailbreaking-chatgpt-prompt-engineering-empirical/); 2024. ArXiv:2305.13860.
247. Yao Y, Duan J, Xu K, Cai Y, Sun Z, Zhang Y. [A survey on Large Language Model (LLM) security and privacy: the good, the bad, and the ugly](https://md.research.elamur.ai/free/en/papers/yao-2023-survey-large-language-model-llm/). High-Confidence Computing. 2024 jun;4(2):100211.
248. Rawat P.: AI at risk: OWASP top 10 critical vulnerabilities for large language models (LLMs). Available from: [https://www.infosectrain.com/blog/](https://www.infosectrain.com/blog/) ai-at-risk-owasp-top-10-critical-vulnerabilities-for-large-language-models-llms/. [↗](https://www.infosectrain.com/blog/)
249. Perez F, Ribeiro I. [Ignore previous prompt: attack techniques for language models](https://md.research.elamur.ai/free/en/papers/perez-2022-ignore-previous-prompt-attack-techniques/); 2022. ArXiv:2211.09527.
250. Ren K, Zheng T, Qin Z, Liu X. Adversarial attacks and defenses in deep learning. Engineering. 2020;6(3):346–360. [find](https://scholar.google.com/scholar?q=Ren+K%2C+Zheng+T%2C+Qin+Z%2C+Liu+X%2E+Adversarial+attacks+and+defenses+in+deep+learning%2E+Engineering%2E+2020%3B6%283%29%3A346%E2%80%93360%2E)
251. Yin Z, Ye M, Zhang T, Du T, Zhu J, Liu H, et al. VLATTACK: multimodal adversarial attacks on vision-language tasks via pre-trained models; 2024. ArXiv:2310.04655. — [arXiv:2310.04655](https://arxiv.org/abs/2310.04655) [find](https://scholar.google.com/scholar?q=Yin+Z%2C+Ye+M%2C+Zhang+T%2C+Du+T%2C+Zhu+J%2C+Liu+H%2C+et+al%2E+VLATTACK%3A+multimodal+adversarial+attacks+on+vision%2Dlanguage+tasks+via+pre%2Dtrained+models%3B+2024%2E+ArXiv%3A2310%2E04655%2E+%E2%80%94+%5BarXiv%3A2310%2E04655%5D%28https%3A%2F%2Farxiv%2Eor)
252. Goodfellow IJ, Shlens J, Szegedy C. [Explaining and harnessing adversarial examples](https://md.research.elamur.ai/free/en/papers/goodfellow-2014-explaining-harnessing-adversarial-examples/); 2015. ArXiv:1412.6572.
253. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L. ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition; 2009. p. 248–255. [find](https://scholar.google.com/scholar?q=Deng+J%2C+Dong+W%2C+Socher+R%2C+Li+LJ%2C+Li+K%2C+Fei%2DFei+L%2E+ImageNet%3A+a+large%2Dscale+hierarchical+image+database%2E+In%3A+2009+IEEE+Conference+on+Computer+Vision+and+Pattern+Recognition%3B+2009%2E+p%2E+248%E2%80%93255%2E)
254. Wang J, Liu Z, Park KH, Jiang Z, Zheng Z, Wu Z, et al. Adversarial demonstration attacks on large language models; 2023. ArXiv:2305.14950. — [arXiv:2305.14950](https://arxiv.org/abs/2305.14950) [find](https://scholar.google.com/scholar?q=Wang+J%2C+Liu+Z%2C+Park+KH%2C+Jiang+Z%2C+Zheng+Z%2C+Wu+Z%2C+et+al%2E+Adversarial+demonstration+attacks+on+large+language+models%3B+2023%2E+ArXiv%3A2305%2E14950%2E+%E2%80%94+%5BarXiv%3A2305%2E14950%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2305%2E14950%29)
255. Kolter Z.: Discrete optimization for adversarial attacks on large language models. Available from: [https://orc.mit.edu/events/](https://orc.mit.edu/events/) discrete-optimization-adversarial-attacks-large-language-models. [↗](https://orc.mit.edu/events/)
256. Shayegani E, Mamun MAA, Fu Y, Zaree P, Dong Y, Abu-Ghazaleh N. [Survey of vulnerabilities in large language models revealed by adversarial attacks](https://md.research.elamur.ai/free/en/papers/shayegani-2023-survey-vulnerabilities-large-language-models/); 2023. ArXiv:2310.10844.
257. Selvakkumar A, Pal S, Jadidi Z. Addressing adversarial machine learning attacks in smart healthcare perspectives; 2021. ArXiv:2112.08862. — [arXiv:2112.08862](https://arxiv.org/abs/2112.08862) [find](https://scholar.google.com/scholar?q=Selvakkumar+A%2C+Pal+S%2C+Jadidi+Z%2E+Addressing+adversarial+machine+learning+attacks+in+smart+healthcare+perspectives%3B+2021%2E+ArXiv%3A2112%2E08862%2E+%E2%80%94+%5BarXiv%3A2112%2E08862%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2112%2E08862%29)
258. Bagdasaryan E, Veit A, Hua Y, Estrin D, Shmatikov V. How to backdoor federated learning. In: Chiappa S, Calandra R, editors. Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics. vol. 108 of Proceedings of Machine Learning Research. PMLR; 2020. p. 2938–… [find](https://scholar.google.com/scholar?q=Bagdasaryan+E%2C+Veit+A%2C+Hua+Y%2C+Estrin+D%2C+Shmatikov+V%2E+How+to+backdoor+federated+learning%2E+In%3A+Chiappa+S%2C+Calandra+R%2C+editors%2E+Proceedings+of+the+Twenty+Third+International+Conference+on+Artificial+Inte)
259. Steinhardt J, Koh PW, Liang P. Certified defenses for data poisoning attacks; 2017. ArXiv:1706.03691. — [arXiv:1706.03691](https://arxiv.org/abs/1706.03691) [find](https://scholar.google.com/scholar?q=Steinhardt+J%2C+Koh+PW%2C+Liang+P%2E+Certified+defenses+for+data+poisoning+attacks%3B+2017%2E+ArXiv%3A1706%2E03691%2E+%E2%80%94+%5BarXiv%3A1706%2E03691%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1706%2E03691%29)
260. Yang H, Xiang K, Ge M, Li H, Lu R, Yu S. A comprehensive overview of backdoor attacks in large language models within communication networks. IEEE Network. 2024;p. 1–1. [find](https://scholar.google.com/scholar?q=Yang+H%2C+Xiang+K%2C+Ge+M%2C+Li+H%2C+Lu+R%2C+Yu+S%2E+A+comprehensive+overview+of+backdoor+attacks+in+large+language+models+within+communication+networks%2E+IEEE+Network%2E+2024%3Bp%2E+1%E2%80%931%2E)
261. Chen X, Liu C, Li B, Lu K, Song D. Targeted backdoor attacks on deep learning systems using data poisoning; 2017. ArXiv:1712.05526. — [arXiv:1712.05526](https://arxiv.org/abs/1712.05526) [find](https://scholar.google.com/scholar?q=Chen+X%2C+Liu+C%2C+Li+B%2C+Lu+K%2C+Song+D%2E+Targeted+backdoor+attacks+on+deep+learning+systems+using+data+poisoning%3B+2017%2E+ArXiv%3A1712%2E05526%2E+%E2%80%94+%5BarXiv%3A1712%2E05526%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1712%2E05526%29)
262. Shamshiri S, Sohn I. Defense method challenges against backdoor attacks in neural networks. In: 2024 International Conference on Artificial Intelligence in Information and Communication; 2024. p. 396–400. [find](https://scholar.google.com/scholar?q=Shamshiri+S%2C+Sohn+I%2E+Defense+method+challenges+against+backdoor+attacks+in+neural+networks%2E+In%3A+2024+International+Conference+on+Artificial+Intelligence+in+Information+and+Communication%3B+2024%2E+p%2E+396%E2%80%93)
263. Holland R, Pal S, Pan L, Zhang LY. Backdoor attacks and generative model fairness: current trends and future research directions. In: 2024 16th International Conference on COMmunication Systems & NETworkS; 2024. p. 31–36. [find](https://scholar.google.com/scholar?q=Holland+R%2C+Pal+S%2C+Pan+L%2C+Zhang+LY%2E+Backdoor+attacks+and+generative+model+fairness%3A+current+trends+and+future+research+directions%2E+In%3A+2024+16th+International+Conference+on+COMmunication+Systems+%26+NETw)
264. Khan A, Sharma I. AI-powered detection and mitigation of backdoor attacks on databases server. In: 2024 2nd International Conference on Intelligent Data Communication Technologies and Internet of Things; 2024. p. 374–379. [find](https://scholar.google.com/scholar?q=Khan+A%2C+Sharma+I%2E+AI%2Dpowered+detection+and+mitigation+of+backdoor+attacks+on+databases+server%2E+In%3A+2024+2nd+International+Conference+on+Intelligent+Data+Communication+Technologies+and+Internet+of+Thin)
265. Ooi YX. Evaluation of backdoor attacks and defenses to deep neural networks [Master’s thesis]. Nanyang Technological University; 2024. [find](https://scholar.google.com/scholar?q=Ooi+YX%2E+Evaluation+of+backdoor+attacks+and+defenses+to+deep+neural+networks+%5BMaster%E2%80%99s+thesis%5D%2E+Nanyang+Technological+University%3B+2024%2E)
266. Li Y, Li T, Chen K, Zhang J, Liu S, Wang W, et al. BadEdit: backdooring large language models by model editing; 2024. ArXiv:2403.13355. — [arXiv:2403.13355](https://arxiv.org/abs/2403.13355) [find](https://scholar.google.com/scholar?q=Li+Y%2C+Li+T%2C+Chen+K%2C+Zhang+J%2C+Liu+S%2C+Wang+W%2C+et+al%2E+BadEdit%3A+backdooring+large+language+models+by+model+editing%3B+2024%2E+ArXiv%3A2403%2E13355%2E+%E2%80%94+%5BarXiv%3A2403%2E13355%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2403%2E13355%29)
267. Gu T, Dolan-Gavitt B, Garg S. BadNets: identifying vulnerabilities in the machine learning model supply chain; 2019. ArXiv:1708.06733. [find](https://scholar.google.com/scholar?q=Gu+T%2C+Dolan%2DGavitt+B%2C+Garg+S%2E+BadNets%3A+identifying+vulnerabilities+in+the+machine+learning+model+supply+chain%3B+2019%2E+ArXiv%3A1708%2E06733%2E)
268. Liu Y, Ma X, Bailey J, Lu F. Reflection backdoor: a natural backdoor attack on deep neural networks. In: Computer Vision – ECCV 2020. Berlin, Heidelberg: Springer-Verlag; 2020. p. 182–199. [find](https://scholar.google.com/scholar?q=Liu+Y%2C+Ma+X%2C+Bailey+J%2C+Lu+F%2E+Reflection+backdoor%3A+a+natural+backdoor+attack+on+deep+neural+networks%2E+In%3A+Computer+Vision+%E2%80%93+ECCV+2020%2E+Berlin%2C+Heidelberg%3A+Springer%2DVerlag%3B+2020%2E+p%2E+182%E2%80%93199%2E)
269. Zhao S, Wen J, Luu A, Zhao J, Fu J. Prompt as triggers for backdoor attack: examining the vulnerability in language models. In: Bouamor H, Pino J, Bali K, editors. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. Singapore: Association for Computational Linguis… [find](https://scholar.google.com/scholar?q=Zhao+S%2C+Wen+J%2C+Luu+A%2C+Zhao+J%2C+Fu+J%2E+Prompt+as+triggers+for+backdoor+attack%3A+examining+the+vulnerability+in+language+models%2E+In%3A+Bouamor+H%2C+Pino+J%2C+Bali+K%2C+editors%2E+Proceedings+of+the+2023+Conference+o)
270. Chow KH, Wei W, Yu L. Imperio: language-guided backdoor attacks for arbitrary model control; 2024. ArXiv:2401.01085. — [arXiv:2401.01085](https://arxiv.org/abs/2401.01085) [find](https://scholar.google.com/scholar?q=Chow+KH%2C+Wei+W%2C+Yu+L%2E+Imperio%3A+language%2Dguided+backdoor+attacks+for+arbitrary+model+control%3B+2024%2E+ArXiv%3A2401%2E01085%2E+%E2%80%94+%5BarXiv%3A2401%2E01085%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2401%2E01085%29)
271. Abdali S, Anarfi R, Barberan C, He J. Securing large language models: threats, vulnerabilities and responsible practices; 2024. ArXiv:2403.12503. — [arXiv:2403.12503](https://arxiv.org/abs/2403.12503) [find](https://scholar.google.com/scholar?q=Abdali+S%2C+Anarfi+R%2C+Barberan+C%2C+He+J%2E+Securing+large+language+models%3A+threats%2C+vulnerabilities+and+responsible+practices%3B+2024%2E+ArXiv%3A2403%2E12503%2E+%E2%80%94+%5BarXiv%3A2403%2E12503%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2403%2E12503%29)
272. Kosch T, Feger S. Risk or chance? Large language models and reproducibility in human-computer interaction research; 2024. ArXiv:2404.15782. — [arXiv:2404.15782](https://arxiv.org/abs/2404.15782) [find](https://scholar.google.com/scholar?q=Kosch+T%2C+Feger+S%2E+Risk+or+chance%3F+Large+language+models+and+reproducibility+in+human%2Dcomputer+interaction+research%3B+2024%2E+ArXiv%3A2404%2E15782%2E+%E2%80%94+%5BarXiv%3A2404%2E15782%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2404%2E15782%29)
273. Liu FW, Hu C. Exploring vulnerabilities and protections in [large language models: a survey](https://md.research.elamur.ai/free/en/papers/minaee-2024-large-language-models-survey/); 2024. ArXiv:2406.00240. — [arXiv:2406.00240](https://arxiv.org/abs/2406.00240)
274. Zhan Q, Liang Z, Ying Z, Kang D. [InjecAgent: benchmarking indirect prompt injections in tool-integrated large language model agents](https://md.research.elamur.ai/free/en/papers/zhan-2024-injecagent-benchmarking-indirect-prompt-injections/); 2024. ArXiv:2403.02691.
275. Chen K, Wang Z, Mi B, Liu W, Wang S, Ren X, et al. Machine unlearning in large language models; 2024. ArXiv:2404.16481. — [arXiv:2404.16481](https://arxiv.org/abs/2404.16481) [find](https://scholar.google.com/scholar?q=Chen+K%2C+Wang+Z%2C+Mi+B%2C+Liu+W%2C+Wang+S%2C+Ren+X%2C+et+al%2E+Machine+unlearning+in+large+language+models%3B+2024%2E+ArXiv%3A2404%2E16481%2E+%E2%80%94+%5BarXiv%3A2404%2E16481%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2404%2E16481%29)
276. Wang H, Li H, Huang M, Sha L. From noise to clarity: unraveling the adversarial suffix of large language model attacks via translation of text embeddings; 2024. ArXiv:2402.16006. — [arXiv:2402.16006](https://arxiv.org/abs/2402.16006) [find](https://scholar.google.com/scholar?q=Wang+H%2C+Li+H%2C+Huang+M%2C+Sha+L%2E+From+noise+to+clarity%3A+unraveling+the+adversarial+suffix+of+large+language+model+attacks+via+translation+of+text+embeddings%3B+2024%2E+ArXiv%3A2402%2E16006%2E+%E2%80%94+%5BarXiv%3A2402%2E16006%5D%28)
277. Gao A. Prompt engineering for large language models; 2023. SSRN:4504303. [find](https://scholar.google.com/scholar?q=Gao+A%2E+Prompt+engineering+for+large+language+models%3B+2023%2E+SSRN%3A4504303%2E)
278. Learn prompting.: Introduction to prompt hacking. Available from: [https://learnprompting.org/docs/prompt](https://learnprompting.org/docs/prompt) hacking/intro. [↗](https://learnprompting.org/docs/prompt)
279. Schulhoff S, Pinto J, Khan A, Bouchard LF, Si C, Anati S, et al. Ignore this title and HackAPrompt: exposing systemic vulnerabilities of LLMs through a global prompt hacking competition. In: Bouamor H, Pino J, Bali K, editors. Proceedings of the 2023 Conference on Empirical Methods in Natural Langua… [find](https://scholar.google.com/scholar?q=Schulhoff+S%2C+Pinto+J%2C+Khan+A%2C+Bouchard+LF%2C+Si+C%2C+Anati+S%2C+et+al%2E+Ignore+this+title+and+HackAPrompt%3A+exposing+systemic+vulnerabilities+of+LLMs+through+a+global+prompt+hacking+competition%2E+In%3A+Bouamor+H)
280. Allouin A.: Understanding LLM prompt hacking and attacks. Available from: [https://medium.com/@alexandre.allouin/](https://medium.com/@alexandre.allouin/) understanding-llm-prompt-hacking-and-attacks-8781c313a25b. [↗](https://medium.com/@alexandre.allouin/)
281. Karande C.: OWASP LLM prompt hacking. Available from: [https://owasp.org/](https://owasp.org/) www-project-llm-prompt-hacking/. [↗](https://owasp.org/)
282. Teneo AI.: Navigating the challenges of prompt hacking in 2024. Available from: [https://www.teneo.ai/blog/](https://www.teneo.ai/blog/) navigating-the-challenges-of-prompt-hacking-in-2024. [↗](https://www.teneo.ai/blog/)
283. Krishna K, Tomar GS, Parikh AP, Papernot N, Iyyer M. Thieves on sesame street! Model extraction of BERT-based APIs. In: Ninth International Conference on Learning Representations; 2020. . [find](https://scholar.google.com/scholar?q=Krishna+K%2C+Tomar+GS%2C+Parikh+AP%2C+Papernot+N%2C+Iyyer+M%2E+Thieves+on+sesame+street%21+Model+extraction+of+BERT%2Dbased+APIs%2E+In%3A+Ninth+International+Conference+on+Learning+Representations%3B+2020%2E+%2E)
284. Papernot N, McDaniel P, Sinha A, Wellman MP. SoK: security and privacy in machine learning. In: 2018 IEEE European Symposium on Security and Privacy (EuroS&P); 2018. p. 399–414. [find](https://scholar.google.com/scholar?q=Papernot+N%2C+McDaniel+P%2C+Sinha+A%2C+Wellman+MP%2E+SoK%3A+security+and+privacy+in+machine+learning%2E+In%3A+2018+IEEE+European+Symposium+on+Security+and+Privacy+%28EuroS%26P%29%3B+2018%2E+p%2E+399%E2%80%93414%2E)
285. Tramèr F, Zhang F, Juels A, Reiter MK, Ristenpart T. Stealing machine learning models via prediction APIs. In: Proceedings of the 25th USENIX Conference on Security Symposium. SEC’16. USA: USENIX Association; 2016. p. 601–618. [find](https://scholar.google.com/scholar?q=Trame%CC%80r+F%2C+Zhang+F%2C+Juels+A%2C+Reiter+MK%2C+Ristenpart+T%2E+Stealing+machine+learning+models+via+prediction+APIs%2E+In%3A+Proceedings+of+the+25th+USENIX+Conference+on+Security+Symposium%2E+SEC%E2%80%9916%2E+USA%3A+USENIX+Ass)
286. Shen X, Qu Y, Backes M, Zhang Y. Prompt stealing attacks against text-to-image generation models; 2023. ArXiv:2302.09923. — [arXiv:2302.09923](https://arxiv.org/abs/2302.09923) [find](https://scholar.google.com/scholar?q=Shen+X%2C+Qu+Y%2C+Backes+M%2C+Zhang+Y%2E+Prompt+stealing+attacks+against+text%2Dto%2Dimage+generation+models%3B+2023%2E+ArXiv%3A2302%2E09923%2E+%E2%80%94+%5BarXiv%3A2302%2E09923%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2302%2E09923%29)
287. Zhang S. Defending against model extraction attacks via watermark-based method with knowledge distillation [Master’s thesis]. Nanyang Technological University; 2024. [find](https://scholar.google.com/scholar?q=Zhang+S%2E+Defending+against+model+extraction+attacks+via+watermark%2Dbased+method+with+knowledge+distillation+%5BMaster%E2%80%99s+thesis%5D%2E+Nanyang+Technological+University%3B+2024%2E)
288. Naseh A, Krishna K, Iyyer M, Houmansadr A. Stealing the decoding algorithms of language models. In: Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security. CCS ’23. New York, NY, USA: Association for Computing Machinery; 2023. p. 1835–1849. [find](https://scholar.google.com/scholar?q=Naseh+A%2C+Krishna+K%2C+Iyyer+M%2C+Houmansadr+A%2E+Stealing+the+decoding+algorithms+of+language+models%2E+In%3A+Proceedings+of+the+2023+ACM+SIGSAC+Conference+on+Computer+and+Communications+Security%2E+CCS+%E2%80%9923%2E+New+)
289. Carlini N, Paleka D, Dvijotham KD, Steinke T, Hayase J, Cooper AF, et al. Stealing part of a production language model; 2024. ArXiv:2403.06634. — [arXiv:2403.06634](https://arxiv.org/abs/2403.06634) [find](https://scholar.google.com/scholar?q=Carlini+N%2C+Paleka+D%2C+Dvijotham+KD%2C+Steinke+T%2C+Hayase+J%2C+Cooper+AF%2C+et+al%2E+Stealing+part+of+a+production+language+model%3B+2024%2E+ArXiv%3A2403%2E06634%2E+%E2%80%94+%5BarXiv%3A2403%2E06634%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2403%2E06634%29)
290. Sha Z, Zhang Y. Prompt stealing attacks against large language models; 2024. ArXiv:2402.12959. — [arXiv:2402.12959](https://arxiv.org/abs/2402.12959) [find](https://scholar.google.com/scholar?q=Sha+Z%2C+Zhang+Y%2E+Prompt+stealing+attacks+against+large+language+models%3B+2024%2E+ArXiv%3A2402%2E12959%2E+%E2%80%94+%5BarXiv%3A2402%2E12959%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2402%2E12959%29)
291. Yang Y, Li C, Jiang Y, Chen X, Wang H, Zhang X, et al. PRSA: PRompt Stealing Attacks against large language models; 2024. ArXiv:2402.19200. — [arXiv:2402.19200](https://arxiv.org/abs/2402.19200) [find](https://scholar.google.com/scholar?q=Yang+Y%2C+Li+C%2C+Jiang+Y%2C+Chen+X%2C+Wang+H%2C+Zhang+X%2C+et+al%2E+PRSA%3A+PRompt+Stealing+Attacks+against+large+language+models%3B+2024%2E+ArXiv%3A2402%2E19200%2E+%E2%80%94+%5BarXiv%3A2402%2E19200%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2402%2E19200%29)
292. Hu H, Salcic Z, Sun L, Dobbie G, Yu PS, Zhang X. Membership inference attacks on machine learning: a survey; 2022. ArXiv:2103.07853. — [arXiv:2103.07853](https://arxiv.org/abs/2103.07853) [find](https://scholar.google.com/scholar?q=Hu+H%2C+Salcic+Z%2C+Sun+L%2C+Dobbie+G%2C+Yu+PS%2C+Zhang+X%2E+Membership+inference+attacks+on+machine+learning%3A+a+survey%3B+2022%2E+ArXiv%3A2103%2E07853%2E+%E2%80%94+%5BarXiv%3A2103%2E07853%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2103%2E07853%29)
293. Kurakin A, Goodfellow I, Bengio S. Adversarial machine learning at scale; 2017. ArXiv:1611.01236. — [arXiv:1611.01236](https://arxiv.org/abs/1611.01236) [find](https://scholar.google.com/scholar?q=Kurakin+A%2C+Goodfellow+I%2C+Bengio+S%2E+Adversarial+machine+learning+at+scale%3B+2017%2E+ArXiv%3A1611%2E01236%2E+%E2%80%94+%5BarXiv%3A1611%2E01236%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1611%2E01236%29)
294. Bai T, Luo J, Zhao J, Wen B, Wang Q. Recent advances in adversarial training for adversarial robustness. In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization; 2021. p. 4312–4321. Survey Tra… [find](https://scholar.google.com/scholar?q=Bai+T%2C+Luo+J%2C+Zhao+J%2C+Wen+B%2C+Wang+Q%2E+Recent+advances+in+adversarial+training+for+adversarial+robustness%2E+In%3A+Proceedings+of+the+Thirtieth+International+Joint+Conference+on+Artificial+Intelligence%2E+Int)
295. Eric M.: A complete introduction to prompt engineering for large language models. Available from: [https://www.mihaileric.com/posts/](https://www.mihaileric.com/posts/) a-complete-introduction-to-prompt-engineering/. [↗](https://www.mihaileric.com/posts/)
296. Linardatos P, Papastefanopoulos V, Kotsiantis S. Explainable AI: a review of machine learning interpretability methods. Entropy. 2020;23(1):18. [find](https://scholar.google.com/scholar?q=Linardatos+P%2C+Papastefanopoulos+V%2C+Kotsiantis+S%2E+Explainable+AI%3A+a+review+of+machine+learning+interpretability+methods%2E+Entropy%2E+2020%3B23%281%29%3A18%2E)
297. Recht B, Re C, Wright S, Niu F. Hogwild!: a lock-free approach to parallelizing stochastic gradient descent. In: Advances in neural information processing systems. vol. 24; 2011. . [find](https://scholar.google.com/scholar?q=Recht+B%2C+Re+C%2C+Wright+S%2C+Niu+F%2E+Hogwild%21%3A+a+lock%2Dfree+approach+to+parallelizing+stochastic+gradient+descent%2E+In%3A+Advances+in+neural+information+processing+systems%2E+vol%2E+24%3B+2011%2E+%2E)
298. Melnychuk V, Frauen D, Feuerriegel S. Causal transformer for estimating counterfactual outcomes. In: International Conference on Machine Learning; 2022. p. 15293–15329. [find](https://scholar.google.com/scholar?q=Melnychuk+V%2C+Frauen+D%2C+Feuerriegel+S%2E+Causal+transformer+for+estimating+counterfactual+outcomes%2E+In%3A+International+Conference+on+Machine+Learning%3B+2022%2E+p%2E+15293%E2%80%9315329%2E)
299. Novakovsky G, Dexter N, Libbrecht MW, Wasserman WW, Mostafavi S. Obtaining genetics insights from deep learning via explainable artificial intelligence. Nature Reviews Genetics. 2023;24(2):125–137. [find](https://scholar.google.com/scholar?q=Novakovsky+G%2C+Dexter+N%2C+Libbrecht+MW%2C+Wasserman+WW%2C+Mostafavi+S%2E+Obtaining+genetics+insights+from+deep+learning+via+explainable+artificial+intelligence%2E+Nature+Reviews+Genetics%2E+2023%3B24%282%29%3A125%E2%80%93137%2E)
300. Bertucci L, Brière M, Fliche O, Mikael J, Szpruch L. Deep learning in finance: from implementation to regulation; 2022. SSRN:4080171. [find](https://scholar.google.com/scholar?q=Bertucci+L%2C+Brie%CC%80re+M%2C+Fliche+O%2C+Mikael+J%2C+Szpruch+L%2E+Deep+learning+in+finance%3A+from+implementation+to+regulation%3B+2022%2E+SSRN%3A4080171%2E)
301. Maple C, Szpruch L, Epiphaniou G, Staykova K, Singh S, Penwarden W, et al. The AI revolution: opportunities and challenges for the finance sector; 2023. ArXiv:2308.16538. — [arXiv:2308.16538](https://arxiv.org/abs/2308.16538) [find](https://scholar.google.com/scholar?q=Maple+C%2C+Szpruch+L%2C+Epiphaniou+G%2C+Staykova+K%2C+Singh+S%2C+Penwarden+W%2C+et+al%2E+The+AI+revolution%3A+opportunities+and+challenges+for+the+finance+sector%3B+2023%2E+ArXiv%3A2308%2E16538%2E+%E2%80%94+%5BarXiv%3A2308%2E16538%5D%28https%3A%2F%2F)
302. Amann J, Blasimme A, Vayena E, Frey D, Madai VI. Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Medical Informatics and Decision Making. 2020;20(1):1–9. [find](https://scholar.google.com/scholar?q=Amann+J%2C+Blasimme+A%2C+Vayena+E%2C+Frey+D%2C+Madai+VI%2E+Explainability+for+artificial+intelligence+in+healthcare%3A+a+multidisciplinary+perspective%2E+BMC+Medical+Informatics+and+Decision+Making%2E+2020%3B20%281%29%3A1%E2%80%939%2E)
303. Rajpurkar P, Chen E, Banerjee O, Topol EJ. AI in health and medicine. Nature Medicine. 2022;28(1):31–38. [find](https://scholar.google.com/scholar?q=Rajpurkar+P%2C+Chen+E%2C+Banerjee+O%2C+Topol+EJ%2E+AI+in+health+and+medicine%2E+Nature+Medicine%2E+2022%3B28%281%29%3A31%E2%80%9338%2E)
304. Öztürk D. What does artificial intelligence mean for organizations? A systematic review of organization studies research and a way forward. The Impact of Artificial Intelligence on Governance, Economics and Finance, Volume I. 2021;p. 265–289. [find](https://scholar.google.com/scholar?q=O%CC%88ztu%CC%88rk+D%2E+What+does+artificial+intelligence+mean+for+organizations%3F+A+systematic+review+of+organization+studies+research+and+a+way+forward%2E+The+Impact+of+Artificial+Intelligence+on+Governance%2C+Econo)
305. Seeamber R, Badea C. If our aim is to build morality into an artificial agent, how might we begin to go about doing so? IEEE Intelligent Systems. 2023;. [find](https://scholar.google.com/scholar?q=Seeamber+R%2C+Badea+C%2E+If+our+aim+is+to+build+morality+into+an+artificial+agent%2C+how+might+we+begin+to+go+about+doing+so%3F+IEEE+Intelligent+Systems%2E+2023%3B%2E)

*Updated 24 October 2026*