--- title: "Who cites When Does Pretraining Help? — 121 citing papers" description: "121 papers of the Elamur Research library cite «When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the…" canonical: "https://research.elamur.ai/free/en/papers/zheng-2021-pretraining-help-assessing-self-supervised/cited-by/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zheng-2021-pretraining-help-assessing-self-supervised/cited-by/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [When Does Pretraining Help? Assessing…](https://md.research.elamur.ai/free/en/papers/zheng-2021-pretraining-help-assessing-self-supervised/) / cited by # Who cites «When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset» 121 papers of our library cite it (of the 149,439 whose bibliographies we read) · 23 with a page here, the most cited first · [← back to «When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset»](https://md.research.elamur.ai/free/en/papers/zheng-2021-pretraining-help-assessing-self-supervised/) 1. [**On the Opportunities and Risks of Foundation Models arXiv:2108.07258**Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.*2021 · 3,160 citations*](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/) 2. [**LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models arXiv:2308.11462**Neel Guha; Julian Nyarko; Daniel E. Ho; Christopher Re; Adam Chilton; Aditya Narayana; Alex Chohlas-Wood; Austin Peters; Brandon Waldon; Daniel N. Rockmore; Diego Zambrano; Dmitry Talisman; Enam Hoque; Faiz Surani; Frank Fagan; Galit Sarfaty; Gregory M. Dickinson; Haggai Porat; Jason Hegland; Jessica Wu; Joe Nudell; Joel Niklaus; John Nay; Jonathan H. Choi; Kevin Tobia; Margaret Hagan; Megan Ma; Michael Livermore; Nikon Rasumov-Rahe; Nils Holzenberger; Noam Kolt; Peter Henderson; Sean Rehaag; Sharad Goel; Shang Gao; Spencer Williams; Sunny Gandhi; Tom Zur; Varun Iyer;, Zehua Li*2023 · 389 citations*](https://md.research.elamur.ai/free/en/papers/guha-2023-legalbench-collaboratively-built-benchmark-measuring/) 3. [**Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools arXiv:2405.20362**Varun Magesh, Faiz Surani, Matthew Dahl, et al.*2024 · 271 citations*](https://md.research.elamur.ai/free/en/papers/magesh-2024-hallucination-free-assessing-reliability-leading/) 4. [**LexGLUE: A Benchmark Dataset for Legal Language Understanding in English arXiv:2110.00976**Ilias Chalkidis; Abhik Jana; Dirk Hartung; Michael Bommarito; Ion Androutsopoulos; Daniel Martin Katz;, Nikolaos Aletras*2021 · 258 citations*](https://md.research.elamur.ai/free/en/papers/chalkidis-2021-lexglue-benchmark-dataset-legal-language/) 5. [**FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance arXiv:2305.05176**Lingjiao Chen, Matei Zaharia, James Zou*2023 · 241 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-frugalgpt-use-large-language-models/) 6. **[LexGLUE: A Benchmark Dataset for Legal Language Understanding in English](https://md.research.elamur.ai/free/en/papers/chalkidis-2022-lexglue-benchmark-dataset-legal-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Ilias Chalkidis, Abhik Jana, Dirk Hartung, et al.*2022 · 239 citations* 7. **[ContractNLI: A Dataset for Document-level Natural Language Inference for Contracts](https://md.research.elamur.ai/free/en/papers/koreeda-2021-contractnli-dataset-document-level-natural/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yuta Koreeda, Christopher Manning*2021 · 177 citations* 8. [**Lawyer LLaMA Technical Report arXiv:2305.15062**Quzhe Huang, Mingxu Tao, Chen Zhang, et al.*2023 · 157 citations*](https://md.research.elamur.ai/free/en/papers/huang-2023-lawyer-llama-technical-report/) 9. **[Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset](https://md.research.elamur.ai/free/en/papers/henderson-2022-pile-law-learning-responsible-data/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Peter Henderson, Mark S. Krass, Lucia Zheng, et al.*2022 · 133 citations* 10. [**Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback arXiv:2303.05453**Hannah Rose Kirk, Bertie Vidgen, Paul Rottger, et al.*2023 · 57 citations*](https://md.research.elamur.ai/free/en/papers/kirk-2023-personalisation-within-bounds-risk-taxonomy/) 11. [**A Reasoning-Focused Legal Retrieval Benchmark arXiv:2505.03970**Lucia Zheng, Neel Guha, Javokhir Arifov, et al.*2025 · 55 citations*](https://md.research.elamur.ai/free/en/papers/zheng-2025-reasoning-focused-legal-retrieval-benchmark/) 12. **[Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs?](https://md.research.elamur.ai/free/en/papers/li-2024-can-multiple-choice-questions-really/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Wangyue Li, Liangzhi Li, Tong Xiang, et al.*2024 · 47 citations* 13. [**One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Support arXiv:2306.09237**Ronja Stern, Vishvaksenan Rasiah, Veton Matoshi, et al.*2023 · 29 citations*](https://md.research.elamur.ai/free/en/papers/stern-2023-one-law-many-languages-benchmarking/) 14. **[Revisiting Epistemic Markers in Confidence Estimation: Can Markers Accurately Reflect Large Language Models' Uncertainty?](https://md.research.elamur.ai/free/en/papers/liu-2025-revisiting-epistemic-markers-confidence-estimation/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Jiayu Liu, Qing Zong, Weiqi Wang, et al.*2025 · 8 citations* 15. **[OpenExempt: A Diagnostic Benchmark for Legal Reasoning and a Framework for Creating Custom Benchmarks on Demand](https://md.research.elamur.ai/free/en/papers/servantez-2026-openexempt-diagnostic-benchmark-legal-reasoning/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Sergio Servantez, Sarah B. Lawsky, Rajiv Jain, et al.*2026 · 2 citations* 16. **[Sycophants in the Courtroom: Are LLMs Fragile to Juridical Authority and Evolving Legal Standards?](https://md.research.elamur.ai/free/en/papers/molfetta-2026-sycophants-courtroom-are-llms-fragile/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Lorenzo Molfetta, Alessio Cocchieri, Luca Ragazzi, et al.*2026 · 2 citations* 17. **[CuriosAI at SemEval-2026 Task 4: A Comprehensive Study of Zero-Shot versus Fine-Tuned Approaches for Narrative Similarity](https://md.research.elamur.ai/free/en/papers/shibata-2026-curiosai-semeval-2026-task-4/) [International Workshop on Semantic Evaluation (SemEval)](https://md.research.elamur.ai/free/en/venues/semeval/)**Yuki Shibata, Hiroki Takushima, Fumika Beppu, et al.*2026 · 1 citation* 18. **[AYN: A Tiny Yet Competitive Indian Legal Language Model Pretrained from Scratch](https://md.research.elamur.ai/free/en/papers/niyogi-2026-ayn-tiny-yet-competitive-indian/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Mitodru Niyogi, Eric Gaussier, Arnab Bhattacharya*2026* 19. **[Compressing Language Models for Specialized Domains](https://md.research.elamur.ai/free/en/papers/williams-2026-compressing-language-models-specialized-domains/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Miles Williams, George Chrysostomou, Vitor Amancio Jeronymo, et al.*2026* 20. **[LLMs for Now, Fine-Tuning for Later: An Ensemble Approach to Data Drift in Domain-Specific Tasks](https://md.research.elamur.ai/free/en/papers/lu-2026-llms-now-fine-tuning-later/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yuxuan Lu, Bingsheng Yao, Shao Zhang, et al.*2026* 21. **[Mitigating Structural Knowledge Collapse in Domain-Specific LLMs via Morpheme-Aware KV-Aggregation](https://md.research.elamur.ai/free/en/papers/si-2026-mitigating-structural-knowledge-collapse-domain/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yuxuan Si, Zheqi Lv, Chengxi Zang, et al.*2026* 22. **[Pub-LawBench: Public-Oriented Benchmarking for LegalAI](https://md.research.elamur.ai/free/en/papers/zheng-2026-pub-lawbench-public-oriented-benchmarking/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Qiaoyu Zheng, Zehan Ma, Yijing Zhang, et al.*2026* 23. **[RADO: Reasoning Audit-Driven Optimization for Rigorous Reasoning in High-Stakes Domains](https://md.research.elamur.ai/free/en/papers/tan-2026-rado-reasoning-audit-driven-optimization/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Zhijie Tan, Xu Chu, Guanyu Wang, et al.*2026* 98 more papers of our library cite it; they have no page here yet. - [← back to](https://md.research.elamur.ai/free/en/papers/zheng-2021-pretraining-help-assessing-self-supervised/) — When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset