---
title: "Automated Analysis of Global AI Safety Initiatives: A"
description: "The authors, from the Japan AI Safety Institute, propose an automated, LLM-driven crosswalk that compares two documents… 25 references."
authors: ["Takayuki Semitsu", "Naoto Kiribuchi", "Kengo Zenitani"]
year: 2026
venue: "Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026)"
source: "https://aclanthology.org/2026.politicalnlp-1.30/"
doi: "10.63317/4yuq3ezxohee"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/semitsu-2026-automated-analysis-global-ai-safety/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/semitsu-2026-automated-analysis-global-ai-safety/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/10/) / Automated Analysis of Global AI Safety Initiatives: A Taxonomy-Driven LLM Approach

# Automated Analysis of Global AI Safety Initiatives: A Taxonomy-Driven LLM Approach

**Authors:** Takayuki Semitsu, Naoto Kiribuchi and Kengo Zenitani · **Year:** 2026 · **Venue:** [Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026)](https://md.research.elamur.ai/free/en/venues/politicalnlp/) ([Workshop on Natural Language Processing for Political Sciences 2026](https://md.research.elamur.ai/free/en/venues/politicalnlp/2026/)) · **Publisher:** [European Language Resources Association (ELRA)](https://md.research.elamur.ai/free/en/publishers/european-language-resources-association-elra/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.politicalnlp-1.30/) · [PDF](https://aclanthology.org/2026.politicalnlp-1.30.pdf) · [DOI 10.63317/4yuq3ezxohee](https://doi.org/10.63317/4yuq3ezxohee) · [OpenAlex](https://openalex.org/W7166509811)

**Citations:** 1 citations (OpenAlex, 2026-10-14)

## Summary

AI safety policy documents from governments, international bodies and standards organizations differ widely in structure, vocabulary and granularity, and existing crosswalks usually rely on one-off comparison axes. The authors, from the Japan AI Safety Institute, propose an automated, LLM-driven crosswalk that compares two documents along a fixed, reusable taxonomy: the 15 activity categories of the Activity Map on AI Safety (AMAIS). AMAIS is grounded in the Hiroshima AI Process and the Seoul Declaration.

For each category, the system extracts and maps activities from both documents. It then writes a short summary for each side, describes their commonalities and differences, and assigns a 0–5 similarity score.

The framework was applied to ten public documents, using five LLMs and Japanese prompts and outputs. Stability across models was analysed through mean, standard-deviation and model-pair MAD heatmaps, and validity was checked against expert judgments. The results show that model choice strongly shapes the outcomes, and some document pairs provoke large cross-model disagreement. Experts agreed closely with one another but diverged from model scores. The tool is meant to support inspection of policy documents, not to rank them.

## Key points

- **Shared taxonomy:** the aspect set is AMAIS activities p1–p15, for example Content Authentication and Provenance, AI Safety Evaluation and Red-Teaming, and International Coordination and Cooperation.
- **Data:** ten documents (A–J) form nine pairs, each anchored on Document A, the UK AISI "Our Research Agenda."
- **Pipeline:** activity extraction and mapping were precomputed with ChatGPT-5.2 and held fixed. Five LLMs then generated comparisons under identical prompts and temperature.
- **Scoring:** the six-level scale runs from 0 (mostly different) to 5 (nearly identical). A score of 0 is forced when either document has no item mapped to a category. Outputs are strict JSON with evidence excerpts, page numbers and confidence values.
- **Validation:** three experts annotated two document pairs, showing high inter-annotator agreement but a notable gap from LLM-assigned scores.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 1,954 works · [🤝 Safety Research](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · 626 works · [🤝 Political Science and International Relations](https://md.research.elamur.ai/free/en/shelves/social-sciences/political-science-and-international-relations/) · 206 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works · [🛡️ Bias, fairness & safety](https://md.research.elamur.ai/free/en/topics/bias-fairness-safety/) · 587 works

## Cite

Cite as: Takayuki Semitsu, Naoto Kiribuchi and Kengo Zenitani. 2026. Automated Analysis of Global AI Safety Initiatives: A Taxonomy-Driven LLM Approach. Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{semitsu2026automated,
  title = {{Automated Analysis of Global AI Safety Initiatives: A Taxonomy-Driven LLM Approach}},
  author = {Takayuki Semitsu, Naoto Kiribuchi and Kengo Zenitani},
  booktitle = {Proceedings of the 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026)},
  year = {2026},
  doi = {10.63317/4yuq3ezxohee},
  url = {https://doi.org/10.63317/4yuq3ezxohee}
}
```

- [← previous Audience Engagement with Arabic Women's Social Empowerment and Wellbeing: A Decadal Corpus](https://md.research.elamur.ai/free/en/papers/zaghouani-2026-audience-engagement-arabic-women-s/)
- [next → Automated Creativity Evaluation of Language Models Across Open-Ended Tasks](https://md.research.elamur.ai/free/en/papers/sen-2026-automated-creativity-evaluation-language-models/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/10/)

## References

25 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. ASEAN. 2024. Asean guide on ai governance and ethics. PDF. [find](https://scholar.google.com/scholar?q=ASEAN%2E+2024%2E+Asean+guide+on+ai+governance+and+ethics%2E+PDF%2E)
2. Blair Attard-Frost, Ana Brandusescu, and Kelly Lyons. 2024. The governance of artificial intelligence in canada: Findings and opportunities from a review of 84 ai governance initiatives. Government Information Quarterly, 41(2):101929. [find](https://scholar.google.com/scholar?q=Blair+Attard%2DFrost%2C+Ana+Brandusescu%2C+and+Kelly+Lyons%2E+2024%2E+The+governance+of+artificial+intelligence+in+canada%3A+Findings+and+opportunities+from+a+review+of+84+ai+governance+initiatives%2E+Government+In)
3. Amna Batool, Sunny Lee, Yue Liu, and Liming Dong. 2025. The anatomy of AI policies: a systematic comparative analysis of AI policies across the globe. AI and Ethics. [find](https://scholar.google.com/scholar?q=Amna+Batool%2C+Sunny+Lee%2C+Yue+Liu%2C+and+Liming+Dong%2E+2025%2E+The+anatomy+of+AI+policies%3A+a+systematic+comparative+analysis+of+AI+policies+across+the+globe%2E+AI+and+Ethics%2E)
4. Catarina G Belém, Pouya Pezeshkpour, Hayate Iso, Seiji Maekawa, Nikita Bhutani, and Estevam Hruschka. 2025. From single to multi: How LLMs hallucinate in multi-document summarization. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 5291–5324, Albuquerque, New Mexico.… [find](https://scholar.google.com/scholar?q=Catarina+G+Bel%C3%A9m%2C+Pouya+Pezeshkpour%2C+Hayate+Iso%2C+Seiji+Maekawa%2C+Nikita+Bhutani%2C+and+Estevam+Hruschka%2E+2025%2E+From+single+to+multi%3A+How+LLMs+hallucinate+in+multi%2Ddocument+summarization%2E+In+Findings+of+t)
5. Yoshua Bengio, Tegan Maharaj, Luke Ong, Stuart Russell, Dawn Song, Max Tegmark, Lan Xue, Ya-Qin Zhang, Stephen Casper, Wan Sie Lee, et al. 2025. The singapore consensus on global ai safety research priorities. arXiv preprint arXiv:2506.20702. — [arXiv:2506.20702](https://arxiv.org/abs/2506.20702) [find](https://scholar.google.com/scholar?q=Yoshua+Bengio%2C+Tegan+Maharaj%2C+Luke+Ong%2C+Stuart+Russell%2C+Dawn+Song%2C+Max+Tegmark%2C+Lan+Xue%2C+Ya%2DQin+Zhang%2C+Stephen+Casper%2C+Wan+Sie+Lee%2C+et+al%2E+2025%2E+The+singapore+consensus+on+global+ai+safety+research+pr)
6. CIFAR. 2026. CAISI Research Program at CIFAR 2025 Year in Review: Building Safe AI for Canadians. PDF. [find](https://scholar.google.com/scholar?q=CIFAR%2E+2026%2E+CAISI+Research+Program+at+CIFAR+2025+Year+in+Review%3A+Building+Safe+AI+for+Canadians%2E+PDF%2E)
7. Government of France. 2025. National strategic review 2025. PDF. [find](https://scholar.google.com/scholar?q=Government+of+France%2E+2025%2E+National+strategic+review+2025%2E+PDF%2E)
8. Beliz Gunel, Sandeep Tata, and Marc Najork. 2023. Strum: Extractive aspect-based contrastive summarization. In Companion Proceedings of the ACM Web Conference 2023, WWW ’23 Companion, page 28–31, New York, NY, USA. Association for Computing Machinery. [find](https://scholar.google.com/scholar?q=Beliz+Gunel%2C+Sandeep+Tata%2C+and+Marc+Najork%2E+2023%2E+Strum%3A+Extractive+aspect%2Dbased+contrastive+summarization%2E+In+Companion+Proceedings+of+the+ACM+Web+Conference+2023%2C+WWW+%E2%80%9923+Companion%2C+page+28%E2%80%9331%2C+New+)
9. Hamza Harkous, Kassem Fawaz, Rémi Lebret, Florian Schaub, Kang G. Shin, and Karl Aberer. 2018. Polisis: Automated analysis and presentation of privacy policies using deep learning. In 27th USENIX Security Symposium (USENIX Security 18), pages 531–548, Baltimore, MD. USENIX Association. [find](https://scholar.google.com/scholar?q=Hamza+Harkous%2C+Kassem+Fawaz%2C+R%C3%A9mi+Lebret%2C+Florian+Schaub%2C+Kang+G%2E+Shin%2C+and+Karl+Aberer%2E+2018%2E+Polisis%3A+Automated+analysis+and+presentation+of+privacy+policies+using+deep+learning%2E+In+27th+USENIX+Secu)
10. Hayate Iso, Xiaolan Wang, Stefanos Angelidis, and Yoshi Suhara. 2022. Comparative opinion summarization via collaborative decoding. In Findings of the Association for Computational Linguistics: ACL 2022, pages 3307–3324. [find](https://scholar.google.com/scholar?q=Hayate+Iso%2C+Xiaolan+Wang%2C+Stefanos+Angelidis%2C+and+Yoshi+Suhara%2E+2022%2E+Comparative+opinion+summarization+via+collaborative+decoding%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL+20)
11. Japan AI Safety Institute. 2025a. AMAIS: Activity Map on AI Safety. PDF. [find](https://scholar.google.com/scholar?q=Japan+AI+Safety+Institute%2E+2025a%2E+AMAIS%3A+Activity+Map+on+AI+Safety%2E+PDF%2E)
12. Japan AI Safety Institute. 2025b. National status report of AI Safety in Japan 2024. and Enrique Herrera-Viedma. 2022. Summarizing legal regulatory documents using transformers. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR… [find](https://scholar.google.com/scholar?q=Japan+AI+Safety+Institute%2E+2025b%2E+National+status+report+of+AI+Safety+in+Japan+2024%2E+and+Enrique+Herrera%2DViedma%2E+2022%2E+Summarizing+legal+regulatory+documents+using+transformers%2E+In+Proceedings+of+the+)
13. MIC. 2023. Hiroshima AI Process. Web page. [find](https://scholar.google.com/scholar?q=MIC%2E+2023%2E+Hiroshima+AI+Process%2E+Web+page%2E)
14. OECD. 2025. Governing with artificial intelligence. [find](https://scholar.google.com/scholar?q=OECD%2E+2025%2E+Governing+with+artificial+intelligence%2E)
15. Joykirat Singh, Sehban Fazili, Rohan Jain, and Md. Shad Akhtar. 2024. EROS:entity-driven controlled policy document summarization. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 6236–6246, Torino, It… [find](https://scholar.google.com/scholar?q=Joykirat+Singh%2C+Sehban+Fazili%2C+Rohan+Jain%2C+and+Md%2E+Shad+Akhtar%2E+2024%2E+EROS%3Aentity%2Ddriven+controlled+policy+document+summarization%2E+In+Proceedings+of+the+2024+Joint+International+Conference+on+Computat)
16. South Korean Ministry of Government Legislation. 2025. Framework act on the development of artificial intelligence and establishment of trust (translated draft). Translated by Etcetera Language Group, Inc. [find](https://scholar.google.com/scholar?q=South+Korean+Ministry+of+Government+Legislation%2E+2025%2E+Framework+act+on+the+development+of+artificial+intelligence+and+establishment+of+trust+%28translated+draft%29%2E+Translated+by+Etcetera+Language+Group%2C)
17. Thomas Ströhle, Ricardo Campos, and Adam Jatowt. 2024. Contrastive text summarization: a survey. International Journal of Data Science and Analytics, 18(4):353–367. [find](https://scholar.google.com/scholar?q=Thomas+Str%C3%B6hle%2C+Ricardo+Campos%2C+and+Adam+Jatowt%2E+2024%2E+Contrastive+text+summarization%3A+a+survey%2E+International+Journal+of+Data+Science+and+Analytics%2C+18%284%29%3A353%E2%80%93367%2E)
18. AI Seoul Summit. 2024. Seoul declaration for safe, innovative and inclusive ai. PDF. [find](https://scholar.google.com/scholar?q=AI+Seoul+Summit%2E+2024%2E+Seoul+declaration+for+safe%2C+innovative+and+inclusive+ai%2E+PDF%2E)
19. The White House (US). 2023. Safe, secure, and trustworthy development and use of artificial intelligence. Web page. [find](https://scholar.google.com/scholar?q=The+White+House+%28US%29%2E+2023%2E+Safe%2C+secure%2C+and+trustworthy+development+and+use+of+artificial+intelligence%2E+Web+page%2E)
20. The White House (US). 2025. America’s action plan. PDF. [find](https://scholar.google.com/scholar?q=The+White+House+%28US%29%2E+2025%2E+America%E2%80%99s+action+plan%2E+PDF%2E)
21. Autumn Toney, Kathleen Curlee, and Emelia Probasco. 2024. Trust issues: Discrepancies in trustworthy ai keywords use in policy and research. In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’24, page 2222–2233, New York, NY, USA. Association for Computin… [find](https://scholar.google.com/scholar?q=Autumn+Toney%2C+Kathleen+Curlee%2C+and+Emelia+Probasco%2E+2024%2E+Trust+issues%3A+Discrepancies+in+trustworthy+ai+keywords+use+in+policy+and+research%2E+In+Proceedings+of+the+2024+ACM+Conference+on+Fairness%2C+Acco)
22. Mariia Tytarenko, Tobias Walter Rutar, Stefan Lengauer, and Tobias Schreck. 2025. Llm-agent support for two-document comparison using hierarchical topic maps. In VISxGenAI Workshop Papers. [find](https://scholar.google.com/scholar?q=Mariia+Tytarenko%2C+Tobias+Walter+Rutar%2C+Stefan+Lengauer%2C+and+Tobias+Schreck%2E+2025%2E+Llm%2Dagent+support+for+two%2Ddocument+comparison+using+hierarchical+topic+maps%2E+In+VISxGenAI+Workshop+Papers%2E)
23. UK-AISI. 2025. Our research agenda. Web page. [find](https://scholar.google.com/scholar?q=UK%2DAISI%2E+2025%2E+Our+research+agenda%2E+Web+page%2E)
24. Anna Jobin, Marcello Ienca, and Effy Vayena. 2019. The global landscape of AI ethics guidelines. Nature Machine Intelligence. [find](https://scholar.google.com/scholar?q=Anna+Jobin%2C+Marcello+Ienca%2C+and+Effy+Vayena%2E+2019%2E+The+global+landscape+of+AI+ethics+guidelines%2E+Nature+Machine+Intelligence%2E)
25. Svea Klaus, Ria Van Hecke, Kaweh Djafari Naini, Ismail Sengor Altingovde, Juan Bernabé-Moreno, Cunxiang Wang, Xiaoze Liu, Yuanhao Yue, Xiangru Tang, Tianhang Zhang, Cheng Jiayang, Yunzhi Yao, Wenyang Gao, Xuming Hu, Zehan Qi, et al. 2023. [Survey on factuality in large language models: Knowledge, ret…](https://md.research.elamur.ai/free/en/papers/wang-2023-survey-factuality-large-language-models/)

*Updated 31 October 2026*