--- title: "A multimodal system to support disaster risk management (2026)" description: "This demo paper presents NOAH, a multimodal AI system for disaster risk management in Brazilian cities. 3 references." authors: ["Hosana Iasmin Castro dos Santos Lucena", "Gabriel Rocha dos Santos", "Jady Lima da Silva", "Ricardo José Matos de Carvalho", "Patrick Terrematte"] year: 2026 venue: "Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2" source: "https://aclanthology.org/2026.propor-2.7/" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" title_orig: "Sistema Multimodal de Apoio ao Gerenciamento de Riscos de Desastres" title_lang: "pt" canonical: "https://research.elamur.ai/free/en/papers/lucena-2026-sistema-multimodal-de-apoio-ao/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/lucena-2026-sistema-multimodal-de-apoio-ao/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/20/) / A multimodal system to support disaster risk management # A multimodal system to support disaster risk management *Original (Portuguese): Sistema Multimodal de Apoio ao Gerenciamento de Riscos de Desastres* **Authors:** Hosana Iasmin Castro dos Santos Lucena, Gabriel Rocha dos Santos, Jady Lima da Silva, Ricardo José Matos de Carvalho and Patrick Terrematte · **Year:** 2026 · **Venue:** [Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2](https://md.research.elamur.ai/free/en/venues/propor/) ([International Conference on Computational Processing of Portuguese 2026](https://md.research.elamur.ai/free/en/venues/propor/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.propor-2.7/) · [PDF](https://aclanthology.org/2026.propor-2.7.pdf) ## Summary This demo paper presents NOAH, a multimodal AI system for disaster risk management in Brazilian cities. The authors found that the civil defense office in Natal-RN logs threats and incidents by hand, first on paper and then in Excel. Under that workflow, categorization depends on individual judgment and automated statistical or spatial analysis is hard. NOAH lets citizens report incidents in Portuguese through a WhatsApp bot using text, voice or photos: - **Audio** is transcribed with Whisper Small, and the user confirms the transcript. - **Text** is categorized by a BERTopic model adapted to disaster classes. - **Images** are classified by a ResNet50 CNN. The bot then asks for the user's location and saves a structured record that appears on a web dashboard for civil defense staff. A second bot option uses RAG over official contingency plans to give guidance. The paper reports no quantitative evaluation; the authors plan to gather and curate real incident data for proper validation. The work matters because annotated crisis resources such as HumAID are mostly English, leaving Brazilian Portuguese and its regional varieties underserved. ## Key points - **Pipeline components:** Whisper Small (speech-to-text), BERTopic (Grootendorst, 2022) for text categories, ResNet50 for scene types such as floods, fires and landslides, and RAG over official contingency plans. - **Interface:** citizens use only WhatsApp; staff view geolocated structured reports on a web platform. - **Motivation:** the UNDRR (2025) estimates that people born in 2025 have about an 86% chance of living through a catastrophic flood, compared with 63% for those born in 1990. Brazilian funding for municipal risk-reduction plans (PMRR) and climate adaptation plans, which began with Lei 12.608/2012, has increased in 2024–2026. - **Gap addressed:** existing crisis datasets (e.g., HumAID from CrisisNLP) focus on English, and an earlier reporting app (Nik Nazli et al., 2016) had no AI processing. - **Limitation:** no metrics are reported, and evaluation on curated real-world data is left for future work. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* 📚 Shelves (2): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works 🧭 Topics (1): [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 657 works ## Cite Cite as: Hosana Iasmin Castro dos Santos Lucena, Gabriel Rocha dos Santos, Jady Lima da Silva, Ricardo José Matos de Carvalho and Patrick Terrematte. 2026. Sistema Multimodal de Apoio ao Gerenciamento de Riscos de Desastres. Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{lucena2026sistema, title = {{Sistema Multimodal de Apoio ao Gerenciamento de Riscos de Desastres}}, author = {Hosana Iasmin Castro {dos Santos Lucena}, Gabriel Rocha {dos Santos}, Jady Lima {da Silva}, Ricardo José Matos {de Carvalho} and Patrick Terrematte}, booktitle = {Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2}, year = {2026}, url = {https://aclanthology.org/2026.propor-2.7/} } ``` - [← previous A Multimodal Framework for Financial Fake News Detection for Brazilian Portuguese](https://md.research.elamur.ai/free/en/papers/requena-2026-multimodal-framework-financial-fake-news/) - [next → A Multitask Transformer for Offensive Language Detection and Target Identification in HateBR](https://md.research.elamur.ai/free/en/papers/silva-2026-multitask-transformer-offensive-language-detection/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/20/) ## References 3 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Muhammad Imran Ferda Ofli Firoj Alam, Umair Qazi. 2021. Humaid: Human-annotated disaster incidents data from twitter. In 15th International Conference on Web and Social Media (ICWSM). [find](https://scholar.google.com/scholar?q=Muhammad+Imran+Ferda+Ofli+Firoj+Alam%2C+Umair+Qazi%2E+2021%2E+Humaid%3A+Human%2Dannotated+disaster+incidents+data+from+twitter%2E+In+15th+International+Conference+on+Web+and+Social+Media+%28ICWSM%29%2E) 2. Matilde Martins Lencastre Godinho. 2024. The impact of natural language processing in disaster management: A systematic literature review. Master’s thesis, Universidade NOVA de Lisboa (Portugal). [find](https://scholar.google.com/scholar?q=Matilde+Martins+Lencastre+Godinho%2E+2024%2E+The+impact+of+natural+language+processing+in+disaster+management%3A+A+systematic+literature+review%2E+Master%E2%80%99s+thesis%2C+Universidade+NOVA+de+Lisboa+%28Portugal%29%2E) 3. Maarten Grootendorst. 2022. [Bertopic: Neural topic modeling with a class-based tf-idf procedure](https://md.research.elamur.ai/free/en/papers/grootendorst-2022-bertopic-neural-topic-modeling-class/). Preprint, arXiv:2203.05794. *Updated 1 November 2026*