---
title: "Combining Semantic Embeddings and Knowledge Graphs for"
description: "This work-in-progress paper proposes a system with four parts: document embeddings from Portuguese legal models, joined… 14 references."
authors: ["Gustavo Soares Silva", "Omar Andres Carmona Cortes", "Fábio Manoel França Lobato", "Antonio Fernando Lavareda Jacob Junior"]
year: 2026
venue: "Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2"
source: "https://aclanthology.org/2026.propor-2.25/"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/silva-2026-combining-semantic-embeddings-knowledge-graphs/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/silva-2026-combining-semantic-embeddings-knowledge-graphs/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/25/) / Combining Semantic Embeddings and Knowledge Graphs for Identifying Decision Patterns in Brazilian Judicial Decisions

# Combining Semantic Embeddings and Knowledge Graphs for Identifying Decision Patterns in Brazilian Judicial Decisions

**Authors:** Gustavo Soares Silva, Omar Andres Carmona Cortes, Fábio Manoel França Lobato and Antonio Fernando Lavareda Jacob Junior · **Year:** 2026 · **Venue:** [Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2](https://md.research.elamur.ai/free/en/venues/propor/) ([International Conference on Computational Processing of Portuguese 2026](https://md.research.elamur.ai/free/en/venues/propor/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.propor-2.25/) · [PDF](https://aclanthology.org/2026.propor-2.25.pdf)

## Summary
Brazilian courts carry enormous backlogs of repetitive litigation. At the Tribunal de Justiça do Maranhão (TJMA), finding recurring decision patterns is still a manual task. The authors point to three gaps in earlier work: clustering based on text alone struggles when documents are nearly identical in wording, existing pipelines assume a fixed corpus, and LLM-written cluster descriptions are not checked for legal soundness. This work-in-progress paper proposes a system with four parts:
- document embeddings from Portuguese legal models, joined with TransE embeddings of a knowledge graph that Jurema-7B extracts without a predefined schema;
- UMAP reduction followed by clustering;
- incremental assignment of new decisions using a cosine-similarity threshold against cluster centroids;
- LLM justifications grounded in the subgraph that cluster members share.

The pilot corpus contains 388 TJMA payroll loan decisions with very high pairwise overlap. Only text-only baselines are reported so far. The best combination was BumbaLM embeddings with UMAP and HDBSCAN. The work matters as a locally run, privacy-compliant aid for keeping precedents consistent.

## Key points
- Corpus: 388 TJMA decisions on payroll loan disputes (2016–2023). Average pair similarity is very high (Jaccard 0.86, cosine 0.94 with LegalBERT-pt embeddings), which motivates adding structural knowledge graph features.
- Embedding models compared: LegalBERT-pt, BERTimbau, BumbaLM-Embedding (a Qwen3-Embedding-4B variant tuned for Brazilian legal text) and a CBOW Word2Vec baseline. Long documents are split into chunks of up to 1,500 characters, and chunk vectors are averaged; chunks are stored in ChromaDB.
- The hybrid vector is formed by L2-normalizing the text embedding and the TransE graph embedding, then concatenating them. Clustering methods tested: K-Means, HDBSCAN, Agglomerative and Spectral, applied after UMAP with d ∈ {2, 10, 50}.
- Top text-only setup: BumbaLM + UMAP (d=2) + HDBSCAN, which found 5 clusters with Silhouette 0.752, Davies-Bouldin 0.289, Calinski-Harabasz 8,232.49 and a mean rank of 37.7. All five top configurations used UMAP + HDBSCAN.
- Still pending: the comparison of hybrid versus text-only representations, sensitivity tests for the threshold θ_s, validation of knowledge graph and entity-linking quality, and expert review of whether the justifications are legally valid. The planned deployment is a Docker microservice with an API.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 1,772 works · [⚖️ Law](https://md.research.elamur.ai/free/en/shelves/social-sciences/law/) · 77 works

🧭 Topics (2): [🕸️ Knowledge graphs & ontologies](https://md.research.elamur.ai/free/en/topics/knowledge-graphs/) · 192 works · [⚖️ Legal AI](https://md.research.elamur.ai/free/en/topics/legal-ai/) · 134 works

## Cite

Cite as: Gustavo Soares Silva, Omar Andres Carmona Cortes, Fábio Manoel França Lobato and Antonio Fernando Lavareda Jacob Junior. 2026. Combining Semantic Embeddings and Knowledge Graphs for Identifying Decision Patterns in Brazilian Judicial Decisions. Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{silva2026combining,
  title = {{Combining Semantic Embeddings and Knowledge Graphs for Identifying Decision Patterns in Brazilian Judicial Decisions}},
  author = {Gustavo Soares Silva, Omar Andres Carmona Cortes, Fábio Manoel França Lobato and Antonio Fernando Lavareda Jacob Junior},
  booktitle = {Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2},
  year = {2026},
  url = {https://aclanthology.org/2026.propor-2.25/}
}
```

- [← previous Combining Distantly Supervised Models with In Context Learning for Monolingual and Cross-Lingual Relation Extraction](https://md.research.elamur.ai/free/en/papers/rathore-2026-combining-distantly-supervised-models-context/)
- [next → Common Objects Out of Context (COOCo): Investigating Multimodal Context and Semantic Scene Violations in Referential Communication](https://md.research.elamur.ai/free/en/papers/merlo-2026-common-objects-out-context-cooco/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/25/)

## References

14 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. André Aguiar, Raquel Silveira, Vasco Furtado, Vládia Pinheiro, and João A. Monteiro Neto. 2022. Using Topic Modeling in Classification of Brazilian Lawsuits, page 233–242. Springer International Publishing. [find](https://scholar.google.com/scholar?q=Andr%C3%A9+Aguiar%2C+Raquel+Silveira%2C+Vasco+Furtado%2C+Vl%C3%A1dia+Pinheiro%2C+and+Jo%C3%A3o+A%2E+Monteiro+Neto%2E+2022%2E+Using+Topic+Modeling+in+Classification+of+Brazilian+Lawsuits%2C+page+233%E2%80%93242%2E+Springer+International+Publi)
2. Antoine Bordes, Nicolas Usunier, Alberto Garcia-Durán, Jason Weston, and Oksana Yakhnenko. 2013. [Translating embeddings for modeling multi-relational data](https://md.research.elamur.ai/free/en/papers/bordes-2013-translating-embeddings-modeling-multi-relational/). In Proceedings of the 27th International Conference on Neural Information Processing Systems, volume 2 of NIPS’13, page 2787–2795. Curran Associates Inc.
3. Marcella Queiroz de Castro and Ana Régia Mendonça. 2024. PLN e segurança jurídica identificação de divergências jurisprudenciais com processamento de linguagem natural. In Proceedings of the 15th Brazilian Symposium in Information and Human Language Technology, pages 457–462, Belém do Pará, Brazil. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Marcella+Queiroz+de+Castro+and+Ana+R%C3%A9gia+Mendon%C3%A7a%2E+2024%2E+PLN+e+seguran%C3%A7a+jur%C3%ADdica+identifica%C3%A7%C3%A3o+de+diverg%C3%AAncias+jurisprudenciais+com+processamento+de+linguagem+natural%2E+In+Proceedings+of+the+15th+Braz)
4. CNJ. 2025. Justiça em números. [find](https://scholar.google.com/scholar?q=CNJ%2E+2025%2E+Justi%C3%A7a+em+n%C3%BAmeros%2E)
5. José Alfredo F. Costa, Nielsen Castelo D. Dantas, and Esdras Daniel S. A. Silva. 2023. Evaluating text classification in the legal domain using bert embeddings. In Intelligent Data Engineering and Automated Learning – IDEAL 2023, pages 51–63, Cham. Springer Nature Switzerland. [find](https://scholar.google.com/scholar?q=Jos%C3%A9+Alfredo+F%2E+Costa%2C+Nielsen+Castelo+D%2E+Dantas%2C+and+Esdras+Daniel+S%2E+A%2E+Silva%2E+2023%2E+Evaluating+text+classification+in+the+legal+domain+using+bert+embeddings%2E+In+Intelligent+Data+Engineering+and+Aut)
6. Fabrício Almeida do Carmo. 2024. Representações Embeddings Orientadas à Linguagem Jurídica Brasileira. Mestrado em engenharia da compuatação e sistemas, Universidade Estadual do Maranhão, São Luís - MA. [find](https://scholar.google.com/scholar?q=Fabr%C3%ADcio+Almeida+do+Carmo%2E+2024%2E+Representa%C3%A7%C3%B5es+Embeddings+Orientadas+%C3%A0+Linguagem+Jur%C3%ADdica+Brasileira%2E+Mestrado+em+engenharia+da+compuata%C3%A7%C3%A3o+e+sistemas%2C+Universidade+Estadual+do+Maranh%C3%A3o%2C+S%C3%A3o+Lu%C3%ADs+%2D+M)
7. Fernando Martínez-Plumed, Lidia Contreras-Ochando, Cesar Ferri, José Hernández-Orallo, Meelis Kull, Nicolas Lachiche, María José Ramírez-Quintana, and Peter Flach. 2019. Crisp-dm twenty years later: From data mining processes to data science trajectories. IEEE Transactions on Knowledge and Data Engineering, 33(8):3048–3061. [↗](https://doi.org/10.1109/tkde.2019.2962680)
8. Hugo Mentzingen, Nuno António, Fernando Bacao, and Marcio Cunha. 2024. Textual similarity for legal precedents discovery: Assessing the performance of machine learning techniques in an administrative court. International Journal of Information Management Data Insights, 4:100247–100247. [↗](https://doi.org/10.1016/j.jjimei.2024.100247)
9. Raphael Souza de Oliveira and Erick Giovani Sperandio Nascimento. 2025. Analysing similarities between legal court documents using natural language processing approaches based on transformers. PLOS ONE, 20(4):e0320244. [↗](https://doi.org/10.1371/journal.pone.0320244)
10. Felipe Polo, Gabriel Mendonça, Kauê Parreira, Lucka Gianvechio, Peterson Cordeiro, Jonathan Ferreira, Leticia Lima, Antônio Maia, and Renato Vicente. 2021. Legalnlp - natural language processing methods for the brazilian legal language. In Anais do XVIII Encontro Nacional de Inteligência Artificial e Computacional, pages 763–774, Porto Alegre, RS, Brasil. SBC. [find](https://scholar.google.com/scholar?q=Felipe+Polo%2C+Gabriel+Mendon%C3%A7a%2C+Kau%C3%AA+Parreira%2C+Lucka+Gianvechio%2C+Peterson+Cordeiro%2C+Jonathan+Ferreira%2C+Leticia+Lima%2C+Ant%C3%B4nio+Maia%2C+and+Renato+Vicente%2E+2021%2E+Legalnlp+%2D+natural+language+processing+metho)
11. Ingrid L. A. da Silva, Rafael Ferreira Mello, Péricles B. C. Miranda, André C. A. Nascimento, Isabel W. S. Maldonado, and José L. M. Coelho Filho. 2021. Assessment of text clustering approaches for legal documents. In Anais do XVIII Encontro Nacional de Inteligência Artificial e Computacional (ENIAC 2021), ENIAC 2021, page 37–48. Sociedade Brasileira de Computação. [find](https://scholar.google.com/scholar?q=Ingrid+L%2E+A%2E+da+Silva%2C+Rafael+Ferreira+Mello%2C+P%C3%A9ricles+B%2E+C%2E+Miranda%2C+Andr%C3%A9+C%2E+A%2E+Nascimento%2C+Isabel+W%2E+S%2E+Maldonado%2C+and+Jos%C3%A9+L%2E+M%2E+Coelho+Filho%2E+2021%2E+Assessment+of+text+clustering+approaches+for+le)
12. Raquel Silveira, Caio Ponte, Vitor Almeida, Vládia Pinheiro, and Vasco Furtado. 2023. Legalbert-pt: A pre-trained language model for the brazilian portuguese legal domain. In Intelligent Systems, pages 268–282, Cham. Springer Nature Switzerland. [find](https://scholar.google.com/scholar?q=Raquel+Silveira%2C+Caio+Ponte%2C+Vitor+Almeida%2C+Vl%C3%A1dia+Pinheiro%2C+and+Vasco+Furtado%2E+2023%2E+Legalbert%2Dpt%3A+A+pre%2Dtrained+language+model+for+the+brazilian+portuguese+legal+domain%2E+In+Intelligent+Systems%2C+page)
13. Fábio Souza, Rodrigo Nogueira, and Roberto Lotufo. 2020. Bertimbau: Pretrained bert models for brazilian portuguese. In Intelligent Systems, pages 403– 417, Cham. Springer International Publishing. [find](https://scholar.google.com/scholar?q=F%C3%A1bio+Souza%2C+Rodrigo+Nogueira%2C+and+Roberto+Lotufo%2E+2020%2E+Bertimbau%3A+Pretrained+bert+models+for+brazilian+portuguese%2E+In+Intelligent+Systems%2C+pages+403%E2%80%93+417%2C+Cham%2E+Springer+International+Publishing%2E)
14. Yanran Tang, Ruihong Qiu, Yilun Liu, Xue Li, and Zi Huang. 2024. Casegnn: Graph neural networks for legal case retrieval with text-attributed graphs. In Advances in Information Retrieval, pages 80–95, Cham. Springer Nature Switzerland. [find](https://scholar.google.com/scholar?q=Yanran+Tang%2C+Ruihong+Qiu%2C+Yilun+Liu%2C+Xue+Li%2C+and+Zi+Huang%2E+2024%2E+Casegnn%3A+Graph+neural+networks+for+legal+case+retrieval+with+text%2Dattributed+graphs%2E+In+Advances+in+Information+Retrieval%2C+pages+80%E2%80%9395%2C)

*Updated 1 November 2026*