---
title: "Subword tokenization — definition and key papers"
description: "Subword tokenization is a way of splitting text into units smaller than words but usually larger than single characters."
canonical: "https://research.elamur.ai/free/en/concepts/subword-tokenization/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/concepts/subword-tokenization/)

[home](https://md.research.elamur.ai/free/en/) / [concepts](https://md.research.elamur.ai/free/en/concepts/) / Subword tokenization

# ✂️ Subword tokenization

Concept · 30 key papers · [all concepts](https://md.research.elamur.ai/free/en/concepts/)

Subword tokenization is a way of splitting text into units smaller than words but usually larger than single characters. A vocabulary of fixed size is learned from a corpus, so frequent words stay whole and rare or unseen words break into known pieces.

Also: subword segmentation, subword units, wordpieces, open-vocabulary tokenization

## What it is

A neural text model can only take as input a finite set of symbols. Word-level vocabularies leave rare and unseen words out, and they grow very large in morphologically rich languages. Character or byte sequences avoid unknown symbols, but they make inputs long and expensive to process. Subword tokenization sits between these two options.

A tokenizer has two parts:

- a learned inventory of pieces;
- a procedure that maps any string onto a sequence of those pieces.

Common words usually become single tokens. Rarer words become a few fragments. Depending on the vocabulary, a word like "unhappiness" might come out as "un", "happi" and "ness".

The approach became standard in neural machine translation. It was then carried into pretrained encoders and large language models ([Sennrich et al. 2016](https://md.research.elamur.ai/free/en/papers/sennrich-2016-neural-machine-translation-rare-words/); [Mielke et al. 2021](https://md.research.elamur.ai/free/en/papers/mielke-2021-between-words-characters-brief-history/)). Tokenizers are commonly compared by fertility (the average number of tokens per word), by compression, and above all by how well the resulting model performs on later tasks. The first two are convenient proxies, but how well they predict model quality is disputed ([Ali et al. 2024](https://md.research.elamur.ai/free/en/papers/ali-2024-tokenizer-choice-llm-training-negligible/); [Schmidt et al. 2024](https://md.research.elamur.ai/free/en/papers/schmidt-2024-tokenization-is-more-than-compression/)).

## The key idea

Most subword vocabularies are built in one of two ways. Byte-pair encoding grows a vocabulary bottom-up by merging symbols. The unigram language model starts large and prunes top-down.

```
BPE merge step:     (a*, b*) = argmax over adjacent pairs (a, b) of  count(a, b)
                    replace every occurrence of a b with the new symbol ab
Unigram LM:         P(x) = p(x1) · p(x2) · … · p(xM)
                    x* = argmax over x in S(X) of P(x)
```

In the BPE lines, a and b are adjacent symbols in the training corpus, and count(a, b) is how often they occur side by side. The pair with the highest count, (a*, b*), becomes a new symbol ab.

In the unigram lines, X is a word or sentence and S(X) is the set of all ways to segment X with the current vocabulary. Each x is one such segmentation, made of pieces x1 to xM. The value p(xi) is the probability of piece xi, and x* is the most probable segmentation.

Byte-pair encoding works step by step:

1. Split every word into characters, with an end-of-word marker.
2. Count all adjacent symbol pairs.
3. Merge the most frequent pair everywhere and record that merge.
4. Repeat until a chosen number of merges has been performed.

To tokenize new text, the recorded merges are replayed in the order they were learned.

WordPiece, attributed to Schuster and Nakajima (2012), is similar to BPE. The difference is that it picks the merge that most raises the likelihood of the training data, rather than the most frequent raw pair. In the unigram model, piece probabilities are fitted with EM (expectation–maximization). The best segmentation is found with Viterbi decoding, a dynamic-programming search for the highest-scoring path. This also makes it possible to sample alternative segmentations during training. BPE-dropout later brought a similar kind of sampling to BPE ([Kudo 2018](https://md.research.elamur.ai/free/en/papers/kudo-2018-subword-regularization-improving-neural-network/); [Provilkov et al. 2020](https://md.research.elamur.ai/free/en/papers/provilkov-2020-bpe-dropout-simple-effective-subword/)).

| Method | Direction | Segmentation of new text |
| --- | --- | --- |
| BPE | bottom-up merges | replay merge table |
| WordPiece | bottom-up, likelihood-driven | greedy longest match (BERT's inference procedure) |
| Unigram LM | top-down pruning | Viterbi over piece probabilities |

## History and founding papers

Byte-pair encoding began as a data-compression method by Gage (1994). It was adapted to the translation of rare words ([Sennrich et al. 2016](https://md.research.elamur.ai/free/en/papers/sennrich-2016-neural-machine-translation-rare-words/)), and this made it the default segmentation for neural machine translation ([Mielke et al. 2021](https://md.research.elamur.ai/free/en/papers/mielke-2021-between-words-characters-brief-history/)). In parallel, static word embeddings were extended to use subword information ([Bojanowski et al. 2017](https://md.research.elamur.ai/free/en/papers/bojanowski-2017-enriching-word-vectors-subword-information/)).

Kudo then proposed the unigram language model together with subword regularization. In this scheme the model sees several sampled segmentations of the same word during training ([Kudo 2018](https://md.research.elamur.ai/free/en/papers/kudo-2018-subword-regularization-improving-neural-network/)).

SentencePiece made both BPE and unigram training work directly on raw sentences ([Kudo & Richardson 2018](https://md.research.elamur.ai/free/en/papers/kudo-2018-sentencepiece-simple-language-independent-subword/)). It replaces whitespace with the meta-symbol ▁ (U+2581) and then handles it like any other character, so detokenization is lossless. Users set the final vocabulary size directly instead of a merge count. On the KFTT English–Japanese corpus, a shared 8k SentencePiece vocabulary reached 29.55 BLEU (an n-gram overlap score for translation) for ja→en. An 80k word-level baseline reached 28.24 BLEU on the same task ([Kudo & Richardson 2018](https://md.research.elamur.ai/free/en/papers/kudo-2018-sentencepiece-simple-language-independent-subword/)).

BPE-dropout later brought regularization back to plain BPE. During training it skips each candidate merge with probability p, typically 0.1. At inference, plain BPE is applied (p = 0). Across IWSLT, WMT14 and ASPEC translation directions, it beat standard BPE by up to 2.3 BLEU and Kudo's method by up to 0.9 BLEU. On clean WMT14 test sets, the gains over BPE were 0.45–1.5 BLEU. They rose to 1.58–2.32 BLEU when 10% of source words carried a one-character typo ([Provilkov et al. 2020](https://md.research.elamur.ai/free/en/papers/provilkov-2020-bpe-dropout-simple-effective-subword/)).

Byte-level BPE runs the merges over UTF-8 bytes, so no input is ever out of vocabulary. In translation it matched BPE quality with about one-eighth of the vocabulary ([Wang et al. 2019](https://md.research.elamur.ai/free/en/papers/wang-2019-neural-machine-translation-byte-level/)).

A separate line of work comes from unsupervised morphology. Morfessor 2.0 re-implements Morfessor Baseline, the method of Creutz and Lagus (2002), which was first released as Morfessor 1.0 in 2005. It uses MAP (maximum a posteriori) estimation that balances a lexicon prior against data likelihood ([Smit et al. 2014](https://md.research.elamur.ai/free/en/papers/smit-2014-morfessor-2-0-toolkit-statistical/)). Later models in this line include:

- Bayesian multilingual segmenters, which cut relative error by up to 24% over a monolingual counterpart ([Snyder & Barzilay 2008](https://md.research.elamur.ai/free/en/papers/snyder-2008-unsupervised-multilingual-learning-morphological-segmentation/));
- log-linear models with priors in the spirit of MDL (minimum description length). On the full Arabic Penn Treebank they reached 77.7 F1 (the harmonic mean of boundary precision and recall), against 74.9 for Morfessor Categories-MAP ([Poon et al. 2009](https://md.research.elamur.ai/free/en/papers/poon-2009-unsupervised-morphological-segmentation-log-linear/));
- adaptor grammars guided by about 1000 gold-segmented word types ([Sirts & Goldwater 2013](https://md.research.elamur.ai/free/en/papers/sirts-2013-minimally-supervised-morphological-segmentation-adaptor/)).

For Arabic, one system combined a morphological analyzer with SVM classifiers that choose among its candidate analyses. It reported a tokenization error of 0.7% on the Penn Arabic Treebank, against 2.9% for an earlier system ([Habash & Rambow 2005](https://md.research.elamur.ai/free/en/papers/habash-2005-arabic-tokenization-part-speech-tagging/)). Joint lattice parsing for Turkish and Hebrew showed that the right segmentation can depend on syntax ([Seeker & Çetinoğlu 2015](https://md.research.elamur.ai/free/en/papers/seeker-2015-graph-based-lattice-dependency-parser/)).

## How it is used today

Most pretrained language models ship with a subword tokenizer ([Mielke et al. 2021](https://md.research.elamur.ai/free/en/papers/mielke-2021-between-words-characters-brief-history/)). The shared WordPiece vocabulary of multilingual BERT has 119,547 tokens ([Rust et al. 2021](https://md.research.elamur.ai/free/en/papers/rust-2021-how-good-is-your-tokenizer/)). ChatGPT and BLOOMZ both rely on byte-level BPE ([Ahia et al. 2023](https://md.research.elamur.ai/free/en/papers/ahia-2023-do-all-languages-cost-same/)). Pretrained BPE embeddings have been released for 275 languages. In English entity typing, an 11 MB BPE model matched FastText vectors of roughly 6 GB ([Heinzerling & Strube 2018](https://md.research.elamur.ai/free/en/papers/heinzerling-2018-bpemb-tokenization-free-pre-trained/)).

Vocabulary size is a central design choice. In 2.6B-parameter decoder experiments, about 33k entries sufficed for English. A five-language mix (English, German, French, Italian, Spanish) needed roughly three times as many. Reusing an English-centric tokenizer for that mix, instead of one trained on it, raised training compute by up to 68% ([Ali et al. 2024](https://md.research.elamur.ai/free/en/papers/ali-2024-tokenizer-choice-llm-training-negligible/)).

For code models, vocabulary size correlated only weakly with accuracy on HumanEval, a benchmark of Python code-generation problems. The pre-tokenization regular expression mattered much more. A base model's tokenizer could be swapped with little loss once fine-tuning exceeded about 50B tokens ([Dagan et al. 2024](https://md.research.elamur.ai/free/en/papers/dagan-2024-getting-most-out-tokenizer-pre/)).

Swapping tokenizers also underlies cross-lingual transfer. Each new subword embedding can be initialized from semantically similar old ones. The similar tokens are found with multilingual static word embeddings that place both languages in one shared space. This matters because embeddings make up about 31% of the parameters of the base-size RoBERTa ([Minixhofer et al. 2022](https://md.research.elamur.ai/free/en/papers/minixhofer-2022-wechsel-effective-initialization-subword-embeddings/)).

Mismatched vocabularies complicate knowledge distillation. For example, the BLOOMZ tokenizer covers only 30.03% of Mistral's vocabulary ([Boizard et al. 2024](https://md.research.elamur.ai/free/en/papers/boizard-2024-towards-cross-tokenizer-distillation-universal/)). Discrete tokenization in a broader sense, mapping signals to discrete units rather than learning subword vocabularies, has also reached speech ([Zhang et al. 2023](https://md.research.elamur.ai/free/en/papers/zhang-2023-speechtokenizer-unified-speech-tokenizer-speech/)) and robot actions ([Pertsch et al. 2025](https://md.research.elamur.ai/free/en/papers/pertsch-2025-fast-efficient-action-tokenization-vision/)).

Across languages, tokenization creates measurable inequality. One study used FLORES-200, a parallel evaluation set, so the content stays the same across languages. Some languages needed up to five times more tokens than others for that content. Over-fragmented languages also scored worse in in-context learning ([Ahia et al. 2023](https://md.research.elamur.ai/free/en/papers/ahia-2023-do-all-languages-cost-same/)). Related work also finds unfairness between languages, and the size of the gap depends on the tokenizer and the languages compared ([Petrov et al. 2023](https://md.research.elamur.ai/free/en/papers/petrov-2023-language-model-tokenizers-introduce-unfairness/)).

Monolingual tokenizers with lower fertility gave consistent gains for Arabic, Finnish, Indonesian, Korean and Turkish. Lower fertility tracked downstream gains (Spearman ρ ≈ 0.36) about as closely as pretraining corpus size did (ρ ≈ 0.38) ([Rust et al. 2021](https://md.research.elamur.ai/free/en/papers/rust-2021-how-good-is-your-tokenizer/)).

## Open questions

What makes a tokenizer good is still unsettled. Compression is the usual explanation. However, one study trained 64 English models with varied tokenizers, including PathPiece, which minimizes token count. Fewer tokens showed no clear link to better downstream accuracy ([Schmidt et al. 2024](https://md.research.elamur.ai/free/en/papers/schmidt-2024-tokenization-is-more-than-compression/)). Fertility and parity (the token count for parallel text relative to English) are, at best, weak predictors of model quality ([Ali et al. 2024](https://md.research.elamur.ai/free/en/papers/ali-2024-tokenizer-choice-llm-training-negligible/)).

BPE has also been called suboptimal for pretraining. Models using unigram LM segmentation matched or outperformed BPE-based ones on downstream tasks ([Bostrom & Durrett 2020](https://md.research.elamur.ai/free/en/papers/bostrom-2020-byte-pair-encoding-is-suboptimal/)). Number handling is one concrete weakness. Commas can force right-to-left digit grouping. Doing so raised few-shot addition accuracy for the March 2023 GPT-4 checkpoint from 84.4% to 98.9% ([Singh & Strouse 2024](https://md.research.elamur.ai/free/en/papers/singh-2024-tokenization-counts-impact-tokenization-arithmetic/)).

A related question is whether morpheme-aware segmentation should replace purely statistical splits. For Arabic classification, no tokenizer won everywhere, and even linguistically meaningless splits did surprisingly well ([Alyafeai et al. 2021](https://md.research.elamur.ai/free/en/papers/alyafeai-2021-evaluating-various-tokenizers-arabic-text/)). Linguistic pipelines such as UDPipe take a different route. They split text into words and then assign morphological analyses in a separate trainable step, rather than learning statistical subword pieces ([Straka et al. 2016](https://md.research.elamur.ai/free/en/papers/straka-2016-udpipe-trainable-pipeline-processing-conll/)).

Finally, tokenizer-free models try to remove the fixed vocabulary altogether. Canine works directly from characters ([Clark et al. 2022](https://md.research.elamur.ai/free/en/papers/clark-2022-canine-pre-training-efficient-tokenization/)). Charformer learns soft segmentation from bytes. It roughly matches subword models and runs 10–93% faster than a byte-level baseline ([Tay et al. 2021](https://md.research.elamur.ai/free/en/papers/tay-2021-charformer-fast-character-transformers-gradient/)). Whether such models can handle non-concatenative morphology, and stay efficient at scale, remains open.

## Key papers

The works this page cites, the most cited first; citations as counted by OpenAlex plus the papers of this library that cite the work, read 2026-10-23.

- [SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing](https://md.research.elamur.ai/free/en/papers/kudo-2018-sentencepiece-simple-language-independent-subword/) — Taku Kudo, John Richardson · 2018 · 4,461 citations
- [Neural Machine Translation of Rare Words with Subword Units](https://md.research.elamur.ai/free/en/papers/sennrich-2016-neural-machine-translation-rare-words/) — Rico Sennrich, Barry Haddow, Alexandra Birch · 2016 · 3,409 citations
- [Enriching Word Vectors with Subword Information](https://md.research.elamur.ai/free/en/papers/bojanowski-2017-enriching-word-vectors-subword-information/) — Piotr Bojanowski, Edouard Grave, Armand Joulin et al. · 2017 · 2,218 citations
- [Arabic Tokenization, Part-of-Speech Tagging and Morphological Disambiguation in One Fell Swoop](https://md.research.elamur.ai/free/en/papers/habash-2005-arabic-tokenization-part-speech-tagging/) — Nizar Habash, Owen Rambow · 2005 · 634 citations
- [Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates](https://md.research.elamur.ai/free/en/papers/kudo-2018-subword-regularization-improving-neural-network/) — Taku Kudo · 2018 · 561 citations
- [UDPipe: Trainable Pipeline for Processing CoNLL-U Files Performing Tokenization, Morphological Analysis, POS Tagging and Parsing](https://md.research.elamur.ai/free/en/papers/straka-2016-udpipe-trainable-pipeline-processing-conll/) — Milan Straka, Jan Hajič, Jana Straková · 2016 · 478 citations
- [How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models](https://md.research.elamur.ai/free/en/papers/rust-2021-how-good-is-your-tokenizer/) — Phillip Rust, Jonas Pfeiffer, Ivan Vulić et al. · 2021 · 444 citations
- [BPE-Dropout: Simple and Effective Subword Regularization](https://md.research.elamur.ai/free/en/papers/provilkov-2020-bpe-dropout-simple-effective-subword/) — Ivan Provilkov, Dmitrii Emelianenko, Elena Voita · 2020 · 389 citations
- [BPEmb: Tokenization-free Pre-trained Subword Embeddings in 275 Languages](https://md.research.elamur.ai/free/en/papers/heinzerling-2018-bpemb-tokenization-free-pre-trained/) — Benjamin Heinzerling, Michael Strube · 2018 · 256 citations
- [Neural Machine Translation with Byte-Level Subwords](https://md.research.elamur.ai/free/en/papers/wang-2019-neural-machine-translation-byte-level/) — Changhan Wang, Kyunghyun Cho, Jiatao Gu · 2019 · 228 citations
- [Unsupervised Multilingual Learning for Morphological Segmentation](https://md.research.elamur.ai/free/en/papers/snyder-2008-unsupervised-multilingual-learning-morphological-segmentation/) — Benjamin Snyder, Regina Barzilay · 2008 · 221 citations
- [Unsupervised Morphological Segmentation with Log-Linear Models](https://md.research.elamur.ai/free/en/papers/poon-2009-unsupervised-morphological-segmentation-log-linear/) — Hoifung Poon, Colin Cherry, Kristina Toutanova · 2009 · 210 citations
- [Charformer: Fast Character Transformers via Gradient-based Subword Tokenization](https://md.research.elamur.ai/free/en/papers/tay-2021-charformer-fast-character-transformers-gradient/) — Yi Tay, Vinh Q. Tran, Sebastian Ruder et al. · 2021 · 179 citations
- [Morfessor 2.0: Toolkit for statistical morphological segmentation](https://md.research.elamur.ai/free/en/papers/smit-2014-morfessor-2-0-toolkit-statistical/) — Peter Smit, Sami Virpioja, Stig-Arne Grönroos et al. · 2014 · 168 citations
- [Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models](https://md.research.elamur.ai/free/en/papers/ahia-2023-do-all-languages-cost-same/) — Orevaoghene Ahia, Sachin Kumar, Hila Gonen et al. · 2023 · 164 citations
- [Canine: Pre-training an Efficient Tokenization-Free Encoder for Language Representation](https://md.research.elamur.ai/free/en/papers/clark-2022-canine-pre-training-efficient-tokenization/) — Jonathan H. Clark, Dan Garrette, Iulia Turc et al. · 2022 · 156 citations
- [Language Model Tokenizers Introduce Unfairness Between Languages](https://md.research.elamur.ai/free/en/papers/petrov-2023-language-model-tokenizers-introduce-unfairness/) — Aleksandar Petrov, Emanuele La Malfa, Philip H. S. Torr et al. · 2023 · 149 citations
- [Byte Pair Encoding is Suboptimal for Language Model Pretraining](https://md.research.elamur.ai/free/en/papers/bostrom-2020-byte-pair-encoding-is-suboptimal/) — Kaj Bostrom, Greg Durrett · 2020 · 136 citations
- [Tokenizer Choice For LLM Training: Negligible or Crucial?](https://md.research.elamur.ai/free/en/papers/ali-2024-tokenizer-choice-llm-training-negligible/) — Mehdi Ali, Michael Fromm, Klaudia Thellmann et al. · 2024 · 102 citations
- [Minimally-Supervised Morphological Segmentation using Adaptor Grammars](https://md.research.elamur.ai/free/en/papers/sirts-2013-minimally-supervised-morphological-segmentation-adaptor/) — Kairit Sirts, Sharon Goldwater · 2013 · 94 citations
- [WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models](https://md.research.elamur.ai/free/en/papers/minixhofer-2022-wechsel-effective-initialization-subword-embeddings/) — Benjamin Minixhofer, Fabian Paischer, Navid Rekabsaz · 2022 · 90 citations
- [Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP](https://md.research.elamur.ai/free/en/papers/mielke-2021-between-words-characters-brief-history/) — Sabrina J. Mielke, Zaid Alyafeai, Elizabeth Salesky et al. · 2021 · 89 citations
- [Tokenization Is More Than Compression](https://md.research.elamur.ai/free/en/papers/schmidt-2024-tokenization-is-more-than-compression/) — Craig W Schmidt, Varshini Reddy, Haoran Zhang et al. · 2024 · 66 citations
- [Evaluating Various Tokenizers for Arabic Text Classification](https://md.research.elamur.ai/free/en/papers/alyafeai-2021-evaluating-various-tokenizers-arabic-text/) — Zaid Alyafeai, Maged S. Al-shaibani, Mustafa Ghaleb et al. · 2021 · 66 citations
- [A Graph-based Lattice Dependency Parser for Joint Morphological Segmentation and Syntactic Analysis](https://md.research.elamur.ai/free/en/papers/seeker-2015-graph-based-lattice-dependency-parser/) — Wolfgang Seeker, Özlem Çetinoğlu · 2015 · 66 citations
- [Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs](https://md.research.elamur.ai/free/en/papers/singh-2024-tokenization-counts-impact-tokenization-arithmetic/) — Aaditya K. Singh, DJ Strouse · 2024 · 53 citations
- [SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models](https://md.research.elamur.ai/free/en/papers/zhang-2023-speechtokenizer-unified-speech-tokenizer-speech/) — Xin Zhang, Dong Zhang, Shimin Li et al. · 2023 · 51 citations
- [Getting the most out of your tokenizer for pre-training and domain adaptation](https://md.research.elamur.ai/free/en/papers/dagan-2024-getting-most-out-tokenizer-pre/) — Gautier Dagan, Gabriel Synnaeve, Baptiste Roziere · 2024 · 44 citations
- [FAST: Efficient Action Tokenization for Vision-Language-Action Models](https://md.research.elamur.ai/free/en/papers/pertsch-2025-fast-efficient-action-tokenization-vision/) — Karl Pertsch, Kyle Stachowicz, Brian Ichter et al. · 2025 · 38 citations
- [Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMs](https://md.research.elamur.ai/free/en/papers/boizard-2024-towards-cross-tokenizer-distillation-universal/) — Nicolas Boizard, Kevin El Haddad, Celine Hudelot et al. · 2024 · 34 citations

## Related concepts

- [Language model](https://md.research.elamur.ai/free/en/concepts/language-model/) — A language model is a probability distribution over sequences of tokens (words, subwords or characters). It is usually factored into…
- [Minimum description length](https://md.research.elamur.ai/free/en/concepts/minimum-description-length/) — Minimum description length (MDL) is a model-selection principle rooted in information theory. It says the best explanation of a dataset is…
- [Zipf's law](https://md.research.elamur.ai/free/en/concepts/zipfs-law/) — Zipf's law is the empirical regularity that, when the items of a collection such as the words of a text are ranked by frequency, each…
- [Transformer and attention](https://md.research.elamur.ai/free/en/concepts/transformer/) — The Transformer is a neural network architecture that represents a sequence by letting each element gather information from all others…

## More papers

Topics: [✂️ Tokenization & segmentation](https://md.research.elamur.ai/free/en/topics/tokenization/) · [🧩 Morphology](https://md.research.elamur.ai/free/en/topics/morphology/) · [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/)

Shelves: [💬 Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

- [← previous concept Semantic similarity](https://md.research.elamur.ai/free/en/concepts/semantic-similarity/)
- [next concept → Transformer and attention](https://md.research.elamur.ai/free/en/concepts/transformer/)
- [↑ back to concepts](https://md.research.elamur.ai/free/en/concepts/)