---
title: "A Diagram Is Worth A Dozen Images — Kembhavi 2016"
description: "The paper addresses how to get machines to understand diagrams."
authors: ["Aniruddha Kembhavi", "Mike Salvato", "Eric Kolve", "Minjoon Seo", "Hannaneh Hajishirzi", "Ali Farhadi"]
year: 2016
venue: "arXiv:1603.07396"
source: "https://arxiv.org/abs/1603.07396"
doi: "10.48550/arxiv.1603.07396"
arxiv: "1603.07396"
licence: "arXiv — non-exclusive license to distribute"
licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/kembhavi-2016-diagram-worth-dozen-images/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/kembhavi-2016-diagram-worth-dozen-images/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2016](https://md.research.elamur.ai/free/en/papers/2016/) / A Diagram Is Worth A Dozen Images

# A Diagram Is Worth A Dozen Images

**Authors:** [Aniruddha Kembhavi](https://md.research.elamur.ai/free/en/authors/aniruddha-kembhavi/), Mike Salvato, Eric Kolve, [Minjoon Seo](https://md.research.elamur.ai/free/en/authors/minjoon-seo/), [Hannaneh Hajishirzi](https://md.research.elamur.ai/free/en/authors/hannaneh-hajishirzi/), [Ali Farhadi](https://md.research.elamur.ai/free/en/authors/ali-farhadi/) · **Year:** 2016 · **Venue:** arXiv:1603.07396 · **Licence:** [arXiv — non-exclusive license to distribute](http://arxiv.org/licenses/nonexclusive-distrib/1.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/1603.07396) · [PDF](https://arxiv.org/pdf/1603.07396) · [DOI 10.48550/arxiv.1603.07396](https://doi.org/10.48550/arxiv.1603.07396) · [arXiv 1603.07396](https://arxiv.org/abs/1603.07396) · [OpenAlex](https://openalex.org/W2951298542)

**Citations:** 9 citations (openalex-snapshot · 2026-10-14) · [198](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
The paper addresses how to get machines to understand diagrams. Diagrams, such as school science illustrations, show processes, cycles and dependencies that photographs cannot easily capture, but computer vision had paid them little attention. The authors split the problem into two tasks. The first is syntactic parsing: finding a diagram's elements and how they are structurally linked. The second is semantic interpretation, which they test through multiple-choice question answering. They encode a diagram's structure as a Diagram Parse Graph (DPG), building on Engelhardt's theory of graphic representation. Dsdp-Net, an LSTM model, builds a DPG step by step by choosing relationships from noisy candidate detections. Dqa-Net answers questions by attending to the relevant relations in the DPG. Both models are evaluated on AI2D, a new dataset of annotated science diagrams with questions. Dsdp-Net beats greedy and A* search baselines at parsing. Dqa-Net beats a standard VQA model that uses only image features. The work established diagram understanding as its own research area and released a benchmark for it.

## Key points
- **AI2D dataset:** more than 5,000 grade-school science diagrams, over 150,000 annotations of elements and relations, ground-truth parses, and more than 15,000 multiple-choice questions.
- **DPG representation:** nodes are one of four constituent types (blobs, text boxes, arrows, arrow heads). Edges are one of ten relationship classes, such as inter-object linkage, arrow descriptor and image title.
- **Parsing:** Dsdp-Net was trained on about 400,000 sampled relationship sequences. It is scored with the Jaccard Index for Graphs (JIG) and clearly beats the Greedy and A* baselines. A YOLO-style CNN that predicts the whole graph directly gave no meaningful output.
- **Question answering:** Dqa-Net uses 300-dimensional GloVe embeddings and a small LSTM with attention over DPG relations. It beats the LSTM Q+I VQA baseline (which uses VGG-19 image features) whether that baseline is trained on VQA or on AI2D.
- **Release:** AI2D and the baselines are public. The authors' suggested next step is adding diagrammatic and commonsense knowledge to diagram QA.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Other](https://md.research.elamur.ai/free/en/shelves/other/)

## Cited by

Cited by

198 papers of our library cite it (of the 140884 whose bibliographies we read); 26 of them have a page here, 172 not yet.

- [Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone](https://md.research.elamur.ai/free/en/papers/abdin-2024-phi-3-technical-report-highly/)
- [Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-vl-versatile-vision-language/)
- [Qwen2.5-VL Technical Report](https://md.research.elamur.ai/free/en/papers/bai-2025-qwen2-5-vl-technical/)
- [Qwen3-VL Technical Report](https://md.research.elamur.ai/free/en/papers/bai-2025-qwen3-vl-technical-report/)
- [InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks](https://md.research.elamur.ai/free/en/papers/chen-2023-internvl-scaling-up-vision/)
- [Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling](https://md.research.elamur.ai/free/en/papers/chen-2024-expanding-performance-boundaries-open/)
- [How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites](https://md.research.elamur.ai/free/en/papers/chen-2024-far-gpt-4v-closing/)
- [Are We on the Right Way for Evaluating Large Vision-Language Models?](https://md.research.elamur.ai/free/en/papers/chen-2024-right-way-evaluating-large-vision/)
- [Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models](https://md.research.elamur.ai/free/en/papers/deitke-2024-molmo-pixmo-open-weights-open/)
- [InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Model](https://md.research.elamur.ai/free/en/papers/dong-2024-internlm-xcomposer2-mastering-free/)
- [Gemini: A Family of Highly Capable Multimodal Models](https://md.research.elamur.ai/free/en/papers/gemini-2023-team-gemini-family-highly-capable-multimodal/)
- [Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context](https://md.research.elamur.ai/free/en/papers/gemini-2024-team-gemini-1-5-unlocking-multimodal/)
- [AIN: The Arabic INclusive Large Multimodal Model](https://md.research.elamur.ai/free/en/papers/heakl-2025-ain-arabic-inclusive-large-multimodal/)
- [What matters when building vision-language models?](https://md.research.elamur.ai/free/en/papers/lauren-2024-ccon-matters-building-vision-language-models/)
- [LLaVA-OneVision: Easy Visual Task Transfer](https://md.research.elamur.ai/free/en/papers/li-2024-llava-onevision-easy-visual-task/)
- [MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts](https://md.research.elamur.ai/free/en/papers/lu-2023-mathvista-evaluating-mathematical-reasoning-foundation/)
- [Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs](https://md.research.elamur.ai/free/en/papers/microsoft-2025-phi-4-mini-technical-report/)
- [STRUDEL: Unrolling a Benchmark for Evaluating Vision-Language Models on Structured Diagram Understanding across Domains](https://md.research.elamur.ai/free/en/papers/steinigen-2026-strudel-unrolling-benchmark-evaluating-vision/)
- [Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs](https://md.research.elamur.ai/free/en/papers/tong-2024-cambrian-1-fully-open-vision/)
- [Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution](https://md.research.elamur.ai/free/en/papers/wang-2024-qwen2-vl-enhancing-vision/)
- [InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency](https://md.research.elamur.ai/free/en/papers/wang-2025-internvl3-5-advancing-open/)
- [DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding](https://md.research.elamur.ai/free/en/papers/wu-2024-deepseek-vl2-mixture-experts/)
- [Qwen2.5-Omni Technical Report](https://md.research.elamur.ai/free/en/papers/xu-2025-qwen2-5-omni-technical/)
- [Qwen3-Omni Technical Report](https://md.research.elamur.ai/free/en/papers/xu-2025-qwen3-omni-technical-report/)
- [MiniCPM-V: A GPT-4V Level MLLM on Your Phone](https://md.research.elamur.ai/free/en/papers/yao-2024-minicpm-v-gpt-4v/)
- [InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models](https://md.research.elamur.ai/free/en/papers/zhu-2025-internvl3-exploring-advanced-training/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{kembhavi2016diagram,
  title = {{A Diagram Is Worth A Dozen Images}},
  author = {Kembhavi, Aniruddha and Salvato, Mike and Kolve, Eric and Seo, Minjoon and Hajishirzi, Hannaneh and Farhadi, Ali},
  year = {2016},
  doi = {10.48550/arxiv.1603.07396},
  eprint = {1603.07396},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.1603.07396}
}
```

- [← previous A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks](https://md.research.elamur.ai/free/en/papers/poria-2016-deeper-look-into-sarcastic-tweets/)
- [next → A Diversity-Promoting Objective Function for Neural Conversation Models](https://md.research.elamur.ai/free/en/papers/li-2016-diversity-promoting-objective-function-neural/)
- [↑ back to papers of 2016](https://md.research.elamur.ai/free/en/papers/2016/)

## References

48 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Srihari, R.K.: Computational models for integrating linguistic and visual information: A survey. Artif. Intell. Rev. 8 (1994) 349–369 [find](https://scholar.google.com/scholar?q=Srihari%2C+R%2EK%2E%3A+Computational+models+for+integrating+linguistic+and+visual+information%3A+A+survey%2E+Artif%2E+Intell%2E+Rev%2E+8+%281994%29+349%E2%80%93369)
2. Ferguson, R.W., Forbus, K.D.: Telling juxtapositions: Using repetition and alignable difference in diagram understanding. Advances in Analogy Research (1998) [find](https://scholar.google.com/scholar?q=Ferguson%2C+R%2EW%2E%2C+Forbus%2C+K%2ED%2E%3A+Telling+juxtapositions%3A+Using+repetition+and+alignable+difference+in+diagram+understanding%2E+Advances+in+Analogy+Research+%281998%29)
3. Watanabe, Y., Nagao, M.: Diagram understanding using integration of layout information and textual information. In: ACL. (1998) [find](https://scholar.google.com/scholar?q=Watanabe%2C+Y%2E%2C+Nagao%2C+M%2E%3A+Diagram+understanding+using+integration+of+layout+information+and+textual+information%2E+In%3A+ACL%2E+%281998%29)
4. O’Gorman, L., Kasturi, R.: Document Image Analysis. IEEE Computer Society Executive Briefings (1997) [find](https://scholar.google.com/scholar?q=O%E2%80%99Gorman%2C+L%2E%2C+Kasturi%2C+R%2E%3A+Document+Image+Analysis%2E+IEEE+Computer+Society+Executive+Briefings+%281997%29)
5. Futrelle, R.P., Shao, M., Cieslik, C., Grimes, A.E.: Extraction, layout analysis and classification of diagrams in pdf documents. In: ICDAR. (2003) [find](https://scholar.google.com/scholar?q=Futrelle%2C+R%2EP%2E%2C+Shao%2C+M%2E%2C+Cieslik%2C+C%2E%2C+Grimes%2C+A%2EE%2E%3A+Extraction%2C+layout+analysis+and+classification+of+diagrams+in+pdf+documents%2E+In%3A+ICDAR%2E+%282003%29)
6. Seo, M.J., Hajishirzi, H., Farhadi, A., Etzioni, O.: Diagram understanding in geometry questions. In: AAAI. (2014) [find](https://scholar.google.com/scholar?q=Seo%2C+M%2EJ%2E%2C+Hajishirzi%2C+H%2E%2C+Farhadi%2C+A%2E%2C+Etzioni%2C+O%2E%3A+Diagram+understanding+in+geometry+questions%2E+In%3A+AAAI%2E+%282014%29)
7. von Engelhardt, J.: The language of graphics: A framework for the analysis of syntax and meaning in maps, charts and diagrams. Yuri Engelhardt (2002) [find](https://scholar.google.com/scholar?q=von+Engelhardt%2C+J%2E%3A+The+language+of+graphics%3A+A+framework+for+the+analysis+of+syntax+and+meaning+in+maps%2C+charts+and+diagrams%2E+Yuri+Engelhardt+%282002%29)
8. Zitnick, C.L., Parikh, D.: Bringing semantics into focus using visual abstraction. In: CVPR. (2013) [find](https://scholar.google.com/scholar?q=Zitnick%2C+C%2EL%2E%2C+Parikh%2C+D%2E%3A+Bringing+semantics+into+focus+using+visual+abstraction%2E+In%3A+CVPR%2E+%282013%29)
9. Zhang, P., Goyal, Y., Summers-Stay, D., Batra, D., Parikh, D.: Yin and yang: Balancing and answering binary visual questions. CoRR abs/1511.05099 (2015) — [arXiv:1511.05099](https://arxiv.org/abs/1511.05099) [find](https://scholar.google.com/scholar?q=Zhang%2C+P%2E%2C+Goyal%2C+Y%2E%2C+Summers%2DStay%2C+D%2E%2C+Batra%2C+D%2E%2C+Parikh%2C+D%2E%3A+Yin+and+yang%3A+Balancing+and+answering+binary+visual+questions%2E+CoRR+abs%2F1511%2E05099+%282015%29+%E2%80%94+%5BarXiv%3A1511%2E05099%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1511)
10. Vedantam, R., Lin, X., Batra, T., Zitnick, C.L., Parikh, D.: Learning common sense through visual abstraction. In: ICCV. (2015) [find](https://scholar.google.com/scholar?q=Vedantam%2C+R%2E%2C+Lin%2C+X%2E%2C+Batra%2C+T%2E%2C+Zitnick%2C+C%2EL%2E%2C+Parikh%2C+D%2E%3A+Learning+common+sense+through+visual+abstraction%2E+In%3A+ICCV%2E+%282015%29)
11. Antol, S., Zitnick, C.L., Parikh, D.: Zero-shot learning via visual abstraction. In: ECCV. (2014) [find](https://scholar.google.com/scholar?q=Antol%2C+S%2E%2C+Zitnick%2C+C%2EL%2E%2C+Parikh%2C+D%2E%3A+Zero%2Dshot+learning+via+visual+abstraction%2E+In%3A+ECCV%2E+%282014%29)
12. Tu, Z., Chen, X., Yuille, A.L., Zhu, S.C.: Image parsing: Unifying segmentation, detection, and recognition. In: CLOR. (2003) [find](https://scholar.google.com/scholar?q=Tu%2C+Z%2E%2C+Chen%2C+X%2E%2C+Yuille%2C+A%2EL%2E%2C+Zhu%2C+S%2EC%2E%3A+Image+parsing%3A+Unifying+segmentation%2C+detection%2C+and+recognition%2E+In%3A+CLOR%2E+%282003%29)
13. Zhu, S.C., Mumford, D.: A stochastic grammar of images. Foundations and Trends in Computer Graphics and Vision 2 (2006) 259–362 [find](https://scholar.google.com/scholar?q=Zhu%2C+S%2EC%2E%2C+Mumford%2C+D%2E%3A+A+stochastic+grammar+of+images%2E+Foundations+and+Trends+in+Computer+Graphics+and+Vision+2+%282006%29+259%E2%80%93362)
14. Martinovic, A., Gool, L.J.V.: Bayesian grammar learning for inverse procedural modeling. In: CVPR. (2013) [find](https://scholar.google.com/scholar?q=Martinovic%2C+A%2E%2C+Gool%2C+L%2EJ%2EV%2E%3A+Bayesian+grammar+learning+for+inverse+procedural+modeling%2E+In%3A+CVPR%2E+%282013%29)
15. Pirsiavash, H., Ramanan, D.: Parsing videos of actions with segmental grammars. In: CVPR. (2014) [find](https://scholar.google.com/scholar?q=Pirsiavash%2C+H%2E%2C+Ramanan%2C+D%2E%3A+Parsing+videos+of+actions+with+segmental+grammars%2E+In%3A+CVPR%2E+%282014%29)
16. Choi, W., Chao, Y.W., Pantofaru, C., Savarese, S.: Understanding indoor scenes using 3d geometric phrases. In: CVPR. (2013) [find](https://scholar.google.com/scholar?q=Choi%2C+W%2E%2C+Chao%2C+Y%2EW%2E%2C+Pantofaru%2C+C%2E%2C+Savarese%2C+S%2E%3A+Understanding+indoor+scenes+using+3d+geometric+phrases%2E+In%3A+CVPR%2E+%282013%29)
17. Socher, R., Lin, C.C.Y., Ng, A.Y., Manning, C.D.: Parsing natural scenes and natural language with recursive neural networks. In: ICML. (2011) [find](https://scholar.google.com/scholar?q=Socher%2C+R%2E%2C+Lin%2C+C%2EC%2EY%2E%2C+Ng%2C+A%2EY%2E%2C+Manning%2C+C%2ED%2E%3A+Parsing+natural+scenes+and+natural+language+with+recursive+neural+networks%2E+In%3A+ICML%2E+%282011%29)
18. Weston, J., Bordes, A., Chopra, S., Mikolov, T.: Towards ai-complete question answering: A set of prerequisite toy tasks. CoRR abs/1502.05698 (2015) [find](https://scholar.google.com/scholar?q=Weston%2C+J%2E%2C+Bordes%2C+A%2E%2C+Chopra%2C+S%2E%2C+Mikolov%2C+T%2E%3A+Towards+ai%2Dcomplete+question+answering%3A+A+set+of+prerequisite+toy+tasks%2E+CoRR+abs%2F1502%2E05698+%282015%29) [our card](https://md.research.elamur.ai/free/en/papers/weston-2015-towards-ai-complete-question-answering/)
19. Richardson, M., Burges, C.J.C., Renshaw, E.: Mctest: A challenge dataset for the open-domain machine comprehension of text. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, EMNLP 2013, 18-21 October 2013, Grand Hyatt Seattle, Seattle, Washington, USA, A mee… [find](https://scholar.google.com/scholar?q=Richardson%2C+M%2E%2C+Burges%2C+C%2EJ%2EC%2E%2C+Renshaw%2C+E%2E%3A+Mctest%3A+A+challenge+dataset+for+the+open%2Ddomain+machine+comprehension+of+text%2E+In%3A+Proceedings+of+the+2013+Conference+on+Empirical+Methods+in+Natural+Langu) [our card](https://md.research.elamur.ai/free/en/papers/missing-2013-richardson-mctest-challenge-dataset-open-domain/)
20. Hermann, K.M., Kocisky, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., Blunsom, P.: Teaching machines to read and comprehend. In: Advances in Neural Information Processing Systems. (2015) 1684–1692 [find](https://scholar.google.com/scholar?q=Hermann%2C+K%2EM%2E%2C+Kocisky%2C+T%2E%2C+Grefenstette%2C+E%2E%2C+Espeholt%2C+L%2E%2C+Kay%2C+W%2E%2C+Suleyman%2C+M%2E%2C+Blunsom%2C+P%2E%3A+Teaching+machines+to+read+and+comprehend%2E+In%3A+Advances+in+Neural+Information+Processing+Systems%2E+%282015%29+) [our card](https://md.research.elamur.ai/free/en/papers/hermann-2015-teaching-machines-read-comprehend/)
21. Sukhbaatar, S., Weston, J., Fergus, R., et al.: End-to-end memory networks. In: Advances in Neural Information Processing Systems. (2015) 2431–2439 [find](https://scholar.google.com/scholar?q=Sukhbaatar%2C+S%2E%2C+Weston%2C+J%2E%2C+Fergus%2C+R%2E%2C+et+al%2E%3A+End%2Dto%2Dend+memory+networks%2E+In%3A+Advances+in+Neural+Information+Processing+Systems%2E+%282015%29+2431%E2%80%932439)
22. Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Lawrence Zitnick, C., Parikh, D.: Vqa: Visual question answering. In: Proceedings of the IEEE International Conference on Computer Vision. (2015) 2425–2433 [find](https://scholar.google.com/scholar?q=Antol%2C+S%2E%2C+Agrawal%2C+A%2E%2C+Lu%2C+J%2E%2C+Mitchell%2C+M%2E%2C+Batra%2C+D%2E%2C+Lawrence+Zitnick%2C+C%2E%2C+Parikh%2C+D%2E%3A+Vqa%3A+Visual+question+answering%2E+In%3A+Proceedings+of+the+IEEE+International+Conference+on+Computer+Vision%2E+%28201)
23. Ren, M., Kiros, R., Zemel, R.: Exploring models and data for image question answering. In: Advances in Neural Information Processing Systems. (2015) 2935– 2943 [find](https://scholar.google.com/scholar?q=Ren%2C+M%2E%2C+Kiros%2C+R%2E%2C+Zemel%2C+R%2E%3A+Exploring+models+and+data+for+image+question+answering%2E+In%3A+Advances+in+Neural+Information+Processing+Systems%2E+%282015%29+2935%E2%80%93+2943)
24. Zhu, Y., Groth, O., Bernstein, M.S., Fei-Fei, L.: Visual7w: Grounded question answering in images. CoRR abs/1511.03416 (2015) [find](https://scholar.google.com/scholar?q=Zhu%2C+Y%2E%2C+Groth%2C+O%2E%2C+Bernstein%2C+M%2ES%2E%2C+Fei%2DFei%2C+L%2E%3A+Visual7w%3A+Grounded+question+answering+in+images%2E+CoRR+abs%2F1511%2E03416+%282015%29) [our card](https://md.research.elamur.ai/free/en/papers/zhu-2015-visual7w-grounded-question-answering-images/)
25. Andreas, J., Rohrbach, M., Darrell, T., Klein, D.: Learning to compose neural networks for question answering. arXiv preprint arXiv:1601.01705 (2016) [find](https://scholar.google.com/scholar?q=Andreas%2C+J%2E%2C+Rohrbach%2C+M%2E%2C+Darrell%2C+T%2E%2C+Klein%2C+D%2E%3A+Learning+to+compose+neural+networks+for+question+answering%2E+arXiv+preprint+arXiv%3A1601%2E01705+%282016%29) [our card](https://md.research.elamur.ai/free/en/papers/andreas-2016-learning-compose-neural-networks-question/)
26. Noh, H., Seo, P.H., Han, B.: Image question answering using convolutional neural network with dynamic parameter prediction. arXiv preprint arXiv:1511.05756 (2015) — [arXiv:1511.05756](https://arxiv.org/abs/1511.05756) [find](https://scholar.google.com/scholar?q=Noh%2C+H%2E%2C+Seo%2C+P%2EH%2E%2C+Han%2C+B%2E%3A+Image+question+answering+using+convolutional+neural+network+with+dynamic+parameter+prediction%2E+arXiv+preprint+arXiv%3A1511%2E05756+%282015%29+%E2%80%94+%5BarXiv%3A1511%2E05756%5D%28https%3A%2F%2Farxiv%2Eor)
27. Horn, R.: Visual language: Global communication for the 21st century. Century. Brainbridge Island, WA, MacroVU (1998) [find](https://scholar.google.com/scholar?q=Horn%2C+R%2E%3A+Visual+language%3A+Global+communication+for+the+21st+century%2E+Century%2E+Brainbridge+Island%2C+WA%2C+MacroVU+%281998%29)
28. Card, S.K., Mackinlay, J.D., Shneiderman, B.: Readings in information visualization: using vision to think. Morgan Kaufmann (1999) [find](https://scholar.google.com/scholar?q=Card%2C+S%2EK%2E%2C+Mackinlay%2C+J%2ED%2E%2C+Shneiderman%2C+B%2E%3A+Readings+in+information+visualization%3A+using+vision+to+think%2E+Morgan+Kaufmann+%281999%29)
29. Twyman, M.: A schema for the study of graphic language (tutorial paper). In: Processing of visible language. Springer (1979) 117–150 [find](https://scholar.google.com/scholar?q=Twyman%2C+M%2E%3A+A+schema+for+the+study+of+graphic+language+%28tutorial+paper%29%2E+In%3A+Processing+of+visible+language%2E+Springer+%281979%29+117%E2%80%93150)
30. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Computation 9 (1997) 1735–1780 [find](https://scholar.google.com/scholar?q=Hochreiter%2C+S%2E%2C+Schmidhuber%2C+J%2E%3A+Long+short%2Dterm+memory%2E+Neural+Computation+9+%281997%29+1735%E2%80%931780)
31. Arbelaez, P.A., Pont-Tuset, J., Barron, J.T., Marques, F., Malik, J.: Multiscale combinatorial grouping. In: CVPR. (2014) [find](https://scholar.google.com/scholar?q=Arbelaez%2C+P%2EA%2E%2C+Pont%2DTuset%2C+J%2E%2C+Barron%2C+J%2ET%2E%2C+Marques%2C+F%2E%2C+Malik%2C+J%2E%3A+Multiscale+combinatorial+grouping%2E+In%3A+CVPR%2E+%282014%29)
32. Zitnick, C.L., r, P.D.: Edge boxes: Locating object proposals from edges. In: ECCV. (2014) [find](https://scholar.google.com/scholar?q=Zitnick%2C+C%2EL%2E%2C+r%2C+P%2ED%2E%3A+Edge+boxes%3A+Locating+object+proposals+from+edges%2E+In%3A+ECCV%2E+%282014%29)
33. Alexe, B., Deselaers, T., Ferrari, V.: Measuring the objectness of image windows. IEEE Trans. Pattern Anal. Mach. Intell. 34 (2012) 2189–2202 [find](https://scholar.google.com/scholar?q=Alexe%2C+B%2E%2C+Deselaers%2C+T%2E%2C+Ferrari%2C+V%2E%3A+Measuring+the+objectness+of+image+windows%2E+IEEE+Trans%2E+Pattern+Anal%2E+Mach%2E+Intell%2E+34+%282012%29+2189%E2%80%932202)
34. Uijlings, J.R.R., van de Sande, K.E.A., Gevers, T., Smeulders, A.W.M.: Selective search for object recognition. International Journal of Computer Vision 104 (2013) 154–171 [find](https://scholar.google.com/scholar?q=Uijlings%2C+J%2ER%2ER%2E%2C+van+de+Sande%2C+K%2EE%2EA%2E%2C+Gevers%2C+T%2E%2C+Smeulders%2C+A%2EW%2EM%2E%3A+Selective+search+for+object+recognition%2E+International+Journal+of+Computer+Vision+104+%282013%29+154%E2%80%93171)
35. Kokkinos, I.: Highly accurate boundary detection and grouping. In: CVPR. (2010) [find](https://scholar.google.com/scholar?q=Kokkinos%2C+I%2E%3A+Highly+accurate+boundary+detection+and+grouping%2E+In%3A+CVPR%2E+%282010%29)
36. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014) [find](https://scholar.google.com/scholar?q=Simonyan%2C+K%2E%2C+Zisserman%2C+A%2E%3A+Very+deep+convolutional+networks+for+large%2Dscale+image+recognition%2E+CoRR+abs%2F1409%2E1556+%282014%29) [our card](https://md.research.elamur.ai/free/en/papers/simonyan-2014-very-deep-convolutional-networks-large/)
37. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS. (2012) [find](https://scholar.google.com/scholar?q=Krizhevsky%2C+A%2E%2C+Sutskever%2C+I%2E%2C+Hinton%2C+G%2EE%2E%3A+Imagenet+classification+with+deep+convolutional+neural+networks%2E+In%3A+NIPS%2E+%282012%29)
38. Microsoft: Project oxford. [https://www.projectoxford.ai/](https://www.projectoxford.ai/) [↗](https://www.projectoxford.ai/)
39. de Campos, T.E., Babu, B.R., Varma, M.: Character recognition in natural images. In: Proceedings of the International Conference on Computer Vision Theory and Applications, Lisbon, Portugal. (February 2009) [find](https://scholar.google.com/scholar?q=de+Campos%2C+T%2EE%2E%2C+Babu%2C+B%2ER%2E%2C+Varma%2C+M%2E%3A+Character+recognition+in+natural+images%2E+In%3A+Proceedings+of+the+International+Conference+on+Computer+Vision+Theory+and+Applications%2C+Lisbon%2C+Portugal%2E+%28February)
40. Tesseract: Open source ocr engine. [https://github.com/tesseract-ocr/tesseract](https://github.com/tesseract-ocr/tesseract) [↗](https://github.com/tesseract-ocr/tesseract)
41. Nair, V., Hinton, G.E.: Rectified linear units improve restricted boltzmann machines. In: ICML. (2010) [find](https://scholar.google.com/scholar?q=Nair%2C+V%2E%2C+Hinton%2C+G%2EE%2E%3A+Rectified+linear+units+improve+restricted+boltzmann+machines%2E+In%3A+ICML%2E+%282010%29)
42. Tieleman, T., Hinton, G.E.: Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude. COURSERA: Neural Networks for Machine Learning (2012) [find](https://scholar.google.com/scholar?q=Tieleman%2C+T%2E%2C+Hinton%2C+G%2EE%2E%3A+Lecture+6%2E5%2Drmsprop%3A+Divide+the+gradient+by+a+running+average+of+its+recent+magnitude%2E+COURSERA%3A+Neural+Networks+for+Machine+Learning+%282012%29)
43. Redmon, J., Divvala, S.K., Girshick, R.B., Farhadi, A.: You only look once: Unified, real-time object detection. CoRR abs/1506.02640 (2015) — [arXiv:1506.02640](https://arxiv.org/abs/1506.02640) [find](https://scholar.google.com/scholar?q=Redmon%2C+J%2E%2C+Divvala%2C+S%2EK%2E%2C+Girshick%2C+R%2EB%2E%2C+Farhadi%2C+A%2E%3A+You+only+look+once%3A+Unified%2C+real%2Dtime+object+detection%2E+CoRR+abs%2F1506%2E02640+%282015%29+%E2%80%94+%5BarXiv%3A1506%2E02640%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1506%2E02640%29)
44. Pennington, J., Socher, R., Manning, C.D.: Glove: Global vectors for word representation. In: Empirical Methods in Natural Language Processing (EMNLP). (2014) 1532–1543 [find](https://scholar.google.com/scholar?q=Pennington%2C+J%2E%2C+Socher%2C+R%2E%2C+Manning%2C+C%2ED%2E%3A+Glove%3A+Global+vectors+for+word+representation%2E+In%3A+Empirical+Methods+in+Natural+Language+Processing+%28EMNLP%29%2E+%282014%29+1532%E2%80%931543)
45. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014) [find](https://scholar.google.com/scholar?q=Simonyan%2C+K%2E%2C+Zisserman%2C+A%2E%3A+Very+deep+convolutional+networks+for+large%2Dscale+image+recognition%2E+CoRR+abs%2F1409%2E1556+%282014%29) [our card](https://md.research.elamur.ai/free/en/papers/simonyan-2014-very-deep-convolutional-networks-large/)
46. Chollet, F.: Keras. [https://github.com/fchollet/keras](https://github.com/fchollet/keras) (2015) [↗](https://github.com/fchollet/keras)
47. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Levenberg, J., Mané, D., Monga, R., Moore, S., Murray, D., Olah, C., Sc… [find](https://scholar.google.com/scholar?q=Abadi%2C+M%2E%2C+Agarwal%2C+A%2E%2C+Barham%2C+P%2E%2C+Brevdo%2C+E%2E%2C+Chen%2C+Z%2E%2C+Citro%2C+C%2E%2C+Corrado%2C+G%2ES%2E%2C+Davis%2C+A%2E%2C+Dean%2C+J%2E%2C+Devin%2C+M%2E%2C+Ghemawat%2C+S%2E%2C+Goodfellow%2C+I%2E%2C+Harp%2C+A%2E%2C+Irving%2C+G%2E%2C+Isard%2C+M%2E%2C+Jia%2C+Y%2E%2C+Jozefowicz%2C+)
48. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: Machine learning in Python. Journal of Machine Learning Research 1… [find](https://scholar.google.com/scholar?q=Pedregosa%2C+F%2E%2C+Varoquaux%2C+G%2E%2C+Gramfort%2C+A%2E%2C+Michel%2C+V%2E%2C+Thirion%2C+B%2E%2C+Grisel%2C+O%2E%2C+Blondel%2C+M%2E%2C+Prettenhofer%2C+P%2E%2C+Weiss%2C+R%2E%2C+Dubourg%2C+V%2E%2C+Vanderplas%2C+J%2E%2C+Passos%2C+A%2E%2C+Cournapeau%2C+D%2E%2C+Brucher%2C+M%2E%2C+Perrot%2C)