--- title: "Polite Chatbot: A Text Style Transfer Application (2023)" description: "The paper tackles a practical gap in dialogue systems: making a chatbot answer… 83.27% accuracy. 2 references, cited by 15 papers here." authors: ["Sourabrata Mukherjee", "Vojtěch Hudeček", "Ondřej Dušek"] year: 2023 venue: "Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop" source: "https://aclanthology.org/2023.eacl-srw.9/" doi: "10.18653/v1/2023.eacl-srw.9" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/mukherjee-2023-polite-chatbot-text-style-transfer/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/mukherjee-2023-polite-chatbot-text-style-transfer/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/10/) / Polite Chatbot: A Text Style Transfer Application # Polite Chatbot: A Text Style Transfer Application **Authors:** Sourabrata Mukherjee, Vojtěch Hudeček and [Ondřej Dušek](https://md.research.elamur.ai/free/en/authors/ondrej-dusek/) · **Year:** 2023 · **Venue:** [Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop](https://md.research.elamur.ai/free/en/venues/eacl/) ([EACL 2023](https://md.research.elamur.ai/free/en/venues/eacl/2023/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2023.eacl-srw.9/) · [PDF](https://aclanthology.org/2023.eacl-srw.9.pdf) · [DOI 10.18653/v1/2023.eacl-srw.9](https://doi.org/10.18653/v1/2023.eacl-srw.9) · [OpenAlex](https://openalex.org/W4386566568) **Citations:** 8 citations (OpenAlex, 2026-10-14) · [15](https://md.research.elamur.ai/free/en/papers/mukherjee-2023-polite-chatbot-text-style-transfer/cited-by/) in our library, of the 149,439 papers whose bibliographies we read ## Summary The paper tackles a practical gap in dialogue systems: making a chatbot answer politely while staying on topic, even though no parallel corpus pairs ordinary replies with polite ones. The authors use a three-stage pipeline. First, they finetune BART as a politeness transfer model. Its training pairs are synthetic: following Madaan et al. (2020), politeness markers found via TF-IDF are deleted from very polite Enron sentences, and the model learns to restore them. Unlike the earlier tagger-plus-generator design, this happens in one seq2seq step. Second, they run this model over DailyDialog utterances to build a corpus of contexts paired with polite next turns. Third, they finetune GPT-2, DialoGPT and BlenderBot on that corpus. The result is an end-to-end polite responder that needs no post-processing. Both automatic metrics (a BERT politeness classifier, BLEU, Sentence-BERT similarity) and a small human study show higher politeness than baselines, with only a modest loss in coherence to context. The value of the work is that a simple data-centric recipe can replace more complex multi-step or reinforcement-learning approaches. ## Key points - **Politeness transfer results:** on the Madaan et al. (2020) Enron test data, the single-step BART transfer model beats the two-module baseline on all three metrics. - Polite Score: 8.68 vs 7.01 - BLEU: 71.65 vs 60.16 - Content Similarity: 93.25 vs 87.86 - **Synthetic DailyDialog corpus:** the authors' transfer model lifts the Polite Score from 5.41 (source data) to 7.95, compared with 6.37 for Madaan et al. Content similarity to the source utterances stays high: BLEU 70.21, CS 89.07. - **Data used:** - DailyDialog has 13,118 dialogues, split into 11,118 train, 1,000 validation and 1,000 test, with about 7.9 turns per dialogue. - The Enron data is sorted into ten politeness buckets, P0–P9, and only the most polite bucket (P9) is used to create training pairs. - **Politeness classifier:** the BERT-based scorer reaches 83.27% accuracy. Its errors fall mostly into adjacent buckets, with an average error of 0.98 buckets. - **Human evaluation:** 50 test contexts were rated on BlenderBot outputs using a 1–5 Likert scale. - Politeness: 4.26 for the authors' model, the highest of all systems; plain DailyDialog finetuning scored 3.90. - Coherence to context: 2.94, below plain DailyDialog finetuning at 3.74. - Fluency: 4.30. ## Interesting ideas - Parallel training data for a style can be manufactured by deleting the phrases that statistically separate a styled text from a plain one and training a model to restore them; this needs no human-paired corpus. - Phrases whose mean TF-IDF is much higher in polite texts than in non-polite ones act as an automatically mined lexicon of politeness markers. - The desired style is baked into the training corpus up front, so the final model is end-to-end and needs no post-editing step at inference time. - Politeness is scored on ordered buckets, and errors are reported as the average distance between predicted and true bucket rather than raw accuracy alone, which shows that most mistakes are near misses. - Pairing lenient automatic metrics (BLEU-1/2, embedding similarity) with human ratings exposed a trade-off that the automatic scores hid: higher politeness came with lower coherence to context. ## For Mova How these ideas could serve Mova, our small open language model — its files, stages and tests: - **I1** (back): the same delete-and-restore trick could produce training pairs for turning a bare, meaning-faithful generated sentence into a register-appropriate one, without hand-written parallel text. - **I2** (frames): such a mined marker list could feed the speech-act and pragmatics layer in crate prag as explainable cues for politeness or indirectness, rather than an opaque classifier. - **I3** (learn): when silver data is prepared, normalisations or repairs can be applied to the data once, rather than bolted on as runtime rules, keeping the deployed pipeline simpler. - **I4** (learn): graded judgments such as confidence levels or parse-quality tiers could be evaluated by distance-aware error, separating harmless near misses from real failures. - **I5** (answer): reader and QA evaluations should include a human or control check of relevance, so that gains in surface quality are not mistaken for better answers. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Charles University](https://md.research.elamur.ai/free/en/universities/charles-university/) — University, Prague, Czechia · 133 works · 20,686 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works 🧭 Topics (1): [🗨️ Dialogue systems](https://md.research.elamur.ai/free/en/topics/dialogue-systems/) · 624 works ## Cite Cite as: Sourabrata Mukherjee, Vojtěch Hudeček and Ondřej Dušek. 2023. Polite Chatbot: A Text Style Transfer Application. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{mukherjee2023polite, title = {{Polite Chatbot: A Text Style Transfer Application}}, author = {Sourabrata Mukherjee, Vojtěch Hudeček and Ondřej Dušek}, booktitle = {Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop}, year = {2023}, doi = {10.18653/v1/2023.eacl-srw.9}, url = {https://doi.org/10.18653/v1/2023.eacl-srw.9} } ``` - [← previous PAL to Lend a Helping Hand: Towards Building an Emotion Adaptive Polite and Empathetic Counseling Conversational Agent](https://md.research.elamur.ai/free/en/papers/mishra-2023-pal-lend-helping-hand-building/) - [next → UniCoRN: Unified Cognitive Signal ReconstructioN bridging cognitive signals and human language](https://md.research.elamur.ai/free/en/papers/xi-2023-unicorn-unified-cognitive-signal-reconstruction/) - [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/10/) ## References 2 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Elisabeth André, Matthias Rehm, Wolfgang Minker, and Dirk Bühler. 2004. Endowing spoken language dialogue systems with emotional intelligence. In Affective Dialogue Systems, Tutorial and Research Workshop, ADS 2004, Kloster Irsee, Germany, June 14-16, 2004, Proceedings, volume 3068 of Lecture Notes in Computer Science, pages 178–187. Springer. [find](https://scholar.google.com/scholar?q=Elisabeth+Andr%C3%A9%2C+Matthias+Rehm%2C+Wolfgang+Minker%2C+and+Dirk+B%C3%BChler%2E+2004%2E+Endowing+spoken+language+dialogue+systems+with+emotional+intelligence%2E+In+Affective+Dialogue+Systems%2C+Tutorial+and+Research+Work) 2. Liz Coppock. 2005. Politeness strategies in conversation closings. Unpublished manuscript: Stanford University. [find](https://scholar.google.com/scholar?q=Liz+Coppock%2E+2005%2E+Politeness+strategies+in+conversation+closings%2E+Unpublished+manuscript%3A+Stanford+University%2E) *Updated 29 October 2026*