Dr. Johannes Kiesel

GESIS – Leibniz Institute for the Social Sciences, Cologne

Topics: Conversational AI, Computational Argumentation, Human Values, Methods Hub, User Simulation

I am the leader of team BDA at GESIS - Leibniz Institute for the Social Sciences in Cologne, Germany since 2025. Before that I have been a Post-Doc and researcher at the Bauhaus-Universität Weimar. I am service infrastructure manager of the Methods Hub. I have been a PI of the project Futuring Machines (2024).

Reviewing and Service
  • I have served on the program committees or as reviewer for the Web Conference alternate track on Journalism, Misinformation, and Fact Checking (2018), AIKG-SD (2026), ARR (2024, 2025, 2026), ArgMining (2021, 2023, 2025), CAIR (2020), CHI (2019, 2023), CHIIR (2024, 2026), CIKM (2020, 2021, 2022, 2026), CLEF (2014, 2016, 2025), CLEF Labs (2022, 2023, 2024, 2025), COLING-LREC (2024), CUI (2022, 2024), DBSpektrum (2015), EACL (2017), ECIR (2018, 2020, 2023, 2024, 2026), EMNLP (2016), HCOMP (2018), HT (2020), IJCAI (2023), KDML-LWDA (2016), NAACL (2016), PAN (2019), SemEval (2019), SIGIR (2016, 2021, 2023, 2024, 2025, 2026), Springer World Wide Web (2024, 2025), TOIS (2020, 2022, 2023), Touché (2022, 2023, 2024), TPDL (2022, 2023, 2024, 2025), WebConf (2026), WebSci (2026), and WIR-LWDA (2016).
  • I have served as reviewer for ANR (2026).
  • I have served on the best paper committee of CLEF (2026).
  • I am a member of the SIGIR Artifact Evaluation Committee since 2021.
  • I have been a member of the parent's council of the Kindergarten associated with Bauhaus-Universität Weimar (2019–2025, vice-chair 2021–2024, chair 2024–2025).


Publications

2026^

  • Christina Viehmann, Johannes Kiesel, Arnim Bleier, Chung-hong Chan, Po-Chun Chang, Raniere Gaia Costa da Silva, Ahrabhi Kathirgamalingam, Muhammad Taimoor Khan, Stephan Linzbach, Fakhri Momeni, Felix Victor Münch, Ran Yu, Stefan Dietze, and Claudia Wagner. 2026. Methods Hub: A Community‐Driven, Interactive Platform for Open‐Source Computational Tools and Tutorials. Media and Communication 14 (October 2026), 21 pages. doi
  • Johannes Kiesel, Marc Feger, Tim Hagen, Sebastian Heineking, Maximilian Heinrich, Maik Fröbe, Katarina Boland, Christine Mathews, Wilhelm Pertsch, Julia Romberg, Ines Zelch, Stefan Dietze, Matthias Hagen, Martin Potthast, and Benno Stein. 2026. Overview of Touché 2026: Argumentation Systems. In Experimental IR Meets Multilinguality, Multimodality, and Interaction. 17th International Conference of the CLEF Association (CLEF 2026), September, 2026, Jena, Germany. Springer, 678–702. doi version ecir abstract version clef worknotes
  • Mario Scharfbillig et al. 2026. ValuesML: A new multilingual dataset for values detection in news and political manifestos. Behavior Research Methods 58, 10 (August 2026). doi
  • Maximilian Heinrich, Sharat Anand, Johannes Kiesel, and Benno Stein. 2026. Illustrating Arguments with Images Using Aspect-Aware Prompting. In 13th Workshop on Argument Mining and Reasoning (ArgMining 26), July, 2026, San Diego, USA. ACL, 52–65. doi
  • Zahra Abbasiantaeb, Simon Lupart, Marcel Gohsen, Nailia Mirzakhmedova, Johannes Kiesel, Jeffrey Dalton, and Mohammad Aliannejadi. 2026. TREC iKAT 2025: A Test Collection for the Offline and Interactive Evaluation of Conversational Search. In 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2026), July, 2026, Melbourne, Australia. ACM, 3092–3100. code doi
  • Marcel Gohsen, Nailia Mirzakhmedova, Zahra Abbasiantaeb, Johannes Kiesel, Simon Lupart, Jeffrey Dalton, Benno Stein, and Mohammad Aliannejadi. 2026. Sim.API: A Middleware to Simplify the Use of User Simulators for Shared Tasks in Conversational Search. In 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2026), July, 2026, Melbourne, Australia. ACM, 3190–3197. doi
  • Nailia Mirzakhmedova, Marcel Gohsen, Johannes Kiesel, and Benno Stein. 2026. Do Simulated Users Need to Remember? Analyzing the Impact of Memory Models in Conversational Search Evaluation. In 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2026), July, 2026, Melbourne, Australia. ACM, 1359–1370. doi
  • Johannes Kiesel, Christina Viehmann, Felix Victor Münch, Arnim Bleier, Chung-hong Chan, Po-Chun Chang, Raniere Gaia Costa da Silva, Ahrabhi Kathirgamalingam, Muhammad Taimoor Khan, Stephan Linzbach, Fakhri Momeni, Ran Yu, Claudia Wagner, and Stefan Dietze. 2026. The Methods Hub: A Community Portal for Finding and Re-Using Methods. In 18th ACM Web Science Conference (WebSci 2026 Companion), May, 2026, Braunschweig, Germany. ACM, 15–19. doi
  • Fakhri Momeni, Sarah Sajid, and Johannes Kiesel. 2026. From Guidelines to Practice: Evaluating the Reproducibility of Methods in Computational Social Science. In 18th ACM Web Science Conference (WebSci 2026), May, 2026, Braunschweig, Germany. ACM, 398–408. doi
  • Arnim Bleier, Johannes Kiesel, Christina Viehmann, Felix Victor Münch, Chung-hong Chan, Po-Chun Chang, Raniere Gaia Costa da Silva, Ahrabhi Kathirgamalingam, Muhammad Taimoor Khan, Stephan Linzbach, Fakhri Momeni, Ran Yu, Stefan Dietze, and Claudia Wagner. 2026. Improving Reproducibility in Computational Social Science with the Methods Hub. In 20th International Conference on Web and Social Media (ICWSM 2026), May, 2026, Los Angeles, USA. AAAI Press. doi
  • Matthias Hagen et al. 2026. Retrieval-Augmented Generation -- The Future of Search? (Dagstuhl Seminar 25391). Dagstuhl Reports 15, 9 (May 2026), 71–159. doi
  • Marcel Gohsen, Nicola Lea Libera, Johannes Kiesel, Jan Ehlers, and Benno Stein. 2026. Does Cognitive Load Affect Human Accuracy in Detecting Voice-Based Deepfakes. In 11th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2026), March, 2026, Seattle, USA. ACM, 62–72. data doi

2025^

  • Christine Bauer et al. 2025. Conversational Agents: A Framework for Evaluation (CAFE) (Dagstuhl Perspectives Workshop 24352). Dagstuhl Manifestos 11, 1 (December 2025), 19–67. doi
  • Marcel Gohsen, Zahra Abbasiantaeb, Mohammad Aliannejadi, Krisztian Balog, Timo Breuer, Jeffrey Dalton, Maik Fröbe, Christin Kreutz, Andreas Kruff, Simon Lupart, Nailia Mirzakhmedova, Harrisen Scells, Philipp Schaer, Benno Stein, and Johannes Kiesel. 2025. User Simulation in Practice: Lessons Learned from Three Shared Tasks. SIGIR Forum 59, 2 (December 2025), 18 pages. doi
  • Muhammad Taimoor Khan, Johannes Kiesel, Dimitar Dimitrov, and Stefan Dietze. 2025. Understanding Discourse-Topic Dependent Data Loss in Social Media Archives. In 2nd MethodsNET Conference (MethodsNET 2025), September, 2025, Louvain-la-Neuve, Belgium. Zenodo. doi
  • Bogdan Ionescu et al. 2025. Overview of ImageCLEF 2025: Multimedia Retrieval in Medical, Social Media and Content Recommendation Applications. In Experimental IR Meets Multilinguality, Multimodality, and Interaction. 16th International Conference of the CLEF Association (CLEF 2025), September, 2025, Madrid, Spain. Springer, Berlin Heidelberg New York, 290–314. data doi events version ecir abstract
  • Johannes Kiesel et al. 2025. Overview of Touché 2025: Argumentation Systems. In Experimental IR Meets Multilinguality, Multimodality, and Interaction. 16th International Conference of the CLEF Association (CLEF 2025), September, 2025, Madrid, Spain. Springer, Berlin Heidelberg New York, 486–508. data doi events slides version clef worknotes version ecir abstract
  • Midhun Kanadan, Johannes Kiesel, Maximilian Heinrich, and Benno Stein. 2025. Webis at CQs-Gen 2025: Prompting and Reranking for Critical Questions. In 12th Workshop on Argument Mining (ArgMining 2025) at ACL, July, 2025, Wien, Austria. Association for Computational Linguistics.
  • Ines Zelch, Matthias Hagen, Benno Stein, and Johannes Kiesel. 2025. Segmentation of Argumentative Texts by Key Statements for Argument Mining from the Web. In 12th Workshop on Argument Mining (ArgMining 2025) at ACL, July, 2025, Vienna, Austria. Association for Computational Linguistics, 228–242. doi poster
  • Ines Zelch, Matthias Hagen, Benno Stein, and Johannes Kiesel. 2025. Reproducing the Argument Quality Prediction of Project Debater. In 12th Workshop on Argument Mining (ArgMining 2025) at ACL, July, 2025, Vienna, Austria. Association for Computational Linguistics, 181–188. doi poster
  • Fakhri Momeni, Muhammad Taimoor Khan, Johannes Kiesel, and Tony Ross-Hellauer. 2025. Checklists for Computational Reproducibility in Social Sciences: Insights from Literature and Survey Evaluation. In 3rd ACM Conference for Reproducibility and Replicability (REP 2025), July, 2025, Vancouver, British Columbia, Canada. ACM, 179–191. doi

2024^

  • Bogdan Ionescu et al. 2024. Overview of the ImageCLEF 2024: Multimedia Retrieval in Medical Applications. In Experimental IR Meets Multilinguality, Multimodality, and Interaction. 15th International Conference of the CLEF Association (CLEF 2024), September, 2024, Grenoble, France. Springer, Berlin Heidelberg New York, 140–164. data doi events version ecir abstract
  • Johannes Kiesel, Çağrı Çöltekin, Maximilian Heinrich, Maik Fröbe, Milad Alshomary, Bertrand De Longueville, Tomaž Erjavec, Nicolas Handke, Matyáš Kopp, Nikola Ljubešić, Katja Meden, Nailia Mirzakhmedova, Vaidas Morkevičius, Theresa Reitis-Münstermann, Mario Scharfbillig, Nicolas Stefanovitch, Henning Wachsmuth, Martin Potthast, and Benno Stein. 2024. Overview of Touché 2024: Argumentation Systems. In Experimental IR Meets Multilinguality, Multimodality, and Interaction. 15th International Conference of the CLEF Association (CLEF 2024), September, 2024, Grenoble, France. Springer, Berlin Heidelberg New York, 308–332. data doi events poster slides version clef worknotes version ecir abstract
  • Johannes Kiesel, Marcel Gohsen, Nailia Mirzakhmedova, Matthias Hagen, and Benno Stein. 2024. Who Will Evaluate the Evaluators? Exploring the Gen-IR User Simulation Space. In Experimental IR Meets Multilinguality, Multimodality, and Interaction. 15th International Conference of the CLEF Initiative (CLEF 2024), September, 2024, Grenoble, France. Springer, Berlin Heidelberg New York. slides
  • Lukas Gienapp, Harrisen Scells, Niklas Deckers, Janek Bevendorff, Shuai Wang, Johannes Kiesel, Shahbaz Syed, Maik Fröbe, Guido Zuccon, Benno Stein, Matthias Hagen, and Martin Potthast. 2024. Evaluating Generative Ad Hoc Information Retrieval. In 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2023), July, 2024, Washington D.C., USA. ACM. doi slides
  • Jordi Tost, Marcel Gohsen, Britta Schulte, Fidel Thomet, Mattis Kuhn, Johannes Kiesel, Benno Stein, and Eva Hornecker. 2024. Futuring Machines: An Interactive Framework for Participative Futuring Through Human-AI Collaborative Speculative Fiction Writing. In 6th Conference on Conversational User Interfaces (CUI 2024), July, 2024, Luxembourg, Luxembourg. ACM. doi poster
  • Nailia Mirzakhmedova, Johannes Kiesel, Milad Alshomary, Maximilian Heinrich, Nicolas Handke, Xiaoni Cai, Valentin Barriere, Doratossadat Dastgheib, Omid Ghahroodi, Mohammad Ali Sadraei, Ehsaneddin Asgari, Lea Kawaletz, Henning Wachsmuth, and Benno Stein. 2024. The Touché23-ValueEval Dataset for Identifying Human Values behind Arguments. In Joint Conference of the 31st Conference on Computational Linguistics and 16th Conference on Language Resources and Evaluation (LREC-COLING 2024), May, 2024, Torino, Italy. International Committee on Computational Linguistics. data
  • Alexander Frummet, Andrea Papenmeier, Maik Fröbe, and Johannes Kiesel. 2024. 8th Workshop on Search-Oriented Conversational Artificial Intelligence (SCAI 2024). In 9th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2024), March, 2024, Sheffield, United Kingdon. Springer, 433–435. doi events
  • Johannes Kiesel, Marcel Gohsen, Nailia Mirzakhmedova, Matthias Hagen, and Benno Stein. 2024. Simulating Follow-up Questions in Conversational Search. In Advances in Information Retrieval. 46th European Conference on IR Research (ECIR 2024), March, 2024, Glasgow, Scotland. Springer. data doi slides

2023^

  • Islam Torky, Simon Ruth, Shashi Sharma, Mohamed Salama, Krishna Chaitanya, Tim Gollub, Johannes Kiesel, and Benno Stein. 2023. Webis @ ImageArg 2023: Embedding-based Stance and Persuasiveness Classification. In 10th Workshop on Argument Mining (ArgMining 2023) at EMNLP, December, 2023, Singapore. Association for Computational Linguistics.
  • Nailia Mirzakhmedova, Johannes Kiesel, Khalid Al-Khatib, and Benno Stein. 2023. Unveiling the Power of Argument Arrangement in Online Persuasive Discussions. In Findings of the Association for Computational Linguistics: EMNLP 2023, December, 2023, Singapore. Association for Computational Linguistics.
  • Alexander Bondarenko, Maik Fröbe, Johannes Kiesel, Ferdinand Schlatt, Valentin Barriere, Brian Ravenet, Léo Hemamou, Simon Luck, Jan Heinrich Reimer, Benno Stein, Martin Potthast, and Matthias Hagen. 2023. Overview of Touché 2023: Argument and Causal Retrieval. In Experimental IR Meets Multilinguality, Multimodality, and Interaction. 14th International Conference of the CLEF Association (CLEF 2023), September, 2023, Thessaloniki, Greece. Springer, Berlin Heidelberg New York. data doi events slides version clef worknotes version ecir abstract
  • Johannes Kiesel, Milad Alshomary, Nailia Mirzakhmedova, Maximilian Heinrich, Nicolas Handke, Henning Wachsmuth, and Benno Stein. 2023. SemEval-2023 Task 4: ValueEval: Identification of Human Values behind Arguments. In 17th International Workshop on Semantic Evaluation (SemEval 2023), July, 2023. Association for Computational Linguistics, Toronto, Canada, 2287–2303. data doi events slides
  • Janek Bevendorff, Sanket Gupta, Johannes Kiesel, and Benno Stein. 2023. An Empirical Comparison of Web Content Extraction Algorithms. In 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2023), July, 2023, Taipei, Taiwan. ACM, 2594–2603. doi
  • Miriam Louise Carnot, Lorenz Heinemann, Jan Braker, Tobias Schreieder, Johannes Kiesel, Maik Fröbe, Martin Potthast, and Benno Stein. 2023. On Stance Detection in Image Retrieval for Argumentation. In 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2023), July, 2023, Taipei, Taiwan. ACM, 2562–2571. data doi slides
  • Yamen Ajjour, Johannes Kiesel, Benno Stein, and Martin Potthast. 2023. Topic Ontologies for Arguments. In 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2023), May, 2023, Dubrovnik, Croatia. Association for Computational Linguistics. data poster slides
  • Niklas Deckers, Maik Fröbe, Johannes Kiesel, Gianluca Pandolfo, Christopher Schröder, Benno Stein, and Martin Potthast. 2023. The Infinite Index: Information Retrieval on Generative Text-To-Image Models. In 8th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2023), March, 2023, Austin, USA. ACM. data doi slides
  • Marcel Gohsen, Johannes Kiesel, Mariam Korashi, Jan Ehlers, and Benno Stein. 2023. Guiding Oral Conversations: How to Nudge Users Towards Asking Questions?. In 8th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2023), March, 2023, Austin, USA. ACM, New York, 34–42. data doi slides

2022^

  • Theresa Elstner, Johannes Kiesel, Lars Meyer, Max Martius, Sebastian Schmidt, Benno Stein, and Martin Potthast. 2022. Visual Web Archive Quality Assessment. In 26th International Conference on Theory and Practice of Digital Libraries (TPDL 2022), September, 2022, Padua. Springer, Berlin Heidelberg New York, 365–371. data doi slides
  • Alexander Bondarenko, Maik Fröbe, Johannes Kiesel, Shahbaz Syed, Timon Gurcke, Meriem Beloucif, Alexander Panchenko, Chris Biemann, Benno Stein, Henning Wachsmuth, Martin Potthast, and Matthias Hagen. 2022. Overview of Touché 2022: Argument Retrieval. In Experimental IR Meets Multilinguality, Multimodality, and Interaction. 13th International Conference of the CLEF Association (CLEF 2022), September, 2022, Bologna, Italy. Springer, Berlin Heidelberg New York. data doi events version clef worknotes version ecir abstract
  • Svitlana Vakulenko, Johannes Kiesel, and Maik Fröbe. 2022. SCAI-QReCC Shared Task on Conversational Question Answering. In 14th Language Resources and Evaluation Conference (LREC 2022), June, 2022, Marseille, France. European Language Resources Association (ELRA), Paris, France, 4913–4922. data events slides
  • Johannes Kiesel. 2022. Harnessing Web Archives to Tackle Selected Societal Challenges. Ph.D. Dissertation. Bauhaus-Universität Weimar, Weimar, Germany. doi slides
  • Johannes Kiesel, Milad Alshomary, Nicolas Handke, Xiaoni Cai, Henning Wachsmuth, and Benno Stein. 2022. Identifying the Human Values behind Arguments. In 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022), May, 2022, Dublin, Ireland. Association for Computational Linguistics, 4459–4471. data doi poster slides
  • Johannes Kiesel, Volker Bernhard, Marcel Gohsen, Josef Roth, and Benno Stein. 2022. What is That? Crowdsourcing Questions to a Virtual Exhibition. In 7th Conference on Human Information Interaction & Retrieval (CHIIR 2022), March, 2022, Regensburg, Germany. ACM, 358–362. data doi poster

2021^

  • Alexander Bondarenko, Maik Fröbe, Marcel Gohsen, Sebastian Günther, Johannes Kiesel, Jakob Schwerter, Shahbaz Syed, Michael Völske, Martin Potthast, Benno Stein, and Matthias Hagen. 2021. Webis at TREC 2021: Deep Learning, Health Misinformation, and Podcasts Tracks. In 30th International Text Retrieval Conference (TREC 2021), November, 2021, Gaithersburg, USA. National Institute of Standards and Technology (NIST). poster slides
  • Johannes Kiesel, Nico Reichenbach, Benno Stein, and Martin Potthast. 2021. Image Retrieval for Arguments Using Stance-Aware Query Expansion. In 8th Workshop on Argument Mining (ArgMining 2021) at EMNLP, November, 2021, Punta Cana, Dominican Republic. Association for Computational Linguistics, 36–45. data doi slides
  • Johannes Kiesel, Xiaoni Cai, Roxanne El Baff, Benno Stein, and Matthias Hagen. 2021. Toward Conversational Query Reformulation. In 2nd International Conference on Design of Experimental Search & Information Retrieval Systems (DESIRES 2021), September, 2021, Padua, Italy. 91–101. data slides video
  • Johannes Kiesel, Lars Meyer, Martin Potthast, and Benno Stein. 2021. Meta-Information in Conversational Search. ACM Transactions on Information Systems (ACM TOIS) 39, 4 (August 2021), 44 pages. data doi slides
  • Johannes Kiesel, Damiano Spina, Henning Wachsmuth, and Benno Stein. 2021. The Meant, the Said, and the Understood: Conversational Argument Search and Cognitive Biases. In 3rd Conference on Conversational User Interfaces (CUI 2021), July, 2021, Bilbao (online), Spain. ACM, New York. doi slides video
  • Damiano Spina, Johanne R. Trippas, Paul Thomas, Hideo Joho, Byström Katriina, Leigh Clark, Nick Craswell, Mary Czerwinski, David Elsweiler, Alexander Frummet, Souvick Ghosh, Johannes Kiesel, Irene Lopatovska, Daniel McDuff, Selina Meyer, Ahmed Mourad, Owoicho Paul, Pathiyan Sachin Cherumanal, Daniel Russell, and Laurianne Sitbon. 2021. Report on the Future Conversations Workshop at CHIIR 2021. SIGIR Forum 55, 1 (June 2021), 22 pages. doi
  • Johannes Kiesel, Lars Meyer, Florian Kneist, Benno Stein, and Martin Potthast. 2021. An Empirical Comparison of Web Page Segmentation Algorithms. In Advances in Information Retrieval. 43rd European Conference on IR Research (ECIR 2021), March, 2021, Lucca, Italy. Springer, Berlin Heidelberg New York, 62–74. code data doi slides video
  • Michael Völske, Janek Bevendorff, Johannes Kiesel, Benno Stein, Maik Fröbe, Matthias Hagen, and Martin Potthast. 2021. Web Archive Analytics. In 50. Jahrestagung der Gesellschaft für Informatik (INFORMATIK 2020), January, 2021, CERN, Geneva, Switzerland. Gesellschaft für Informatik, GI, 61–72. doi preprint

2020^

  • Shahbaz Syed, Roxanne El Baff, Khalid Al-Khatib, Johannes Kiesel, Benno Stein, and Martin Potthast. 2020. News Editorials: Towards Summarizing Long Argumentative Texts. In 28th International Conference on Computational Linguistics (COLING 2020), December, 2020, virtual event, Barcelona. Association for Computational Linguistics, Online. code data slides video
  • Johannes Kiesel, Florian Kneist, Lars Meyer, Kristof Komlossy, Benno Stein, and Martin Potthast. 2020. Web Page Segmentation Revisited: Evaluation Framework and Dataset. In 29th ACM International Conference on Information and Knowledge Management (CIKM 2020), October, 2020, virtual event, Ireland. ACM, 3047–3054. code data doi slides video
  • Michael Völske, Janek Bevendorff, Johannes Kiesel, Benno Stein, Maik Fröbe, Matthias Hagen, and Martin Potthast. 2020. Towards an Open Web Index: Lessons From the Past. In 2nd International Symposium on Open Search Technology (OSSYM 2020), October, 2020, CERN, Geneva, Switzerland. International Open Search Symposium. doi slides
  • Michael Völske, Janek Bevendorff, Johannes Kiesel, Benno Stein, Maik Fröbe, Matthias Hagen, and Martin Potthast. 2020. Web Archive Analytics: Infrastructure & Applications @ Webis (extended abstract). In 2nd International Symposium on Open Search Technology (OSSYM 2020), October, 2020, CERN, Geneva, Switzerland. International Open Search Symposium. doi poster
  • Johannes Kiesel, Kevin Lang, Henning Wachsmuth, Eva Hornecker, and Benno Stein. 2020. Investigating Expectations for Voice-based and Conversational Argument Search on the Web. In 5th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2020), March, 2020, Vancouver, British Columbia, Canada. ACM, 53–62. data doi slides video

2019^

  • Yamen Ajjour, Henning Wachsmuth, Johannes Kiesel, Martin Potthast, Matthias Hagen, and Benno Stein. 2019. Data Acquisition for Argument Search: The args.me corpus. In 42nd German Conference on Artificial Intelligence (KI 2019), September, 2019, Kassel, Germany. Springer, Berlin Heidelberg New York, 48–59. award data doi slides
  • Christina Lohr, Johannes Kiesel, Stephanie Luther, Johannes Hellrich, Benno Stein, and Udo Hahn. 2019. Continuous Annotation Quality Control, Support for Hierarchically Structured Label Sets and Long-Segment Annotation with WAT-SL 2.0. In 13th Linguistic Annotation Workshop (LAW 2019) at ACL, July, 2019, Florence, Italy. Association for Computational Linguistics. code poster
  • Johannes Kiesel, Maria Mestre, Rishabh Shukla, Emmanuel Vincent, Payam Adineh, David Corney, Benno Stein, and Martin Potthast. 2019. SemEval-2019 Task 4: Hyperpartisan News Detection. In 13th International Workshop on Semantic Evaluation (SemEval 2019), June, 2019, Minneapolis. Association for Computational Linguistics, 829–839. data doi events poster slides video
  • Johannes Kiesel, Fabienne Hubricht, Benno Stein, and Martin Potthast. 2019. A Dataset for Content Error Detection in Web Archives. In 18th ACM/IEEE Joint Conference on Digital Libraries (JCDL 2019), June, 2019, Urbana-Champaign. ACM, 349–350. award data doi poster slides
  • Johannes Kiesel, Arefeh Bahrami, Benno Stein, Avishek Anand, and Matthias Hagen. 2019. Clarifying False Memories in Voice-based Search. In 4th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2019), March, 2019, Glasgow, Scotland. ACM, 331–335. doi poster slides

2018^

  • Johannes Kiesel, Florian Kneist, Milad Alshomary, Benno Stein, Matthias Hagen, and Martin Potthast. 2018. Reproducible Web Corpora: Interactive Archiving with Automatic Quality Assessment. Journal of Data and Information Quality (JDIQ) 10, 4 (October 2018), 1–25. award code data doi
  • Johannes Kiesel, Arjen P. de Vries, Matthias Hagen, Benno Stein, and Martin Potthast. 2018. WASP: Web Archiving and Search Personalized. In 1st International Conference on Design of Experimental Search & Information Retrieval Systems (DESIRES 2018), August, 2018, Bertinoro. 16–21. code slides
  • Johannes Kiesel, Arefeh Bahrami, Benno Stein, Avishek Anand, and Matthias Hagen. 2018. Toward Voice Query Clarification. In 41st International ACM Conference on Research and Development in Information Retrieval (SIGIR 2018), July, 2018, Ann Arbor, MI. ACM, 1257–1260. doi poster
  • Martin Potthast, Johannes Kiesel, Kevin Reinartz, Janek Bevendorff, and Benno Stein. 2018. A Stylometric Inquiry into Hyperpartisan and Fake News. In 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018), July, 2018, Melbourne. Association for Computational Linguistics, 231–240. code data preprint slides video

2017^

  • Matthias Hagen, Yamen Ajjour, Johannes Kiesel, Payam Adineh, and Benno Stein. 2017. Webis at TREC 2017: Open Search and Core Tracks. In 26th International Text Retrieval Conference (TREC 2017), November, 2017, Gaithersburg, USA. National Institute of Standards and Technology (NIST).
  • Yamen Ajjour, Wei-Fan Chen, Johannes Kiesel, Henning Wachsmuth, and Benno Stein. 2017. Unit Segmentation of Argumentative Texts. In 4th Workshop on Argument Mining (ArgMining 2017) at EMNLP, September, 2017, Copenhagen, Denmark. Association for Computational Linguistics, 118–128. code doi
  • Matthias Hagen, Johannes Kiesel, Milad Alshomary, and Benno Stein. 2017. Webis at the CLEF 2017 Dynamic Search Lab. In Working Notes Papers of the CLEF 2017 Evaluation Labs, September, 2017, Dublin, Ireland.
  • Johannes Kiesel, Martin Potthast, Matthias Hagen, and Benno Stein. 2017. Spatio-temporal Analysis of Reverted Wikipedia Edits. In 11th International AAAI Conference on Web and Social Media (ICWSM 2017), May, 2017, Montreal, Canada. 122–131. award code slides video
  • Johannes Kiesel, Henning Wachsmuth, Khalid Al-Khatib, and Benno Stein. 2017. WAT-SL: A Customizable Web Annotation Tool for Segment Labeling. In Software Demonstrations at the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2017), April, 2017, Valencia, Spain. 13–16. code
  • Johannes Kiesel, Benno Stein, and Stefan Lucks. 2017. A Large-scale Analysis of the Mnemonic Password Advice. In 24th Annual Network and Distributed System Security Symposium (NDSS 2017), February, 2017, San Diego, USA. Association for Computational Linguistics. data doi slides

2016^

  • Khalid Al-Khatib, Henning Wachsmuth, Johannes Kiesel, Matthias Hagen, and Benno Stein. 2016. A News Editorial Corpus for Mining Argumentation Strategies. In 26th International Conference on Computational Linguistics (COLING 2016), December, 2016, Osaka, Japan. Association for Computational Linguistics, 3433–3443. code data poster
  • Matthias Hagen, Johannes Kiesel, Payam Adineh, Masoud Alahyari, Ehsan Fatehifar, Arefeh Bahrami, Pia Fichtl, and Benno Stein. 2016. Webis at TREC 2016: Tasks, Total Recall, and Open Search Tracks. In 25th International Text Retrieval Conference (TREC 2016), November, 2016, Gaithersburg, USA. National Institute of Standards and Technology (NIST).
  • Patrick Riehmann, Martin Potthast, Henning Gruendl, Johannes Kiesel, Dean Jürges, Giuliano Castiglia, Bagrat Ter-Akopyan, and Bernd Fröhlich. 2016. Visualizing Article Similarities in Wikipedia. In 18th Eurographics Conference on Visualization (EuroVis 2016), June, 2016, Groningen, Netherlands. The Eurographics Association, 69–71. award doi poster

2015^

  • Henning Wachsmuth, Johannes Kiesel, and Benno Stein. 2015. Sentiment Flow--A General Model of Web Review Argumentation. In 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP 2015), September, 2015, Lisbon, Portugal. Association for Computational Linguistics, 601–611. code doi slides video
  • Johannes Kiesel, Khalid Al-Khatib, Matthias Hagen, and Benno Stein. 2015. A Shared Task on Argumentation Mining in Newspaper Editorials. In 2nd Workshop on Argumentation Mining (ArgMining 2015) at NAACL, June, 2015. Association for Computational Linguistics, Denver, Colorado, 35–38. doi

2013^

  • Martin Potthast, Tim Gollub, Matthias Hagen, Martin Tippmann, Johannes Kiesel, Paolo Rosso, Efstathios Stamatatos, and Benno Stein. 2013. Overview of the 5th International Competition on Plagiarism Detection. In Working Notes Papers of the CLEF 2013 Evaluation Labs, September, 2013. slides

2012^

  • Martin Potthast, Tim Gollub, Matthias Hagen, Jan Graßegger, Johannes Kiesel, Maximilian Michel, Arnd Oberländer, Martin Tippmann, Alberto Barrón-Cedeño, Parth Gupta, Paolo Rosso, and Benno Stein. 2012. Overview of the 4th International Competition on Plagiarism Detection. In Working Notes Papers of the CLEF 2012 Evaluation Labs, September, 2012.

Data

2026^

2025^

2024^

2023^

2022^

2021^

2020^

2019^

2018^

2017^

2016^

Events

2027^

  • DESIRES 2027
    Conference. 5th International Conference on the Design of Experimental Search & Information REtrieval Systems (DESIRES 2027), co-organized by Johannes Kiesel and Johanne Trippas. Cologne, Germany.

2026^

  • The Methods Hub @ ReproCheck Midterm Workshop
    Invited Talk. By Johannes Kiesel. Hamburg, Germany.
  • Touché @ CLEF 2026
    Workshop. Lab hosting four shared tasks on argumentation systems, held in conjunction with the 27th Conference and Labs of the Evaluation Forum (CLEF 2026), co-organized by Johannes Kiesel, Marc Feger, Tim Hagen, Sebastian Heineking, Maximilian Heinrich, Maik Fröbe, Martin Potthast, and Benno Stein. Jena, Germany.
  • Fallacy Detection @ Touché/CLEF 2026
    Shared Task. Determine if and in which way an argument is fallacious, held as part of the 7th Touché Lab on Argumentation Systems (Touché @ CLEF 2026), co-organized by Maximilian Heinrich, Maik Fröbe, Benno Stein, and Johannes Kiesel. Jena, Germany.
  • Introducing Open and Reproducible Web Search for the Social Sciences @ SEASON 2026
    Workshop. Workshop held in conjunction with the 2nd Conference of the Search Engines and Society Network (SEASON 2026), co-organized by Taimoor Khan, Alisa Rieger, Johannes Kiesel, Dimitar Dimitrov, and Stefan Dietze. Hamburg, Germany.
  • Bringing Computer Science Tools to Social Science: The Methods Hub @ PAN 2026
    Invited Talk. Keynote at the PAN'26 workshop by Johannes Kiesel. Jena, Germany.
  • Tools for Detecting Values in Text @ Values Seminar Series 2026
    Invited Talk. By Johannes Kiesel and Mario Scharfbillig. Online. video
  • Method Sharing Retreat (MESHARE) @ WebSci 2026
    Tutorial. Learn how to submit to Methods Hub using your own method, held in conjunction with the 18th ACM Web Science Conference (WebSci 2026), co-organized by Muhammad Taimoor Khan, Ran Yu, Felix Münch, Fakhri Momeni, Stephan Linzbach, Arnim Bleier, and Johannes Kiesel. Braunschweig, Germany.
  • GESIS Methods Hub - the Collaborative Online Portal for Finding and Sharing Computational Methods in the Social Sciences @ ZBW ReproCheck Colloquium
    Invited Talk. By Johannes Kiesel and Arnim Bleier. Online.
  • The Methods Hub: A Platform for Sharing Reproducible Data Science Methods @ ISDT 2026
    Invited Talk. By Johannes Kiesel. Islamabad, Pakistan and online.
  • GESIS Methods Hub - the Collaborative Online Portal for Finding and Sharing Computational Methods in the Social Sciences @ NFDI4DS Lectures 2026
    Invited Talk. By Johannes Kiesel. Online.
  • ECIR 2026
    Conference. 48th European Conference on Information Retrieval (ECIR 2026), proceedings chairs Alisa Rieger and Johannes Kiesel. Delft, The Netherlands.
  • GESIS Methods Hub Social Media Datasprint @ SMAD 2026
    Workshop. Collaboratively explore social media datasets, held in conjuction with the 2nd Social Media Access Days (SMAD 2026), co-organized by Johannes Kiesel, Christina Viehmann, Felix Münch, and Arnim Bleier. Frankfurt am Main, Germany.

2025^

  • Interactive Knowledge Assistance Track (iKAT) @ TREC 2025
    Shared Task. Build conversational agents that respond to users' immediate queries but adapt their responses based on the cumulative context of the interaction, held in conjunction with the 34th Text Retrieval Conference (TREC 2025), co-organized by Mohammad Aliannejadi, Zahra Abbasiantaeb, Simon Lupart, Nailia Mirzakhmedova, Marcel Gohsen, Johannes Kiesel, and Jeff Dalton. Online.
  • Touché @ CLEF 2025
    Workshop. Lab hosting four shared tasks on argumentation systems, held in conjunction with the 26th Conference and Labs of the Evaluation Forum (CLEF 2025), co-organized by Johannes Kiesel, Çağrı Çöltekin, Marcel Gohsen, Sebastian Heineking, Maximilian Heinrich, Maik Fröbe, Tim Hagen, Martin Potthast, and Benno Stein. Madrid, Spain. data publications slides
  • Image Retrieval/Generation for Arguments @ Touché+ImageCLEF/CLEF 2025
    Shared Task. Retrieve or generate images that help to convey central aspects of claims, held as part of the 6th Touché Lab on Argumentation Systems (Touché @ CLEF 2025), co-organized by Maximilian Heinrich, Johannes Kiesel, Moritz Wolter, Martin Potthast, and Benno Stein. Madrid, Spain. data publications
  • Retrieval-Augmented Debating @ Touché/CLEF 2025
    Shared Task. Build conversational agents that argue against a debate partner and to evaluate such systems automatically, held as part of the 6th Touché Lab on Argumentation Systems (Touché @ CLEF 2025), co-organized by Marcel Gohsen, Nailia Mirzakhmedova, Harrisen Scells, Mohammad Aliannejadi, Maik Fröbe, Johannes Kiesel, and Benno Stein. Madrid, Spain. data publications

2024^

  • SCAI 2024 @ CHIIR 2024
    Workshop. 8th Workshop on Search-Oriented Conversational Artificial Intelligence (SCAI 2024), held in conjunction with the 9th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2024), co-organized by Alexander Frummet, Andrea Papenmeier, Maik Fröbe, and Johannes Kiesel. Sheffield, United Kingdom. publications
  • Introduction to Machine Learning @ Bauhaus-Universität Weimar
    Teaching. M.Sc. course on concepts and methods of machine learning in Winter term 24/25 lectured by Johannes Kiesel. Weimar, Germany. slides
  • Using AI in Everyday Life at the University @ Bauhaus-Universität Weimar
    Teaching. Training seminar in 2024 lectured by Benno Stein, Johannes Kiesel, and Marcel Gohsen. Weimar, Germany. slides
  • Understanding to Stay in Control: Using, Assessing, and Mastering AI @ Jahrestagung eTeach-Netzwerk Thüringen
    Invited Talk. Keynote by Benno Stein and Johannes Kiesel. Jena, Germany. slides
  • Wie lernen Computer? @ Kinderuni Weimar 2024/25
    Teaching. Invited lecture at the Kinderuni Weimar lectured by Benno Stein and Johannes Kiesel. Weimar, Germany. slides
  • Touché @ CLEF 2024
    Workshop. Lab hosting three shared tasks on argumentation systems, held in conjunction with the 25th Conference and Labs of the Evaluation Forum (CLEF 2024), co-organized by Johannes Kiesel, Çağrı Çöltekin, Maximilian Heinrich, Maik Fröbe, Martin Potthast, Henning Wachsmuth, and Benno Stein. Grenoble, France. data poster publications slides
  • ValueEval @ Touché/CLEF 2024
    Shared Task. Detect the prevalent human values in texts and the values' valence, held as part of the 5th Touché Lab on Argumentation Systems (Touché @ CLEF 2024), co-organized by Johannes Kiesel, Milad Alshomary, Nailia Mirzakhmedova, Nicolas Handke, Bertrand De Longueville, Theresa Reitis-Münstermann, Mario Scharfbillig, Nicolas Stefanovitch, Henning Wachsmuth, and Benno Stein. Grenoble, France. data publications
  • Image Retrieval/Generation for Arguments @ Touché+ImageCLEF/CLEF 2024
    Shared Task. Retrieve or generate images per topic and stance that show support for that stance, held as part of the 5th Touché Lab on Argumentation Systems (Touché @ CLEF 2024), co-organized by Maximilian Heinrich, Johannes Kiesel, Martin Potthast, and Benno Stein. Grenoble, France. data publications
  • CUI 2024
    Conference. 6th Conversational User Interfaces conference (CUI 2024), full paper chairs Johannes Kiesel, Saul Albert, and Robert Moore. Luxembourg City, Luxembourg.

2023^

  • Touché @ CLEF 2023
    Workshop. Lab hosting four shared tasks on argumentation systems, held in conjunction with the 24th Conference and Labs of the Evaluation Forum (CLEF 2023), co-organized by Alexander Bondarenko, Maik Fröbe, Johannes Kiesel, Ferdinand Schlatt, Jan Heinrich Reimer, Valentin Barriere, Léo Hemamou, Simon Luck, Brian Ravenet, Benno Stein, Martin Potthast, and Matthias Hagen. Thessaloniki, Greece. data publications slides
  • Image Retrieval for Arguments @ Touché/CLEF 2023
    Shared Task. Retrieve images per topic and stance that show support for that stance, held as part of the 4th Touché Lab on Argumentation Systems (Touché @ CLEF 2023), co-organized by Johannes Kiesel, Maik Fröbe, Martin Potthast, and Benno Stein. Thessaloniki, Greece. data publications
  • Open Web Search And its Use to Find Arguments Against Populist Claims @ JRC DISINFO Workshop 2023
    Invited Talk. Talk by Johannes Kiesel. Brussels, Belgium. slides
  • ValueEval @ Touché/SemEval 2023
    Shared Task. Detect the prevalent human values in arguments, held as part of the 17th International Workshop on Semantic Evaluation (SemEval 2023), co-organized by Johannes Kiesel, Milad Alshomary, Nailia Mirzakhmedova, Maximilian Heinrich, Nicolas Handke, Henning Wachsmuth, and Benno Stein. Toronto, Canada. data publications slides video

2022^

  • Touché @ CLEF 2022
    Workshop. Lab hosting three shared tasks on argumentation systems, held in conjunction with the 23th Conference and Labs of the Evaluation Forum (CLEF 2022), co-organized by Alexander Bondarenko, Maik Fröbe, Johannes Kiesel, Shahbaz Syed, Timon Gurcke, Meriem Beloucif, Alexander Panchenko, Chris Biemann, Benno Stein, Henning Wachsmuth, Martin Potthast, and Matthias Hagen. Bologna, Italy. data publications slides
  • Image Retrieval for Arguments @ Touché/CLEF 2022
    Shared Task. Retrieve images per topic and stance that show support for that stance, held as part of the 3th Touché Lab on Argumentation Systems (Touché @ CLEF 2022), co-organized by Johannes Kiesel, Martin Potthast, and Benno Stein. Bologna, Italy. data publications

2021^

  • SCAI QReCC Shared Task 2021 @ SCAI 2021
    Shared Task. Answer a series of contextually-dependent questions like they may occur in natural human-to-human conversations, held as part of the 6th Search-Oriented Conversational AI Workshop (SCAI 2021), co-organized by Maik Fröbe, Johannes Kiesel, and Svitlana Vakulenko. Online. data publications

2019^

  • Hyperpartisan News Detection @ PAN/SemEval 2019
    Shared Task. Decide whether news articles exhibit blind, prejudiced, or unreasoning allegiance to one party, faction, cause, or person, held as part of the 13th International Workshop on Semantic Evaluation (SemEval 2019), co-organized by Johannes Kiesel, Martin Potthast, Maria Mestre, Rishabh Shukla, Benno Stein, David Corney, Emmanuel Vincent, and Payam Adineh. Minneapolis, USA. data publications video

2018^

  • Setting the News Straight Through Technology @ Studienstiftung des deutschen Volkes Akademie
    Teaching. Workshop on Fake News detection technology by Matthias Hagen, Johannes Kiesel, and Martin Potthast. Greifswald, Germany.