posted by user: grupocole || 1400 views || tracked by 4 users: [display]

QGTEC 2008 : Workshop on the Question Generation Task and Evaluation Challenge


When Sep 25, 2008 - Sep 26, 2008
Where Arlington, VA, USA
Submission Deadline Aug 1, 2008
Notification Due Aug 15, 2008
Categories    NLP   information retrieval

Call For Papers


Workshop on the Question Generation Task and Evaluation Challenge
Sponsored by National Science Foundation

September 25-26, 2008
National Science Foundation, Arlington, VA


The natural language generation community has recently identified shared task evaluation campaigns as a potential avenue to provide a focus of research in natural language generation and to increase the visibility of natural language generation in the wider natural language processing/computational linguistics community.

We would like to contribute to this effort by first properly defining and then offering a shared task on Question Generation. As a first approximation, we define Question Generation as the automatic generation of questions (Factual questions, Yes/No-questions, Why-questions, etc.) from inputs such as text (in particular, declarative sentences), raw data, and knowledge bases. The role of this workshop is to reach a community consensus with respect to the Question Generation shared task. The discussions will be guided by the Desiderata for Evaluation of Natural Language Generation (Paris et al., 2007 in Shared Tasks and Comparative Evaluation in Natural Language Generation: Workshop Report, Michael White and Robert Dale, Eds.) outlined at the NSF/SIGGEN Workshop on Shared Tasks and Comparative Evaluation in Natural Language Generation in 2007.

Question Generation is an essential component of learning environments, help systems, information seeking systems, multi-modal conversations between virtual agents, and a myriad of other applications. However, systematic research on Question Generation has been conspicuously absent in the computational linguistics community at large and in the natural language generation community in particular, in spite of substantial attention to the complementary question answering processes. The time is ripe to address the important topic of automated Question Generation.

We invite submissions of short papers (2 pages including references) that address topics relevant to Question Generation as a shared task, as provided below:

-cognitive and computational models of Question Generation that could inform the definition of Question Generation shared task(s)
-question taxonomies
-Question Generation main task(s)
-Question Generation sub-task(s)
-data collection and preparation
-representation language(s) for the input and output data
-annotation schemes and processes
-forms of evaluation (human-based vs. automatic vs. semi-automatic)
-evaluation metrics

Submission Guidelines

Papers should follow the ACL paper format and should not exceed 2 pages including references. Templates are available at Submissions should include information about authors (no anonymous submissions). Papers must be submitted via email to before or on the submission deadline (see next). The papers must be submitted in PDF format.

Important Dates

Submission Deadline: August 1, 2008
Notification Deadline: August 15, 2008
Camera-Ready Papers Due: September 1, 2008

Organizing Committee

Workshop Co-chairs:

Vasile Rus, The University of Memphis
Art Graesser, The University of Memphis

Steering Committee:

James Lester, North Carolina State University
Jose Otero, University of Alcala
Paul Piwek, Open University
Amanda Stent, Stony Brook University

Related Resources

IEEE PVE-SDN 2022   4th IEEE International Workshop On Performance Evaluation of Next Generation Virtualized Environments and Software-Defined Networks
EMNLP 2022   Conference on Empirical Methods in Natural Language Processing
LREC 2022   14th Conference on Language Resources and Evaluation
AIMLNET 2022   2nd International conference on AI, Machine Learning in Communications and Networks
ALQAC 2022   Automated Legal Question Answering Competition
ECNLPIR 2022   2022 European Conference on Natural Language Processing and Information Retrieval (ECNLPIR 2022)
EASE 2022   International Conference on Evaluation and Assessment in Software Engineering (EASE) 2022
ACM-Ei/Scopus-ITNLP 2022   2022 2nd International Conference on Information Technology and Natural Language Processing (ITNLP 2022) -EI Compendex
#SMM4H 2022   7th Social Media Mining for Health Applications - Workshop & Shared Task at COLING 2022
WiMNET 2022   9th International Conference on Wireless and Mobile Network