posted by organizer: RicardoUsbeck || 2994 views || tracked by 8 users: [display]

QALD 2017 : 7th Question Answering over Linked Data Challenge


When May 28, 2017 - Jun 1, 2017
Where Portoroz, Slovenia
Submission Deadline Mar 17, 2017
Notification Due Apr 7, 2017
Final Version Due Apr 23, 2017
Categories    question answering   natural language processing   NLP   QA

Call For Papers

Call for Systems QALD2017 CHALLENGE @ ESWC 2017
ESWC 2017, May 28th, 2016 to June 1st, 2017 Portoroz, Slovenia.

The key challenge for Question Answering over Linked Data is to translate a user’s information need into a form such that it can be evaluated using standard Semantic Web query processing and inferencing techniques.

The main task of QALD therefore is the following: Given one or several RDF dataset(s) as well as additional knowledge sources and natural language questions or keywords, return the correct answers or a SPARQL query that retrieves these answers.

In order to focus on specific aspects and challenges, we propose the following three tasks:

Task 1: Multilingual question answering over DBpedia
Task 2: Hybrid question answering
Task 3: Large-Scale question answering over RDF
Task 4: Wikidata-based question answering

The QALD challenge provides an automatic evaluation tool (GERBIL QA integrated into the HOBBIT platform) that is open source and available for everyone to re-use. This tool is accessible online, so that participants can simply upload the answers produced by their system or even check their system via a web service.

Each experiment will have a citable, time-stable and archivable URI which is both human- and machine-readable. It is mandatory for each system to provide an endpoint URL wrapped inside a provided Docker container after the submission in order to be evaluated with GERBIL QA.

We are accepting papers (up to 5 pages) describing the submitted approach and evaluation results. Submissions must be in English and in PDF, formatted in the style of the Springer Publications format for Lecture Notes in Computer Science (LNCS).

Papers should be submitted through the EasyChair system ( no later than midnight Friday March 10th, 2017, Hawaii Time. Submissions will be reviewed by members of the challenge program committee. Papers will be evaluated according to their significance, originality, technical content, style, clarity, and relevance to the challenge. The complete set of papers will be published with the CEUR Workshop Proceedings (, listed by the DBLP.

For any questions, please write an email to Ricardo Usbeck (usbeck AT

Preliminary Schedule

Release of training data and instructions: Friday January 13th, 2017
Release of test dataset: Friday April 7th, 2017
Paper submission deadline: Friday March 17th, 2017
Challenge paper reviews: Tuesday April 5th, 2017
Paper Notifications and invitation to task: Friday April 7th, 2017
Camera ready papers (5 pages document): Sunday April 23rd, 2017
Submission of camera-ready papers: April 24, 2014

Related Resources

ADAH 2017   Advanced Data Analytics in Health
COLING 2018   The 27th International Conference on Computational Linguistics (COLING 2018)
NLIWOD & QALD 8 2017   NLIWOD and QALD 8 challenge - The Third International Workshop on Natural Language Interfaces for the Web of Data & 8th Question Answering over Linked Data challenge
NAACL HLT 2018   The 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
ACL 2018   56th Annual Meeting of the Association for Computational Linguistics
(Call for papers)QALD@ESWC 2017   7th Question Answering over Linked Data Challenge
NATP 2017   3rd International Conference on Natural Language Processing
BioASQ 2017   A challenge on large-scale biomedical semantic indexing and question answering
OKBQA 2017   Open Knowledge Base and Question Answering Workshop
IJNLC 2017   International Journal on Natural Language Computing