posted by organizer: Oke2017 || 198 views || tracked by 3 users: [display]

SQA 2018 : Scalable Question Answering Open Challenge

FacebookTwitterLinkedInGoogle

Link: https://project-hobbit.eu/open-challenges/sqa-open-challenge/
 
When Dec 1, 2017 - Jun 3, 2018
Where Open Challenge
Submission Deadline TBD
Categories    linked data   big data   question answering
 

Call For Papers

Call For Systems: Scalable Question Answering Open Challenge 2017 - 2018 (SQA)

After the successful organization of the QALD-7 challenge at the ESWC 2017 and the QALD-8 challenge incorporated in the NLIWoD workshop at ISWC 2017, with more than 50 participants, the HOBBIT project (https://project-hobbit.eu/) is proud to announce the Scalable Question Answering Open Challenge (SQA) over Linked Data. SQA open challenge will run periodically with cutoff dates in June 2018 (coinciding with ESWC 2018) and November 2018. Therewith, the challenge will ensure continuous participation and system evaluation. Stay tuned and get ready to participate!

Monetary prizes will be provided to the best winning systems at each cutoff date.
Please express your interest in SQA open challenge by adding your email via the link: https://project-hobbit.eu/open-challenges/sqa-open-challenge/express-interest. You will receive further information and notifications regarding the progress of SQA open challenge.

Important Dates

Dry run phase: December 2017 to January 2018.
Release of the test questions without answers (TBA).
Training phase*: February to April 2018.
Test phase: May 2018.
Proclamation of results: 3rd of June 2018.

*Weekly release of evaluation results from the end of January onwards.

Prizes

The winner of the challenge will receive a prize of 250€.

Scalable Question Answering Open Challenge at a glance

The key challenge for Scalable Question Answering over Linked Data is in the need to translate a user’s information request into such a form that it can be efficiently evaluated using standard Semantic Web query processing and inferencing techniques.

Therefore, the main task of SQA open challenge is the following: given an RDF dataset and and a large volume of natural language questions or keywords, return the correct answers (or SPARQL queries that retrieves those answers).

Small test Data and Documentation are available for SQA open challenge:
Sample dataset: sqaoc-sample-largescale.json (http://hobbitdata.informatik.uni-leipzig.de/SQAOC/sqaoc-sample-largescale.json)
Description: Documentation.txt (http://hobbitdata.informatik.uni-leipzig.de/SQAOC/Documentation.txt)

In the Scalable Question Answering Open Challenge (SQA) users can display the capabilities of their systems using the HOBBIT platform (https://project-hobbit.eu/outcomes/hobbit-platform/) provided by the homonymous H2020 project.

--------------------------------------------------------------------------------------
Organization
--------------------------------------------------------------------------------------
Giulio Napolitano, IAIS, Fraunhofer, Germany
Axel-Cyrille Ngonga Ngomo, University of Paderborn, Germany
Ricardo Usbeck, University of Paderborn, Germany


--------------------------------------------------------------------------------------
Further Information and Contact
--------------------------------------------------------------------------------------
For detailed information including datasets and submission guidelines, please visit the challenge website: https://project-hobbit.eu/challenges/sqa-open-challenge
Contact Email: Giulio.Napolitano@iais.fraunhofer.de






Related Resources

OpenSuCo @ ISC HPC 2017   2017 International Workshop on Open Source Supercomputing
ICDM 2018   18th Industrial Conference on Data Mining ICDM 2018
WWW- SVQA 2018   Challenge@WWW 2018: Semantic Visual Question Answering
IEEE - ICBDA 2018   2018 IEEE 3rd International Conference on Big Data Analysis (ICBDA 2018)--IEEE Xplore and Ei Compendex
NLIWOD & QALD 8 2017   NLIWOD and QALD 8 challenge - The Third International Workshop on Natural Language Interfaces for the Web of Data & 8th Question Answering over Linked Data challenge
IJE 2017   International Journal of Education (IJE)
FiQA 2018   Challenge@WWW 2018: Financial Opinion Mining and Question Answering
BigData Congress 2018   The 7th International Congress on Big Data
QALD 2017   7th Question Answering over Linked Data Challenge
BioASQ 2017   A challenge on large-scale biomedical semantic indexing and question answering