posted by organizer: nandana || 2500 views || tracked by 3 users: [display]

SMART 2021 : SeMantic Answer Type and Relation Prediction Task (SMART 2021)

FacebookTwitterLinkedInGoogle

Link: https://smart-task.github.io/2021/
 
When Oct 24, 2021 - Oct 28, 2021
Where Online
Submission Deadline Sep 15, 2021
Notification Due Sep 22, 2021
Final Version Due Oct 7, 2021
Categories    semantic web   artificial intelligence   KBQA   NLP
 

Call For Papers

SeMantic Answer Type and Relation Prediction Task (SMART 2021)
ISWC 2021 Semantic Web Challenge
in conjunction with ISWC 2021 [https://iswc2021.semanticweb.org/]

*********************************************************************************
Challenge website: https://smart-task.github.io/2021/
Conference date and location: 24 - 28 October 2021 (Online - Virtual)
Submission deadline: September 15, 2021
*********************************************************************************

Brief Background
Knowledge Base Question Answering (KBQA) is a popular task in the field of Natural Language Processing and Information Retrieval, in which the goal is to answer a natural language question using the facts in a Knowledge Base. KBQA can involve several subtasks such as entity linking, relation linking, and answer type prediction. In SMART 2021 Semantic Web Challenge, we focus on two subtasks in KBQA.

Task Descriptions
This year, in the second iteration of the SMART challenge, we have two independent tasks:

Task 1 - Answer Type Prediction: Given a question in natural language, the task is to predict the type of the answer using a set of candidates from a target ontology.

- Who is the heaviest player of the Chicago Bulls? -) dbo:BasketballPlayer
- How many employees does IBM have? -) number

Task 2 - Relation prediction: Given a question in natural language, the task is to predict the relations needed to extract the correct answer from the KB.

- Who are the actors starring in movies directed by and starring William Shatner? -) dbo:starring, dbo:director
- What games can be played in schools founded by Fr. Orlando? -) dbo:sport, dbo:foundedBy

Datasets
We have created datasets for each task; SMART2021-AT and SMART2021-RL. Each of these tasks has separate datasets for DBpedia and Wikidata. More details are available on the challenge website.

Submissions and proceedings
Training data for the tasks are available now and the test data will be provided to the participants by the 31st of August. Participants are required to send their system outputs by the 15th of September. Participants are invited to submit a system paper that will be peer-reviewed and published in a CEUR volume similar to last year, http://ceur-ws.org/Vol-2774/.

Please feel free to contact the organizers regarding any inquiries related to the task, datasets, and submissions. There is a slack workspace for challenge related discussions.

Organizers
Nandana Mihindukulasooriya, IBM Research AI, USA
Mohnish Dubey, University of Bonn, Germany
Alfio Gliozzo, IBM Research AI, USA
Jens Lehmann, University of Bonn, Germany
Axel-Cyrille Ngonga Ngomo, Paderborn University, Germany
Ricardo Usbeck, University of Hamburg, Germany
Gaetano Rossiello, IBM Research AI, USA
Uttam Kumar, University of Bonn, Germany

Related Resources

PerAnsSumm Shared Task @ CL4Health NAACL 2025   Shared Task on Perspective-aware Healthcare Answer Summarization at CL4Health Workshop [NAACL 2025]
IEEE-Ei/Scopus-ITCC 2025   2025 5th International Conference on Information Technology and Cloud Computing (ITCC 2025)-EI Compendex
GermEval2024 GerMS-Detect 2024   GermEval2024 Shared Task GerMS-Detect -- Sexism Detection and Annotator Disagreement Prediction in German Online News Fora @Konvens 2024
SPIE-Ei/Scopus-DMNLP 2025   2025 2nd International Conference on Data Mining and Natural Language Processing (DMNLP 2025)-EI Compendex&Scopus
COPA 2025   14th Symposium on Conformal and Probabilistic Prediction with Applications
DEPLING 2023   International Conference on Dependency Linguistics
Call For Papers Special Issue 2024   Smart Cities, innovating in the Transformation of Urban Environments
IEEE-Ei/Scopus-CNIOT 2025   2025 IEEE 6th International Conference on Computing, Networks and Internet of Things (CNIOT 2025) -EI Compendex
PREDICTION SOLUTIONS 2025   International Conference on Prediction Solutions for Technical and Societal Systems
AMLDS 2025   IEEE--2025 International Conference on Advanced Machine Learning and Data Science