posted by user: Oke2017 || 2597 views || tracked by 4 users: [display]

OKE 2018 : OKE - Open Knowledge Extraction Challenge @ ESWC 2018


When Jun 3, 2018 - Jun 7, 2018
Where Heraklion, Crete, Greece
Submission Deadline Mar 30, 2018
Notification Due Apr 30, 2018
Final Version Due May 14, 2018
Categories    semantic web   knowledge extraction systems

Call For Papers

OKE 2018 - Open Knowledge Extraction Challenge

in conjunction with the 15th European Semantic Web Conference (ESWC 2018)
3rd-7th June 2018, Heraklion, Crete, Greece

The OKE challenge invites researchers and practitioners from academia as well as industry to compete to the aim of pushing further the state of the art in knowledge extraction from text for the Semantic Web. The challenge has the ambition to provide a reference framework for research in this field by redefining a number of tasks typically from information and knowledge extraction by taking into account Semantic Web requirements and has the goal to test the performance of knowledge extraction systems.

This year, the challenge goes in the fourth round and consists of four tasks which include named entity identification, disambiguation by linking to a knowledge base as well as relation and knowledge extraction. The challenge makes use of small gold standard datasets that consist of manually curated documents and large silver standard datasets that consist of automatically generated synthetic documents. The performance measure of a participating system is twofold based on (1) Precision, Recall, F1-measure and on (2) Precision, Recall, F1-measure with respect to the runtime of the system.

This year, the challenge comprises the following tasks:
Task 1: Focused Named Entity Identification and Linking
Task 2: Broader Named Entity Identification and Linking
Task 3: Relation Extraction
Task 4: Knowledge Extraction

Participants will be expected to describe their solution and results on the training datasets over a 5 page paper. In particular, a short summary of the approach chosen, a link to the experimental results and an analysis of the strengths and weaknesses of the approach are expected.

Important Dates

Paper submission deadline (5 pages): Friday, March 30th, 2018
Challenge paper reviews: Thursday, April 26th, 2018
Notification of authors and invitation to challenge: Monday, April 30th, 2018
Camera ready papers (5 pages): Monday, May 14th, 2018
Camera ready papers for the challenge post-proceedings (up to 15 pages): Friday, July 6th, 2018 (tentative deadline)

Release of training data and detailed instructions: Monday, February 12, 2018
Release of test dataset: Monday, May 7th, 2018
Deadline for system submission: TBA
Running of the systems: TBA

Presentation of challenge results: During ESWC 2018
Proclamation of winners: During ESWC 2018 closing ceremony



Axel-Cyrille Ngonga Ngomo, Paderborn University, Paderborn, Germany
René Speck, Leipzig University, Leipzig, Germany
Michael Röder, Paderborn Leipzig, Paderborn, Germany
Ricardo Usbeck, Paderborn University, Paderborn, Germany

For the complete list of organizers and program committee members, visit the challenge website.

Further Information and Contact

For detailed information, including datasets and submission guidelines, please visit the challenge website:

Contact Email: OR

Related Resources

PAKDD 2022   The 26th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD 2022)
DMA 2022   8th International Conference on Data Mining and Applications
CLEOPATRA 2021   2nd International Workshop on Cross-lingual Event-centric Open Analytics
ARIMA 2021   Special Issue Data Intelligibility, Business Intelligence and Semantic Web
IJCKG 2021   International Joint Conference on Knowledge Graphs
KSEM 2022   International Conference on Knowledge Science, Engineering and Management
SLIE 2022   Semantics, Logics, Information Extraction and AI
AAAI-MAKE 2022   AAAI 2022 Spring Symposium on Machine Learning and Knowledge Engineering for Hybrid Intelligence
ACM-Ei/Scopus-KDML 2021   2021 International Conference on Knowledge Discovery and Machine Learning (KDML 2021)
ICKE 2022   2022 8th International Conference on Knowledge Engineering (ICKE 2022)