posted by organizer: rspeck || 5538 views || tracked by 10 users: [display]

OKE 2017 : OKE2017 - Open Knowledge Extraction Challenge @ESWC2017

FacebookTwitterLinkedInGoogle

Link: https://project-hobbit.eu/challenges/oke2017-challenge-eswc-2017
 
When May 28, 2017 - Jun 1, 2017
Where Portoroz, Slovenia
Submission Deadline Mar 10, 2017
Notification Due Apr 7, 2017
Final Version Due Apr 23, 2017
Categories    information extraction   linked data   semantic web
 

Call For Papers

ESWC-17 Open Knowledge Extraction (OKE) Challenge
======================================================================
In conjunction with ESWC 2017: http://2017.eswc-conferences.org
May 28 - June 2 2017 Portoroz, Slovenia
full details at: https://project-hobbit.eu/challenges/oke2017-challenge-eswc-2017
======================================================================

we are happy to announce that the Open Knowledge Extraction Challenge (OKE) goes into
its 3rd round at the ESWC 2017. The challenge has been redesigned with new tasks
including: the usage of different knowledge bases and a real knowledge extraction task
as well as two scenarios for each task. Scenario A tests the quality of system results
(i.e., the F1-measure) based on hand-curated documents while scenario B tests the
effectiveness of systems (i.e., the F1-measure per time) based on a large number
automatically generated documents.

We cordially invite you to participate.
======================================================================

1. Aim
----------------------------------------
The aim of this challenge is to test the performance of knowledge extraction
systems in aspects that are relevant for the Semantic Web. These include
precision, recall and runtime. The challenge will test the systems against
data derived from real datasets. This year, the challenge will comprise the
following tasks:
* Task 1 Focused Named Entity Identification and Linking
* Task 2 Broader Named Entity Identification and Linking
* Task 3 Focused Musical Named Entity Recognition and Linking
* Task 4 Knowledge Extraction

We herewith invite system developers to participate in the aforementioned
tasks. The system are invited to write papers presenting their results on the
training data (see important dates below). To ensure that the system results
are comparable, we will provide the HOBBIT benchmarking platform for the
generation of the final results to be included into the system publications. A
specification of the hardware on which the benchmarks will be ran will be
released in due course.

2. Prerequisites for Participation
----------------------------------------
Each participant must:
* provide his/her solution as a docker image that abides by the technical
* specifications which will be released with the challenge

3. Prizes
----------------------------------------
The overall winner of the challenge will get a prize of at least 500€. Further
prizes are being organized.


4. Important Dates
----------------------------------------
Release of training data and instructions: January 13th, 2017
Paper submission deadline: March 17th, 2017
Challenge paper reviews: April 5th, 2017
Paper Notifications and invitation to task: April 7th, 2017
Beginning of benchmarking runs on platform: April 7th, 2017
Camera ready papers (5 pages document): April 23rd, 2017

Release of evaluation results: June 2nd, 2017
Camera-ready challenge proceedings version: June 30th, 2017 (tentative)
Proclamation of winners: June 2nd, 2017 (ESWC 2017)

Related Resources

CoopIS 2025   [Deadline July 7] The 31st International Conference on Cooperative Information Systems
BIEN 2025   8th International Conference on Bioscience & Engineering
NLP4KGC 2025   4th NLP4KGC: Natural Language Processing for Knowledge Graph Construction
IJCI 2025   International Journal on Cybernetics & Informatics
ISKE 2025   The 20th International Conference on Intelligent Systems and Knowledge Engineering (ISKE 2025)
IJESA 2025   International Journal of Embedded Systems and Applications
SLIE 2025   Semantic, Logics, Information Extraction and AI (SLIE)
CSITY 2025   11th International Conference on Computer Science, Engineering and Information Technology
BioCreative9@IJCAI-2025   BioCreative IX Challenge and Workshop@IJCAI-2025: Large Language Models for Clinical and Biomedical NLP
VIPERC 2025   4th International Conference on Visual Pattern Extraction and Recognition for Cultural Heritage Understanding