posted by user: adammo121 || 7049 views || tracked by 7 users: [display]

AKG 2017 : NTCIR-13 Actionable Knowledge Graph (AKG) Task


When Dec 5, 2017 - Dec 8, 2017
Where Tokyo
Submission Deadline Dec 15, 2016
Categories    semantic web   NLP   text mining   data mining

Call For Papers

NTCIR-13 Actionable Knowledge Graph (AKG) Task
2nd Call For Task Participation

The formal run of our first subtask, action mining (AM), will start on 1st Jan 2017! Join us at (Due: Dec 15, 2016)

Dec 15, 2016: Task registration due for AM subtask
Jan 1, 2017: AM: Formal run topics release
Feb 1, 2017: AM: Formal run submissions due
Feb 15, 2017: AM: Formal run results release

=== Quick Links ====

Discussion Group

=== Overview ===
Knowledge graph (aka direct displays, cards, etc.) has become an increasingly common and important component in search engine result pages (SERPs). The objective of this new pilot task accepted to run at NTCIR-13 is to foster research on generating knowledge graphs that are optimised for facilitating users' actions (buying, booking, downloading, comparing, creating, etc.). To achieve this objective, we set two subtasks: Action Mining (AM) subtask and Actionable Knowledge Graph Generation (AKGG) subtask.

=== Tasks ===
In this pilot task, we set two subtasks to achieve and advance the technologies related to actionable knowledge graph presentations that can be used for search engines.

Action Mining Subtask (AM)
Input: Entity, Entity Type, and Wikipedia URL
Output: A ranked list of actions

For a given entity type (e.g., Place) and instance entity (e.g., "poland"), participants will be asked to find potential actions that can be taken (e.g., "visit poland", "buy a house in poland", "find weather in poland"). Participants are allowed to use any external resources (e.g., Action section in to return a ranked list of potential actions. Up to 100 actions should be submitted for each query (pair of entity and its type). The format of each submitted action should contain verb and object (called also the modifier of a verb), where the object's length is limited to 50 characters. For example, in the above-mentioned case of "poland" as the entity instance of the Place type, "buy a house in poland" would be an action composed of a verb "buy" and object "a house in poland". Participants are allowed to submit up to three actions that share the same verb. Note that actions can sometimes lack objects (actions containing only a verb), in which case, the object is actually considered NULL. For example, for the entity "outlook express" of the type Product, "download" is an example of correct action that does not require any explicit object specified. This subtask can be seen as an open information extraction task, and allows us to accumulate a comprehensive set of actions that are related to a given entity type and entity instance. The returned actions will be assessed by crowdsourcing to be scored from 1 to 5. Actions will be evaluated not only based on their relevance but also based on diversity in order to prevent submissions of many similar actions (e.g., actions where verbs are synonyms or the objects have very similar meaning). For sample data see:

Actionable Knowledge Graph Generation Subtask (AKGG)
Input: Query, Entity Type, Entity, and Action
Output: A ranked list of attributes of the type

For a given search query, entity included in that query, the type of the entity, and action (e.g., "kyoto budget travel", "kyoto", location, "visit a temple"), participants will be asked to rank entity properties based on their relevance to the query. The query (input) can be ambiguous as in realistic search queries, and participants need to return the ranked list of relevant entity properties to create an actionable knowledge graph. Actions in the test queries will be taken from the outcomes of the Action Mining (AM) Subtask. Properties to be returned will be those defined as attributes of the entity type in vocabulary.

Please note:

Task participants must submit a paper to the NTCIR-13 Conference (unrefereed) and at least one member of each participating group must attend the conference (December 5-8, 2017, NII, Tokyo, Japan) to present their work.

Please visit task website for more information:

=== Important Dates ===

Dec 15, 2016 Task registration due for AM subtask
Jan 1, 2017 AM: Formal run topics release
Feb 1, 2017 AM: Formal run submissions due
Feb 15, 2017 AM: Formal run results release
Mar 15, 2017 AKGG: Dry run topics + training data release
Apr 15, 2017 AKGG: Dry run submissions due
May 15, 2017 AKGG: Dry run results release
Jun 1, 2017 Task registration due for AKGG subtask
Jun 15, 2017 AKGG: Formal run topics release
Jul 15, 2017 AKGG: Formal run submissions due
Sep 1, 2017 AKGG: Formal run results release, Partial Overview paper release
Oct 1, 2017 Partcipants paper due
Nov 1, 2017 Camera-ready due
Dec 5-8, 2017 NTCIR-13 Conference

=== Organisers ===

Roi Blanco (University of A Coruña, Spain)
Hideo Joho (University of Tsukuba, Japan)
Adam Jatowt (Kyoto University, Japan)
Haitao Yu (University of Tsukuba, Japan)
Shuhei Yamamoto (University of Tsukuba, Japan)

=== Contact ===

ntcir-akg at

--- END ---

Related Resources

LREC 2018   Language Resources and Evaluation Conference
PAKDD 2018   The 22nd Pacific-Asia Conference on Knowledge Discovery and Data Mining
ICSC 2018   12th IEEE International Conference on Semantic Computing (ICSC 2018)
TextGraphs 2017   TextGraphs-11: Graph-based Methods for Natural Language Processing
data-driven 2017   Special Issue on “Data-Driven User Behavioral Modeling: From Real-World Behavior to Knowledge, Algorithms, and Systems”
IPMU 2018   17th Information Processing and Management of Uncertainty in Knowledge-Based Systems Conference
ICKD 2017   2017 6th International Conference on Knowledge Discovery (ICKD 2017)--Ei Compendex and Scopus
SDM 2018   SIAM International Conference on Data Mining
ACM--ICCIP 2017   ACM--2017 the 3rd International Conference on Communication and Information Processing (ICCIP 2017)--Ei Compendex, ISI Web of Science and Scopus
KR 2018   16th International Conference on Principles of Knowledge Representation and Reasoning