posted by organizer: manjira_87 || 17605 views || tracked by 2 users: [display]

CHIS 2016 2016 : CHIS@FIRE 2016: Shared Task on Consumer Health Information Search (CHIS) held in conjunction with FIRE2016, ISI Kolkata


When Dec 8, 2016 - Dec 10, 2016
Where Indian Statistical Institute Kolkata
Submission Deadline TBD
Categories    health care text analytics   information retrieval   NLP   query retrieval

Call For Papers

Call for Participation
CFP in Shared Task on Consumer Health Information Search (CHIS) collocated with the Forum for Information Retrieval Evaluation (FIRE) 2016 on 8th - 10th December 2016, Kolkata
World Wide Web is increasingly being used by consumers as an aid for health decision making and for self-management of chronic illnesses as evidenced by the fact that one in every 20 searches on google is about health. Information access mechanisms for factual health information retrieval have matured considerably, with search engines providing Fact checked Health Knowledge Graph search results to factual health queries. It is pretty straightforward to get an answer to the query “what are the symptoms of Diabetes” from the search engines. However retrieval of relevant multiple perspectives for complex health search queries which do not have a single definitive answer still remains elusive with most of the general purpose search engines. The presence of multiple perspectives with different grades of supporting evidence (which is dynamically changing over time due to the arrival of new research and practice evidence) makes it all the more challenging for a lay searcher.

We use the term “Consumer Health Information Search” (CHIS) to denote such information retrieval search tasks, for which there is “No Single Best Correct Answer”; Instead multiple and diverse perspectives/points of view (which very often are contradictory in nature) are available on the web regarding the queried information. The goal of CHIS track is to research and develop techniques to support users in complex multi-perspective health information queries.
Given a CHIS query, and a document/set of documents associated with that query, the FIRST task is to classify the sentences in the document as relevant to the query or not. The relevant sentences are those from that document, which are useful in providing the answer to the query. The SECOND task is to classify these relevant sentences as supporting the claim made in the query, or opposing the claim made in the query.

Example query: Does daily aspirin therapy prevent heart attack?

S1: “Many medical experts recommend daily aspirin therapy for preventing heart attacks in people of age fifty and above.” [affirmative/Support]

S2: “While aspirin has some role in preventing blood clots, daily aspirin therapy is not for everyone as a primary heart attack prevention method”. [disagreement/Oppose]
First set of Training Data Release: 15th June 2016
Final set of Training Data Release: 1st August 2016 (we are mailing the dataset to registered participants.)
Test Data Release: 1st September 2016
Run Submission Deadline: 15th September 2016
Results Declared: 1st October 2016
Working Notes Due: 15th October 2016
Conference: 8-10 December 2016
Contact email:;
Track Organizers
Shourya Roy, Xerox Research Centre India
Manjira Sinha, Xerox Research Centre India
Sandya Mannarswamy, Xerox Research Centre India

Related Resources

TextGraphs 2019   13th Workshop on Graph-based Methods for Natural Language Processing + Shared Task
ACL 2020   Annual Conference of the Association for Computational Linguistics
MSR 2019   Second Workshop on Multilingual Surface Realization (+ Shared task)
LREC 2020   12th Conference on Language Resources and Evaluation
FinSBD-2019 Shared Task 2019   [IJCAI-2019] Call for participation: FinSBD-2019 Shared Task - Sentence Boundary Detection in PDF Noisy Text in the Financial Domain
NCO 2020   6th International Conference on Signal and Image Processing
CL-SciSumm @SIGIR 2019   [CfP] CL-SciSumm @SIGIR 2019: 5th Computational Linguistics Scientific Document Summarization Shared Task
CHIIR 2020   ACM SIGIR Conference on Human Information Interaction and Retrieval
CFP MEDDOCAN track 2019   CFP: Automated named entity and de-identification of medical document shared task: MEDDOCAN track and prize
AIWolfDial SharedTask 2019   Call for Shared Task Participation: AI Werewolf and Dialog System (AIWolfDial2019)