CLEF eHealth Evaluation Lab 2017
Held as part of CLEF 2017, September 11-14 2017, Dublin — Ireland
Offering shared tasks and data on:
*Multilingual Information Extraction*
*Technologically Assisted Reviews in Empirical Medicine*
*Patient-centred Information Retrieval*
Register at: http://clef2017-labs-registration.dei.unipd.it/
Registration Closes: 21 April 2017
Details at: https://sites.google.com/site/clefehealth2017/
In today’s information overloaded society it is increasingly difficult to retrieve and digest valid and relevant information to make health-centered decisions. Medical content is becoming available electronically in a variety of forms ranging from patient records and medical dossiers, scientific publications and health-related websites to medical-related topics shared across social networks. Laypeople, clinicians and policy-makers need to easily retrieve, and make sense of medical content to support their decision making. Information retrieval systems have been commonly used as a means to access health information available online. However, the reliability, quality, and suitability of the information for the target audience varies greatly while high recall or coverage, that is finding all relevant information about a topic, is often as important as high precision, if not more. Furthermore, the information seekers in the health domain also experience difficulties in expressing their information needs as search queries.
CLEF eHealth aims to bring together researchers working on related information access topics and provide them with datasets to work with and validate the outcomes. This, the sixth year of the lab, offers the following three tasks.
Task 1. Multilingual Information Extraction
Task 2. Technologically Assisted Reviews in Empirical Medicine
Task 3. Patient-centred Information Retrieval
The lab also offers a student mentoring track. Contact the lab chairs if you are interested in taking part in this track.
Please register at http://clef2017-labs-registration.dei.unipd.it/
and see https://sites.google.com/site/clefehealth2017/ for full details.
The vision for the Lab is two-fold: (1) to develop tasks that potentially impact patient understanding of medical information and (2) to provide the community with an increasingly sophisticated dataset of clinical narrative, enriched with links to evidence-based care guidelines, systematic reviews, and other further information, to advance the state-of-the-art in multilingual information extraction and information retrieval in health care. Furthermore, we aim to support reproducible research by encouraging participants to reflect on methods and practical steps to take to facilitate the replication of their experiments. In particular, we call participants to submit their systems and configuration files, and independent researchers to reproduce the results of the participating teams.
CLEF eHealth for You
The tasks are open to everybody. We particularly welcome academic and industrial researchers, scientists, engineers and graduate students in information retrieval, natural language processing, machine learning and biomedical/health informatics to participate. We also encourage participation by multidisciplinary teams that combine technological skills with clinical expertise.
For students: annotated data; methods and code for processing and evaluation to lower the entry barrier; evaluation results, benchmarked against other participants and organisers’ methods; student mentoring; working notes paper; professional networks
For supervisors: tasks with data, methods, code, evaluations, and mentoring for your student theses/projects or course assignments; working notes paper that can be extended to journal/conference papers; and professional networks
For researchers: annotated data; methods and code for processing and evaluation to lower the entry barrier; evaluation results, benchmarked against other participants and organisers’ methods; working notes paper that can be extended to journal/conference papers; and professional networks
For engineers/industrial participants: annotated data; methods and code for processing and evaluation to lower the entry barrier; evaluation results, benchmarked against other participants and organisers’ methods; repeatable evaluations to test your software on; and professional networks
CLEF eHealth Contacts
CLEF eHealth Chairs: Lorraine Goeuriot (lorraine.goeuriot [at] imag.fr), Liadh Kelly (liadh.kelly [at] tcd.ie), and Hanna Suominen (hanna.suominen [at] anu.edu.au)
Task 1 Leaders: Aurélie Névéol (aurelie.neveol [at] limsi.fr) and Aude Robert (aude.robert [at] inserm.fr)
Task 2 Leaders: Evangelos Kanoulas (E.Kanoulas [at] uva.nl), Rene Spijker (renespijker [at] gmail.com)
Task 3 Leaders: Joao Palotti (joaopalotti [at] gmail.com) and Guido Zuccon (g.zuccon [at] qut.edu.au)