CFP: Forum for Information Retrieval Evaluation, Gandhinagar, India

CALL FOR PARTICIPATION FIRE (Forum for Information Retrieval Evaluation) Workshop DAIICT, Gandhinagar, India 19-21 February 2010 http://www.isical.ac.in/~fire The success of TREC, CLEF, and NTCIR has clearly established the importance of building reusable, large-scale standard test collections in Information Access research. The aim of FIRE is to encourage research in Indian language Information Access by creating a similar platform for Indian languages that provides the data and a common forum for comparing models and techniques. The Tasks: 1) Ad-hoc monolingual document retrieval in Bengali, Hindi and Marathi. 2) Ad-hoc cross-lingual document retrieval - documents in Bengali, Hindi, Marathi, and English, - queries in Bengali, Hindi, Marathi, Tamil, Telugu and English. - Bengali and Hindi topics will also be transliterated and made available in Roman script. Adhoc monolingual task participants are encouraged to submit runs using these queries as well. 3) Ad-hoc retrieval from technically oriented mailing lists and discussion forums. This is a pilot task being offered by IBM India Research Lab. 4) Ad-hoc Wikipedia-entity retrieval from news documents - Entities mined from English Wikipedia - Query documents from English news website This is a pilot task being offered by Yahoo! Labs, Bangalore Important Dates: Ad-hoc monolingual and cross-lingual document retrieval: Training data release Aug 15 '09 Test data release Oct 15 '09 Adhoc run submission Nov 25 '09 Results released Feb 01 '10 Ad-hoc retrieval from mailing lists and discussion forums: Training data release Aug 15 '09 Test data release Nov 01 '09 Run submission Nov 25 '09 Results declared Feb 01 '10 Ad-hoc Wikipedia-entity retrieval from news documents: Training data release Oct 15 '09 Test data release Nov 01 '09 Run submission Nov 25 '09 Results declared Feb 01 '10 Task Co-ordinators: Ad-hoc retrieval: Pushpak Bhattacharyya (pb@cse.iitb.ac.in) IIT Bombay Dipasree Pal (dipasree_t@isical.ac.in) ISI Kolkata Retrieval from mailing lists and discussion forums: Debapriyo Majumdar (debapriyo.majumdar@gmail.com) IBM India Research Lab Ayan Bandyopadhyay (ayan_t@isical.ac.in) ISI Kolkata Ad-hoc Wikipedia-entity retrieval from news documents: Ashwin Tengli (ashwint@yahoo-inc.com) Yahoo! Labs, Bangalore Pabitra Mitra (pabitra@cse.iitkgp.ernet.in) IIT Kharagpur Overall co-ordinators: Prasenjit Majumder (p_majumder@daiict.ac.in) DAIICT, Gandhinagar Mandar Mitra (mandar@isical.ac.in) ISI Kolkata International Advisory Committee for FIRE: Amit Singhal, Google Fellow, USA Carol Peters, ISTI-CNR, Italy Christian Fluhr, CEA, France Donna Harman, National Institute of Standards and Technology, USA Doug Oard, University of Maryland, USA Ee Peng Lim, Nanyang Technological University, Singapore Ellen Voorhees, National Institute of Standards and Technology, USA Fabrizio Sebastiani, ISTI-CNR, Italy Gareth Jones, Dublin City University, Ireland. Hsin-Hsi Chen, National Taiwan University, Taipei, Taiwan Hwee Tou Ng, National University of Singapore, Singapore Iadh Ounis, University of Glasgow, UK Ian Soboroff, National Institute of Standards and Technology, USA Jacques Savoy, University of Neuchatel, Switzerland James Allan, University of Massachusetts Amherst, USA Krishna Kummamuru, IBM Research Lab, India Mark Sanderson, University of Sheffield, UK Mun Kew Leong, Institute for Infocomm Research, Singapore Norbert Fuhr, University of Duisburg, Germany Noriko Kando, National Institute of Informatics, Japan Paul McNamee, Johns Hopkins University, USA Prabhakar Raghavan, Yahoo! Research Labs, USA Ricardo Baeza-Yates, Yahoo! Research Labs, Spain Stephen Robertson, Microsoft Research, Cambridge, UK Sung Hyon Myaeng, KAIST, South Korea Tat-Seng Chua, National University of Singapore, Singapore Tetsuya Sakai, NewsWatch Inc., Japan