CLEF 2011 - CLEF 2011 : Conference on Multilingual and Multimodal Information Access Evaluation

Website clef2011.org | Edit Freely

Category CLEF 2011

Deadline: May 08, 2011 | Date: September 19, 2011-September 22, 2011

Venue/Country: Amsterdam, Netherlands

Updated: 2011-05-02 17:27:34 (GMT+9)

Call For Papers - CFP

AIMS AND SCOPE

The CLEF2011 conference aims at advancing the evaluation of complex multimodal and multilingual information systems in order to support individuals, organizations, and communities who design, develop, employ, and improve such systems. The growth of the Internet has been exponential with respect to the number of users, media, and languages used regularly for global information dissemination. Language and media barriers are no longer seen as inviolable and they are constantly crossed and mixed to provide content that can be accessed on a global scale within a multicultural and multilingual setting.

Users need to be able to co-operate and communicate across language and media boundaries, going beyond separate search in diverse media/languages and exploiting interactions between different languages and media.

Experimental evaluation ? both laboratory and interactive ? is a key to fostering the development of multilingual and multimodal information systems that address increasingly complex information needs.

We invite submissions for presentation at the CLEF2011 conference. We welcome submissions on all aspects of multilingual and multimodal information access evaluation. All submissions will be reviewed on the basis of relevance, originality, importance, and clarity.

FORMAT

The conference proceedings will be published in the Springer Lecture Notes in Computer Science (LNCS) series.

Authors are invited to submit electronically original papers, which have not been published and are not under consideration elsewhere, using the LNCS proceedings format. http://www.springer.com/computer/lncs?SGWID=0-164-7-72376-0

Two types of papers are solicited:

? full papers: 12 pages max;

? short papers: 6 pages max.

Papers will be peer-reviewed by at least 3 members of the program committee. Papers should be submitted in PDF format to the following address:

http://senldogo0039.springer-sbm.com/CLEF2011/servlet/Conference/

IMPORTANT DATES

? May 8th, 2011 Submission deadline

? June 10th, 2011 Notification of acceptance

? June 17th, 2011 Camera ready versions

? September 19th-22nd, 2011 CLEF Conference

TOPICS

Relevant topics for the CLEF2010 conference include but are not limited to:

? Novel methodologies for the design of evaluation tasks, especially user-centric ones;

? Analysis of the impact of multilingual/multicultural/multimodal differences in interface and search design;

? Assessing multilinguality and multimodality in relevant application communities, e.g. digital libraries, intellectual property, medical, music, video, and social media;

? Testing and evaluation of translation and summaries over documents and of linked documents in multilingual information retrieval;

? Benefits of multilingual information retrieval methods for different user groups or in different use cases, including those relevant to the developing world;

? Alternative methods for improving and automating ground-truth creation, for example crowd-sourcing or log-based;

? Alternatives and comparison of item-based, list-based, set-based, and session-based evaluation;

? Prediction of success and satisfaction rate;

? Task-oriented metrics of success and failure;

? Simulation (of queries, sessions, users) and information retrieval;

? Innovative and easy to communicate techniques for analysing the experimental results, including statistical analyses, data mining, and information visualization;

? Infrastructures for bringing automation and collaboration in the evaluation process;

? Living laboratories and evaluating live systems;

? Economic impact/sustainability of multilingual and multimodal information approaches, evaluation methodologies, and deployed systems.

ORGANIZATION

http://clef2011.org/index.php?page=pages/organizers.html