 |
Coling 2008 workshop on
human judgements in Computational Linguistics
Manchester, 23 August 2008
|
In connection with Coling
2008, the 22nd International Conference on Computational
Linguistics
18-22 August 2008
Workshop Topic
Human judgements play a key role in the development and the assessment
of linguistic resources and methods in Computational Linguistics. They
are commonly used in the creation of lexical resources and corpus
annotation, and also in the evaluation of automatic approaches to
linguistic tasks: In the developmental phase, human judgements help to
define an inventory of categories as well as robust annotation
criteria, and in the assessment phase they are used to evaluate the
results of automatic systems against existing linguistic
standards. Furthermore, systematically collected human judgements
provide clues for research on linguistic issues that underlie the
judgement task, providing insights complementary to introspective
analysis or evidence gathered from corpora.
The goal of this workshop is to discuss experiments that collect human
judgements for Computational Linguistic purposes. A particular focus
of the workshop is concerned with human judgements on "controversial"
linguistic tasks (those that are not clear from a theoretical point of
view, such as many tasks having to do with semantics or pragmatics),
which tend to result in low agreement scores. Such controversial tasks
and their sub-optimal results are typically poorly documented in the
literature; however, they are especially well-suited as a basis for a
fruitful discussion.
Location
The workshop will be held at the University of Manchester, Alan
Turning building, room G205. This is location B on the Coling
location map.
Important Dates
| Paper submission deadline: | 10 May 2008 |
| Notification of acceptance: | 10 June 2008 |
| Camera-ready copy due: | 01 July 2008 |
| Workshop date: | 23 August 2008 |
Workshop Organizers
Ron Artstein, University of Southern California
Gemma Boleda, Universitat Politècnica de Catalunya
Frank Keller, University of Edinburgh
Sabine Schulte im Walde, Unversität Stuttgart
Keynote Speaker
Martha Palmer,
University of Colorado
Programme Committee
Toni Badia, Universitat Pompeu Fabra
Marco Baroni, University of Trento
Beata Beigman Klebanov, Northwestern University
André Blessing, Universität Stuttgart
Chris Brew, Ohio State University
Kevin Cohen, University of Colorado Health Sciences Center
Barbara Di Eugenio, University of Illinois at Chicago
Katrin Erk, University of Texas at Austin
Stefan Evert, University of Osnabrück
Afsaneh Fazly, University of Toronto
Alex Fraser, Universität Stuttgart
Jesus Gimenez, Universitat Politècnica de Catalunya
Roxana Girju, University of Illinois at Urbana-Champaign
Ed Hovy, University of Southern California
Nancy Ide, Vassar College
Adam Kilgarriff, University of Brighton
Alexander Koller, University of Edinburgh
Anna Korhonen, University of Cambridge
Mirella Lapata, University of Edinburgh
Diana McCarthy, University of Sussex
Alissa Melinger, University of Dundee
Paola Merlo, University of Geneva
Sebastian Padó, Stanford University
Martha Palmer, University of Colorado
Rebecca Passonneau, Columbia University
Massimo Poesio, University of Trento
Sameer Pradhan, BBN Technologies
Horacio Rodriguez, Universitat Politècnica de Catalunya
Bettina Schrader, Universität Potsdam
Suzanne Stevenson, University of Toronto
Contact Information
Please email hjcl_workshop@inf.ed.ac.uk
if you have questions regarding the workshop.
Financial Support
Supported by the Spanish Education and Science Ministery via the KNOW
project (TIN2006-15049-C03-03) and by Sonderforschungsbereich
732, Universität Stuttgart.
created 2008-02-20, last modified 2008-09-19