posted by user: grupocole || 1743 views || tracked by 3 users: [display]

SE 2008 : ACL 2008 Workshop on Semantic Evaluations: Recent Achievements and Future Directions


When Jun 19, 2008 - Jun 20, 2008
Where Columbus, OH, USA
Submission Deadline Mar 16, 2008
Notification Due Apr 14, 2008
Categories    NLP

Call For Papers



ACL 2008 Workshop on

Semantic Evaluations: Recent Achievements and Future Directions
19/20th June, 2008
Columbus, OH, USA

NEW Paper Submission deadline: March 16th, 2007 NEW

This workshop is endorsed by SIGLEX and SIGSEM
ACL Special Interest Group on the Lexicon
ACL Special Interest Group on Computational Semantics


Workshop Description

The main purpose of this workshop is to analyze and discuss the
results of systems participating in the SemEval-2007 evaluation. We
also expect discussion on further developments of related evaluation
exercises and systems. SemEval-2007 held nineteen different tasks,
which conducted evaluations of systems that perform automatic semantic
analysis of text, covering a wide range of aspects of semantics and


There are now many computer systems that do automatic semantic
analysis of text. The purpose of SemEval-2007 was to evaluate the
strengths and weaknesses of such systems with respect to different
words, relations, types of texts, different varieties of language, and
different languages. This workshop is a follow-up to the SemEval-2007
and Senseval series of workshops on semantic evaluation, and we also
want it to be a preparation for the next SemEval evaluation exercise.

Senseval-1 took place in the summer of 1998 for English, French, and
Italian, culminating in a workshop held at Herstmonceux Castle,
Sussex, England on September 2-4. Senseval-2 took place in the summer
of 2001, and was followed by a workshop held in July 2001 in Toulouse,
in conjunction with ACL-2001. It included tasks for 12 languages. A
follow-up workshop on the recent successes and future directions of
word sense disambiguation was held at ACL 2002. Senseval-3 took place
in the spring of 2004, and was followed by a workshop held in July
2004 in Barcelona, in conjunction with ACL-2004. More than 55 teams
participated with over 160 systems in its 16 tasks. SemEval-2007
organized 18 tasks, with over 100 teams and 125 systems
participating. The results of the tasks and systems were presented in
a workshop hold in conjunction with ACL-2007.

SemEval-2007 was motivated by a desire to broaden the spectrum of
accepted works to all aspects of computational semantic analysis of
language. It especially encouraged the proposal of tasks for different
languages, cross-lingual tasks, and tasks that are relevant to
particular NLP applications such as machine translation, information
retrieval and information extraction.

In recent years, the deployment of multiple semantic lexicons and
accordingly tagged corpora (WordNet-SemCor, VerbNet-PropBank, FrameNet
Prague Dependency Treebank and OntoNotes, to name a few) have
radically changed the way semantic analysis is performed, especially
at the disambiguation stage. Some of the tasks at SemEval-2007
tried to take this one step further by proposing multiple layers of
semantic annotation of the same corpus (e.g., senses, roles,
name-entity classes), allowing for novel research to be performed.

SemEval-2007 had a tight schedule, and the results and systems were
usually not known until the workshop was held. This fact, and the
growing number of tasks and systems made it difficult to fully analyze
the tasks and systems. This proposal allows for a better analysis of
the developments in this area.


This workshop invites the submission of original research papers
describing systems and systematic evaluation exercises on tasks related to
the SemEval-2007 evaluation or semantic processing in general.
Both system and evaluation exercise papers are expected to provide
insight on the semantic process where they focus, which include the

* shallow and deep semantic analysis
* word sense disambiguation
* semantic role labeling
* semantic relation identification
* named-entity classification
* analysis and disambiguation of prepositions
* metonymy resolution
* lexical substitution and paraphrasing
* textual entailment
* semantics in applications: IR, IE, MT, etc.


Authors are invited to submit full papers on original, unpublished
work in the topic area of this workshop. Full papers should be up to 8
pages in length, plus one page for references.

As reviewing will be blind, the paper should not include the authors'
names and affiliations. Furthermore, self-references that reveal the
author's identity, e.g., "We previously showed (Smith, 1991) ...",
should be avoided. Instead, use citations such as "Smith previously
showed (Smith, 1991) ...".

All submissions must be electronic in PDF. Please see the conference
website for detailed typesetting specifications. Authors are strongly
encouraged to use the LaTeX or Microsoft Word style files available at

Submission will be electronic, using the START paper submission
website. The submission deadline is March 9th, 2007. The START
submission page is

Important Dates (NEW!!)

March 16, 2008 - Paper Submission due
April 14, 2008 - Notification of acceptance
April 21, 2008 - Camera ready papers due

Organising Committee

Eneko Agirre (University of the Basque Country, UPV/EHU, Basque Country)
Lluí­s Màrquez (Technical University of Catalonia, UPC, Spain)
Richard Wicentowski (Swarthmore College, USA)

Address any queries regarding the workshop to:

sew2008org at googlegroups com

Programme Committee

* Eneko Agirre, University of the Basque Country, Basque Country
* Timothy Baldwin, Melbourne University, Australia
* Nicoletta Calzolari, Istituto di Linguistica Computazionale, Italy
* Xavier Carreras, MIT, USA
* Walter Daelemans, University of Antwerp, Belgium
* Mona Diab, Columbia University, USA
* Katrin Erk, University of Texas, USA
* Roxana Girju, University of Illinois at Urbana-Champaign, USA
* Veronique Hoste, University College Ghent, Ghent
* Eduard Hovy, Information Science Institute, USA
* Nancy Ide, Vassar College, USA
* Adam Kilgarriff, Lexical Computing Ltd, UK
* Kenneth Litkowski, CL Research, USA
* Bernardo Magnini, FBC, Italy
* Katja Markert, Leeds University, UK
* Llu?­s M? rquez, Technical University of Catalonia, Spain
* David Mart?­nez, University of Melbourne, Australia
* Diana McCarthy, University of Sussex, UK
* Rada Mihalcea University of North Texas, USA
* Roberto Navigli, University of Rome "La Sapienza", Italy
* Hwee Tou Ng, National University of Singapore, Singapore
* Ted Pedersen, University of Minnesota in Duluth, USA
* Philip Resnik, University of Maryland, USA
* German Rigau, University of the Basque Country, Basque Country
* Mark Stevenson, University of Sheffield, UK
* Suzanne Stevenson, University of Toronto, Canada
* Carlo Strapparava, FBC, Italy
* Mihai Surdeanu, Barcelona Media Innovation Center, Spain
* Stan Szpakowicz, Univerity of Ottawa, Canada
* Richard Wicentowski, Swarthmore College, USA
* Yorick Wilks, University of Sheffield, UK
* Dekai Wu, The Hong Kong University of Science & Technology, China
* Scott Yih, Microsoft, USA
* Deniz Yuret, Koc University, Turkey

Related Resources

ACL 2022   60th Annual Meeting of the Association for Computational Linguistics
ACM-Ei/Scopus-ITNLP 2022   2022 2nd International Conference on Information Technology and Natural Language Processing (ITNLP 2022) -EI Compendex
NLPTA 2022   3rd International Conference on NLP Techniques and Applications
ISA 2022   18th Joint ACL - ISO Workshop on Interoperable Semantic Annotation
ACL / NAACL-HLT / EMNLP / COLING 2022   ACL 2022 - NAACL 2022 - COLING 2022 - EMNLP 2022 Joint Call for Tutorials
IEEE Big Data - MMBD 2022   IEEE Big Data 2022 Workshop on Multimodal Big Data
ISWC 2022   The 21st International Semantic Web Conference
ACII 2022   Advanced Computational Intelligence: An International Journal
RAMFP 2022   TAA (OA) - SI: Recent Advances on Metric Fixed Point Theory 2022
NLTM 2023   3rd International Conference on NLP & Text Mining