posted by user: grupocole || 1408 views || tracked by 2 users: [display]

GEM 2023 : Generation, Evaluation & Metrics

FacebookTwitterLinkedInGoogle

Link: https://gem-benchmark.com/workshop
 
When Dec 6, 2023 - Dec 10, 2023
Where Singapore
Submission Deadline Sep 8, 2023
Notification Due Oct 6, 2023
Final Version Due Oct 18, 2023
Categories    NLP   computational linguistics   artificial intelligene
 

Call For Papers

The Third Version of the Generation, Evaluation & Metrics (GEM) Workshop will be held as part of EMNLP, December 6-10, 2023, Singapore.


The GEM workshop aims to encourage the development of model auditing & human evaluation strategies, and to popularize model evaluations in languages beyond English. We welcome submissions related, but not limited to, the following topics:
💎 Automatic evaluation of generation systems (example, example, example)
💎 Creating NLG corpora and challenge sets (example, example, example)
💎 Critiques of benchmarking efforts and responsibly measuring progress in NLG (example, example)
💎 Effective and/or efficient NLG methods that can be applied to a wide range of languages and/or scenarios (example, example, example)
💎 Application and evaluation of generation models interacting with external data and tools (example, example, example)
💎 Sociotechnical perspectives of employing large language models (example)
💎 Standardizing human evaluation and making it more robust (example, example, example)
If you are interested, you can check out last year's workshop websites from ACL 2021 and EMNLP 2022.


Industrial Track - Unleashing the Power of NLP: Bridging the Gap between Academia and Industry
GEM 2023 is proud to announce the launch of its Industrial Track, which aims to provide actionable insights to industry professionals and to foster collaborations between academia and industry.


Shared Task
We are organizing a shared task focused on multilingual summarization, including human and automatic evaluation. The Shared Task will be run "Backwards": the workshop will serve as a platform to pre-register your hypotheses. More info on how to participate to come!


Important Dates
Note: For any questions, please email gem-benchmark-chairs@googlegroups.com

Paper Submission Dates

📅 8 September 2023: Workshop paper submission deadline
📅 6 October 2023: Workshop paper notification deadline
📅 18 October 2023: Workshop paper camera ready deadline
Workshop Dates

📅 December 2023 EMNLP
Website: https://gem-benchmark.com/workshop

Related Resources

TRS 2025   Transportation Research Symposium
IEEE-Ei/Scopus-ITCC 2025   2025 5th International Conference on Information Technology and Cloud Computing (ITCC 2025)-EI Compendex
WMT-metrics 2024   WMT24 Metrics Task: Call for Participation
ACL 2025   The 63rd Annual Meeting of the Association for Computational Linguistics
GEM shared task 2024   GEM 2024 multilingual data-to-text and summarization shared task
DMML 2025   6th International Conference on Data Mining & Machine Learning
LDK 2025   Fifth Conference on Language, Data and Knowledge
SHM&ES 2025   Structural Health Monitoring & Engineering Structures
BIOEN 2025   8th International Conference on Biomedical Engineering and Science
EvalMG 2025   The First Workshop of Evaluation of Multi-Modal Generation @ COLING 2025