posted by user: grupocole || 837 views || tracked by 2 users: [display]

GEM 2023 : Generation, Evaluation & Metrics


When Dec 6, 2023 - Dec 10, 2023
Where Singapore
Submission Deadline Sep 8, 2023
Notification Due Oct 6, 2023
Final Version Due Oct 18, 2023
Categories    NLP   computational linguistics   artificial intelligene

Call For Papers

The Third Version of the Generation, Evaluation & Metrics (GEM) Workshop will be held as part of EMNLP, December 6-10, 2023, Singapore.

The GEM workshop aims to encourage the development of model auditing & human evaluation strategies, and to popularize model evaluations in languages beyond English. We welcome submissions related, but not limited to, the following topics:
💎 Automatic evaluation of generation systems (example, example, example)
💎 Creating NLG corpora and challenge sets (example, example, example)
💎 Critiques of benchmarking efforts and responsibly measuring progress in NLG (example, example)
💎 Effective and/or efficient NLG methods that can be applied to a wide range of languages and/or scenarios (example, example, example)
💎 Application and evaluation of generation models interacting with external data and tools (example, example, example)
💎 Sociotechnical perspectives of employing large language models (example)
💎 Standardizing human evaluation and making it more robust (example, example, example)
If you are interested, you can check out last year's workshop websites from ACL 2021 and EMNLP 2022.

Industrial Track - Unleashing the Power of NLP: Bridging the Gap between Academia and Industry
GEM 2023 is proud to announce the launch of its Industrial Track, which aims to provide actionable insights to industry professionals and to foster collaborations between academia and industry.

Shared Task
We are organizing a shared task focused on multilingual summarization, including human and automatic evaluation. The Shared Task will be run "Backwards": the workshop will serve as a platform to pre-register your hypotheses. More info on how to participate to come!

Important Dates
Note: For any questions, please email

Paper Submission Dates

📅 8 September 2023: Workshop paper submission deadline
📅 6 October 2023: Workshop paper notification deadline
📅 18 October 2023: Workshop paper camera ready deadline
Workshop Dates

📅 December 2023 EMNLP

Related Resources

EACL 2024   The 18th Conference of the European Chapter of the Association for Computational Linguistics
LREC-COLING 2024   The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation
RTME 2024   9th International Conference on Recent Trends in Mechanical Engineering
CfP: PEVA Special Issue 2024   CfP: PEVA Special Issue: Performance Analysis and Evaluation of Systems for Artificial Intelligence
IEEE Big Data - MMAI 2023   IEEE Big Data 2023 Workshop on Multimodal AI (Hybrid)
GENEA 2023   Generation and Evaluation of Non-verbal Behaviour for Embodied Agents Workshop 2023
NLDML 2024   3rd International Conference on NLP, Data Mining and Machine Learning
ISEEIE 2024   2024 4th International Symposium on Electrical, Electronics and Information Engineering (ISEEIE 2024)
Security 2025   Special Issue on Recent Advances in Security, Privacy, and Trust
ICCIoT 2024   5th International Conference on Cloud and Internet of Things