posted by user: grupocole || 1152 views || tracked by 2 users: [display]

GEM 2023 : Generation, Evaluation & Metrics

FacebookTwitterLinkedInGoogle

Link: https://gem-benchmark.com/workshop
 
When Dec 6, 2023 - Dec 10, 2023
Where Singapore
Submission Deadline Sep 8, 2023
Notification Due Oct 6, 2023
Final Version Due Oct 18, 2023
Categories    NLP   computational linguistics   artificial intelligene
 

Call For Papers

The Third Version of the Generation, Evaluation & Metrics (GEM) Workshop will be held as part of EMNLP, December 6-10, 2023, Singapore.


The GEM workshop aims to encourage the development of model auditing & human evaluation strategies, and to popularize model evaluations in languages beyond English. We welcome submissions related, but not limited to, the following topics:
💎 Automatic evaluation of generation systems (example, example, example)
💎 Creating NLG corpora and challenge sets (example, example, example)
💎 Critiques of benchmarking efforts and responsibly measuring progress in NLG (example, example)
💎 Effective and/or efficient NLG methods that can be applied to a wide range of languages and/or scenarios (example, example, example)
💎 Application and evaluation of generation models interacting with external data and tools (example, example, example)
💎 Sociotechnical perspectives of employing large language models (example)
💎 Standardizing human evaluation and making it more robust (example, example, example)
If you are interested, you can check out last year's workshop websites from ACL 2021 and EMNLP 2022.


Industrial Track - Unleashing the Power of NLP: Bridging the Gap between Academia and Industry
GEM 2023 is proud to announce the launch of its Industrial Track, which aims to provide actionable insights to industry professionals and to foster collaborations between academia and industry.


Shared Task
We are organizing a shared task focused on multilingual summarization, including human and automatic evaluation. The Shared Task will be run "Backwards": the workshop will serve as a platform to pre-register your hypotheses. More info on how to participate to come!


Important Dates
Note: For any questions, please email gem-benchmark-chairs@googlegroups.com

Paper Submission Dates

📅 8 September 2023: Workshop paper submission deadline
📅 6 October 2023: Workshop paper notification deadline
📅 18 October 2023: Workshop paper camera ready deadline
Workshop Dates

📅 December 2023 EMNLP
Website: https://gem-benchmark.com/workshop

Related Resources

GEM shared task 2024   GEM 2024 multilingual data-to-text and summarization shared task
ACM-Ei/Scopus-CCISS 2024   2024 International Conference on Computing, Information Science and System (CCISS 2024)
IPM-LLMDQKG 2025   Special issue of Information Processing & Management on Large Language Models and Data Quality for Knowledge Graphs
SEMANTiCS 2024   20th International Conference on Semantic Systems
PEMWN 2024   Performance Evaluation & Modeling in Wired and Wireless Networks
ISEEIE 2024   2024 4th International Symposium on Electrical, Electronics and Information Engineering (ISEEIE 2024)
Security 2025   Special Issue on Recent Advances in Security, Privacy, and Trust
COMIT 2024   8th International Conference on Computer Science and Information Technology
IEEE GEM 2024   2024 IEEE CTSoc Conference on Gaming, Entertainment and Media (GEM 2024)
EAIH 2024   Explainable AI for Health