posted by user: aellenhicks || 279 views || tracked by 1 users: [display]

EDGeS 2023 : AAAI Spring Symposium Series - Evaluation and Design of Generalist Systems (EDGeS): Challenges and methods for assessing the new generation of AI With the advent of


When Mar 27, 2023 - Mar 29, 2023
Where Palo Alto, CA
Submission Deadline Jan 23, 2023
Notification Due Feb 6, 2023
Final Version Due Mar 3, 2023
Categories    reasoning   foundation models   general ai   evaluation

Call For Papers

With the advent of large domain-universal models, we are witnessing a trend towards generalist AI systems, no longer restricted to narrow tasks. Alongside this trend has been a resurgence of research in symbolic AI, to support common sense reasoning, explanation, and learning with limited training data. There are few extant strategies for assessing modern generalist AI systems, symbolic AI systems, or combinations thereof; assessing the next generation of AI will require novel tools, methods, and benchmarks that address both reasoning and generalist systems, individually and combined holistically.

In the interest of fostering discussion of methodologies for understanding and assessing AI in the domains of reasoning and generativity, we are accepting submissions on topics including (not exhaustive):

Novel training protocols for achieving generalist performance in reasoning and generative tasks
Limitations of current approaches in AI/Machine learning
Novel methodologies to assess progress on increasingly general AI
Methods and tools for identification of vulnerabilities in modern reasoning systems
Quantifiable approaches to assessing ethical robustness of generalist AI systems
Relevant architectures involving neuro-symbolics, neural network-based foundation models, generative AI, common sense reasoning, statistical and relational AI
Architecture for systems capable of reasoned self-verification and ethical robustness
Description of novel systems that combine reasoning with generativity
This format of the symposium will include invited talks and contributed paper presentations by leading researchers and technical experts, as well as panel discussions and group breakout sessions focusing on the implementation of competency assessment in real autonomous systems.

Participants will be invited to submit:

Full technical papers (6-8 pages)
Technical presentation (including abstract ( 2 pages and biography of main speaker)
Position papers (4-6 pages)
Manuscripts must be submitted as PDFs via EasyChair:
Please align with AAAI format:

Important dates
Abstract submission: Deadline extended to 23 Jan, 2023
Notification: 6th of February 2023
Registration: 27th of February 2023
Camera-ready submission: 3rd of March 2023

Organizing Committee
Joscha Bach, Intel Labs, Committee Co-Chair
John Piorkowski, Johns Hopkins University, Committee Co-Chair
Amanda Hicks, Johns Hopkins University Applied Physics Lab
Tetiana Grinberg, Intel Labs
John Beverley, University at Buffalo
Steven Rogers, Air Force Research Laboratory
Grant Passmore, Imandra
Ramin Hasani, MIT CSAIL
Casey Richardson, S&P Global
Richard Granger, Dartmouth College
Jascha Achterberg, University of Cambridge
Kristinn R. Thórisson, Reykjavik University, IIIM
Luc Steels, Barcelona Supercomputing Center
Yulia Sandamirskaya, Neuromorphic Computing lead, Intel Labs
For more information:

Related Resources

AAAI 2023   The 37th AAAI Conference on Artificial Intelligence
JELIA 2023   18th European Conference on Logics in Artificial Intelligence
aes23   aes23 International Evaluation Conference call for proposals
AAAI Spring Symposia 2023   AAAI Spring Symposium Series
QPP++ 2023   QPP++ 2023: Query Performance Prediction and Its Evaluation in New Tasks
AAAI-MAKE 2023   AAAI 2023 Spring Symposium on Challenges Requiring the Combination of Machine Learning and Knowledge Engineering
MLmDS 2023   AAAI 2023 Workshop: When Machine Learning meets Dynamical Systems: Theory and Applications
AAAI Fast Track 2023   The 37th AAAI Conference on Artificial Intelligence (Fast Track)
IEEE SSCI 2023   2023 IEEE Symposium Series on Computational Intelligence
ITISE 2023   International conference on Time Series and Forecasting