posted by organizer: davidjrohde || 587 views || tracked by 2 users: [display]

ICBINB@NeurIPS 2023 : ICBINB@NeurIPS2023 - Failure Modes in the Age of Foundation Models


When Dec 16, 2023 - Dec 16, 2023
Where New Orleans
Submission Deadline Oct 1, 2023
Notification Due Oct 27, 2023
Final Version Due Nov 30, 2023
Categories    machine learning   NLP   philosophy of science

Call For Papers

Subject: Call For Papers ICBINB@NeurIPS2023 - Failure Modes in the Age of Foundation Models

We are happy to announce the I Can’t Believe It’s Not Better workshop at NeurIPS 2023. This year the workshop is titled Failure Modes in the Age of Foundation Models. We invite submissions that focus on surprising or negative results when using foundation models as well as submissions with more general negative results from machine learning. The full call for papers is below.

Key Information

Paper Submission Deadline - October 1, 2023 (Anywhere on Earth)

Workshop Website:

Call For Papers

The goal of the I Can’t Believe It’s Not Better workshop series is to promote “slow science” that pushes back against “leaderboard-ism”, and provides a forum to share surprising or negative results. In 2023 we propose to apply this same approach to the timely topic of foundation models.

The hype around ChatGPT, Stable Diffusion and SegmentAnything might suggest that all the interesting problems have been solved and artificial general intelligence is just around the corner. In this workshop we cooly reflect on this optimism, inviting submissions on failure modes of foundation models, i.e. unexpected negative results. In addition we invite contributions that will help us understand when we should expect foundation models to disrupt existing sub-fields of ML and when these powerful methods will remain complementary to another sub-field of machine learning.

We invite submissions on the following topics:
Failure modes of current foundation models (safety, explainability, methodological limitations, etc.)
Failure modes of applying foundation models, embeddings or other massive scale deep learning models.
Development of machine learning methodologies that benefit from foundation models, but necessitate other techniques.
Meta machine learning research and reflections on the impact of foundation models on the broader field of machine learning.
Negative scientific findings in a more general sense. In keeping with previous workshops we will accept findings on methodologies or tools that gave surprising negative results without foundation models. Such submissions are encouraged especially with discussion on the relevance of findings in the present climate where foundation models are changing the field.

Technical submissions may center on machine learning, deep learning or deep learning adjacent fields (causal DL, meta-learning, generative modelling, adversarial examples, probabilistic reasoning, etc) as well as domain specific applications.

Papers will be assessed on:
Clarity of writing
Rigor and transparency in the scientific methodologies employed
Novelty and significance of insights
Quality of discussion of limitations
Reproducibility of results

Selected papers will be optionally included in a special issue of PMLR. Alternatively, some authors may prefer their paper to be in the non-archival track which is to share preliminary findings that will later go to full review at another venue.

Related Resources

IEEE Xplore-Ei/Scopus-CSPIT 2023   2023 Asia Conference on Communications, Signal Processing and Information Technology (CSPIT 2023) -EI Compendex
FL@FM-NeurIPS 2023   International Workshop on Federated Learning in the Age of Foundation Models in Conjunction with NeurIPS 2023
IEEE Xplore-Ei/Scopus-DMCSE 2023   2023 International Conference on Data Mining, Computing and Software Engineering (DMCSE 2023) -EI Compendex
FLLM 2023   The International Symposium on Foundation and Large Language Models
CVPR 2024   The IEEE/CVF Conference on Computer Vision and Pattern Recognition
DIFM 2023   First Workshop on Distributed infrastructures for foundation models
JCICE 2024   2024 International Joint Conference on Information and Communication Engineering(JCICE 2024)
ICDE 2024   40th IEEE International Conference on Data Engineering
ICEFA 2024   Tenth International Conference on Engineering Failure Analysis
IEEE Big Data - MMAI 2023   IEEE Big Data 2023 Workshop on Multimodal AI (Hybrid)