posted by organizer: skallumadi || 11752 views || tracked by 3 users: [display]

SIGIR eCom DC 2020 : The 2020 SIGIR Ecom Data Challenge : Multi-modal Product Data Classification and Retrieval challenge


When Jul 30, 2020 - Jul 30, 2020
Where Xi'an
Abstract Registration Due Jul 15, 2020
Submission Deadline Jul 22, 2020
Notification Due Jul 23, 2020
Final Version Due Jul 27, 2020
Categories    ecommerce   NLP   information retrieval   classification

Call For Papers

Call for Participation

The 2020 SIGIR workshop on eCommerce is hosting the Rakuten Multi-modal Product Data Classification and Retrieval challenge. This challenge focuses on two topics, namely large-scale multi-modal (text and image) classification and cross-modal retrieval. The goal of the multi-modal classification task is to predict each product’s 'type code' as defined in the catalog of Rakuten France. In the cross-modal retrieval task, presented with the text of the products, the goal is to retrieve the images corresponding to the products.

Challenge website:

Important Dates:
Data Challenge opens: April 20, 2020
Final Leaderboard - July 22, 2020
SIGIR eCom Full day Workshop - July 30, 2020

Task Description:

The cataloging of product listings through some type of text or image categorization method is a fundamental problem for any e-commerce marketplace, with applications ranging from personalized search and recommendations to query understanding. Manual and rule-based approaches to categorization are not scalable since commercial products are organized in many and sometimes thousands of classes. When actual users categorize product data, it has often been observed that not only the text of the title and description of the product is useful but also its associated images.


The main tasks for this challenge are as follows:
1. Multi-modal classification. Given a training set of products and their product type codes, predict the corresponding product type codes for an unseen held out test set of products. The systems are free to use the available textual titles and/or descriptions whenever available and additionally the images to allow for true multi-modal learning.
2. Cross-modal retrieval. Given an held-out test set of product items with their titles and (possibly empty) descriptions, predict the best image from among a set of test images that correspond to the products in the test set.

Participation and Data:

The data challenge is open to everyone.

For this challenge, Rakuten France has released approximately 99K product listings in tsv format, including a training (84,916) and test set (13,812). The dataset consists of product titles, product descriptions, product images and their corresponding product type codes. The test set will be released towards the end of the data challenge. Furthermore, one can assume the test set has been generated from the same data distribution as the training set.

Details about evaluation metrics and other aspects of the task can be found at the website:

Important Dates:
Data Challenge opens: April 20, 2020
Final Leaderboard - July 22, 2020
SIGIR eCom Full day Workshop - July 30, 2020

Related Resources

AAAI 2023   The 37th AAAI Conference on Artificial Intelligence
IEEE Xplore-Ei/Scopus-CSPIT 2023   2023 Asia Conference on Communications, Signal Processing and Information Technology (CSPIT 2023) -EI Compendex
SIGIR-AP 2023   1st International ACM SIGIR Conference on Information Retrieval in the Asia Pacific
IEEE Xplore-Ei/Scopus-DMCSE 2023   2023 International Conference on Data Mining, Computing and Software Engineering (DMCSE 2023) -EI Compendex
SIGIR-KDF 2023   The 4th Workshop on Knowledge Discovery from Unstructured Data in Financial Services
LREC-COLING 2024   The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation
NLDML 2024   3rd International Conference on NLP, Data Mining and Machine Learning
ICDM 2024   24th Industrial Conference on Data Mining
EACL 2024   The 18th Conference of the European Chapter of the Association for Computational Linguistics
MLDM 2024   20th International Conference on Machine Learning and Data Mining