posted by organizer: aliskin || 998 views || tracked by 2 users: [display]

Crowd Science Workshop on WSDM 2023 : WSDM 2023 Crowd Science Workshop on Collaboration of Humans and Learning Algorithms for Data Labeling

FacebookTwitterLinkedInGoogle

Link: https://toloka.ai/events/wsdm-2023/
 
When Mar 3, 2023 - Mar 3, 2023
Where Singapore
Submission Deadline Jan 15, 2023
Notification Due Feb 1, 2023
Categories    crowdsourcing   active learning
 

Call For Papers

Crowdsourcing has been used to produce impactful and large-scale datasets for Machine Learning and Artificial Intelligence (AI), such as ImageNET, SuperGLUE, etc. Since the rise of crowdsourcing in the early 2000s, the AI community has been studying its computational, system design, and data-centric aspects from various angles at such workshops as CSS, CrowdML, DCAI, and HILL.

This workshop focuses on improving the welfare of the invisible labeling crowd force behind the AI, i.e., the crowdworkers.

# Focus Areas

We welcome studies that focus on the following (non-exhaustive) list of topics:

- developing and enhancing crowdworker-centric tools that offer task matching, requester assessment, and instruction validation, among other topics;
— active learning techniques, methods for joint learning from noisy data and from crowds, novel approaches for crowd-computer interaction, repetitive task automation, and role separation between humans and machines;
- designing and applying such techniques in various domains, including e-commerce and medicine.

# Guidelines and Submission

Find format guidelines and submit a paper!

https://easychair.org/cfp/wsdm2023crowdscience

Submissions due: January 5, 2023
Notifications due: February 1, 2023
Workshop date: March 3, 2023

# Paper Presentation

At least one author of each accepted paper must register for the main conference, WSDM 2023, to present their work.

# Invited Speakers

Ujwal Gadiraju, Delft University of Technology
Djellel Difallah, NYU Abu Dhabi

# Organizers

- Dmitry Ustalov, Toloka, Belgrade, Serbia
- Saiph Savage, Northeastern University Boston, MA, USA
- Niels van Berkel, University of Aalborg Aalborg, Denmark
- Yang Liu, University of California Santa Cruz, Santa Cruz, USA
- Alisa Smirnova, Toloka, Lucerne, Switzerland

Don’t hesitate to contact us at research@toloka.ai if you have any questions or suggestions regarding this workshop.

Related Resources

WSDM 2025   18th ACM International Conference on Web Search and Data Mining
IEEE-Ei/Scopus-ITCC 2025   2025 5th International Conference on Information Technology and Cloud Computing (ITCC 2025)-EI Compendex
SPIE-Ei/Scopus-DMNLP 2025   2025 2nd International Conference on Data Mining and Natural Language Processing (DMNLP 2025)-EI Compendex&Scopus
WSDM 2024   17th ACM International Conference on Web Search and Data Mining
IEEE-Ei/Scopus-CNIOT 2025   2025 IEEE 6th International Conference on Computing, Networks and Internet of Things (CNIOT 2025) -EI Compendex
ACM SAC 2025   40th ACM/SIGAPP Symposium On Applied Computing
CSITEC 2025   11th International Conference on Computer Science, Information Technology
SEAS 2025   14th International Conference on Software Engineering and Applications
ISCSIC 2025   2025 9th International Symposium on Computer Science and Intelligent Control(ISCSIC 2025)
CETA--EI 2025   2025 4th International Conference on Computer Engineering, Technologies and Applications (CETA 2025)