posted by organizer: finsim || 513 views || tracked by 1 users: [display]

[IJCAI 2021] FinSIM-3 Shared Task 2021 : Learning Semantic Similarities for the Financial Domain

FacebookTwitterLinkedInGoogle

Link: https://sites.google.com/nlg.csie.ntu.edu.tw/finnlp2021/shared-task-finsim
 
When Aug 21, 2021 - Aug 26, 2021
Where Montreal
Submission Deadline Jul 12, 2021
Categories    financial ontology   NLP/ML   semantic similarities   embeddings
 

Call For Papers

FinSIM-3 2021 shared task on Learning Semantic Similarities for the Financial Domain

Greetings,

We would like to invite you to submit to FinSIM-3, the 3rd shared task on Learning Semantic Similarities for the Financial Domain, held in conjunction with IJCAI 2021 @ Online, 21st -26th August, 2021 as part of the FinNLP-2021 workshop.

====================

Shared Task URL: https://sites.google.com/nlg.csie.ntu.edu.tw/finnlp2021/shared-task-finsim
Workshop URL: https://sites.google.com/nlg.csie.ntu.edu.tw/finweb2021
Registration Form: https://forms.gle/a9cRtYX5X94QCoYYA

_____________________________________________
The FinSim-3 shared task aims to spark interest from communities in NLP, ML/AI, Knowledge Engineering and Financial document processing. Going beyond the mere representation of words is a key step to industrial applications that make use of Natural Language Processing (NLP). This is typically addressed using either 1) Unsupervised corpus-derived representations like word embeddings, which are typically opaque to human understanding but very useful in NLP applications or 2) Manually tagged resources such as corpora, lexica, taxonomies and ontologies, which typically have low coverage and contain inconsistencies, but provide a deeper understanding of the target domain.
These two methods form the two ends of a spectrum which a number of approaches have attempted to combine, particularly in tasks aiming at expanding the coverage of manual resources using automatic methods.
The Semeval community has organized several evaluation campaigns to stimulate the development of methods which extract semantic/lexical relations between concepts/words (Bordea et al. 2015, Bordea et al. 2016, Jurgens et al. 2016, Camacho-Collados et al. 2018).
There are also a large number of datasets and challenges that specifically look at how to automatically populate knowledge bases such as DBpedia or Wikidata (e.g. KBP challenges).
To the best of our knowledge, FinSim 2020 was the first time a task attempting to combine these methods for the Financial domain.

The 3rd edition of FinSim-3 focuses on the evaluation of semantic representations by assessing the quality of the automatic classification of a given list of carefully selected terms from the Financial domain against a domain ontology. Participants will be given a list of carefully selected terms from the Financial domain such as “European depositary receipt”, “Interest rate swaps” and will be asked to design a system which can automatically classify them into the most relevant hypernym (or top-level) concept in an external ontology. For example, given the set of concepts “Bonds”, “Unclassified”, “Share”, “Loan”, the most relevant hypernym of “European depositary receipt” is “Share”.
In this new edition, we propose an extended dataset with more diversified financial concepts. We are interested in systems which make creative use of relevant resources such as ontologies and lexica, as well as systems which make use of contextual word embeddings such as BERT (Devlin et al. 2018).
Participating systems are expected to provide for each given term the most relevant concept (hypernym/synonym) in an external ontology: the Financial Industry Business Ontology (FIBO). Performance will be measured according to the accuracy with which financial terms are classified, and according to recall (based on the total number of predictions).
This task is open to everyone. The only exception are the co-chairs of the organizing team, who cannot submit a system, and who will serve as an authority to resolve any disputes concerning ethical issues or completeness of system descriptions.

A USD $1000 prize will be rewarded to the best-performing teams.
_____________________________________________

To register your interest in participating in FinSim shared task please use the following google form: https://forms.gle/JxmKfJ3to53dtWm76
__________________________________________

Important dates:

May 18, 2021: First announcement of the shared task and beginning of registration
May 28, 2021 : Release of training set & scoring scripts.
June 28, 2021: Release of test set.
June 28, 2021: Registration deadline.
July 02, 2021: System's outputs submission deadline.
July 05, 2021: Release of results.
July 07, 2021: Shared task title and abstract due
July 12, 2021: Shared task paper submissions due
July 16, 2021: Camera-ready version of shared task paper due

_________________________________________

Contact:
For any questions on the shared task please contact us on:
fin.sim.task@gmail.com
______________________________________


Shared task organizers:
- Youness Mansar, Fortia Financial Solutions
- Ismail El Maarouf, Fortia Financial Solutions
- Juyeon Kang, Fortia Financial Solutions
_________________________________________

References
Georgeta Bordea, Paul Buitelaar, Stefano Faralli and Roberto Navigli (2015). “SemEval-2015 Task 17: Taxonomy Extraction Evaluation (TExEval)”. In Proceedings of SemEval 2015, co-located with NAACL HLT 2015, Denver, Col, USA.
Georgeta Bordea, Els Lefever, and Paul Buitelaar (2016). “Semeval-2016 task 13: Taxonomy extraction evaluation (TExEval-2)”. In Proceedings of the 10th International Workshop on Semantic Evaluation, San Diego, CA, USA.
Jose Camacho-Collados, Claudio Delli Bovi, Luis Espinosa-Anke, Sergio Oramas, Tommaso Pasini, Enrico Santus, Vered Shwartz, Roberto Navigli, and Horacio Saggion (2018). “SemEval-2018 Task 9: Hypernym Discovery”. In Proceedings of the 12th International Workshop on Semantic Evaluation (SemEval-2018), New Orleans, LA, United States. Association for Computational Linguistics.
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova (2018). “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding”. https://arxiv.org/abs/1810.04805v2.
David Jurgens and Mohammad Taher Pilehvar (2016). “SemEval-2016 Task 14: Semantic Taxonomy Enrichment”. In Proceedings of SemEval-2016, NAACL-HLT.
The Financial Industry Business Ontology (FIBO): https://spec.edmcouncil.org/fibo/


Related Resources

Federated Learning in IOT Cybersecurity 2021   PeerJ Computer Science - Federated Learning for Cybersecurity in Internet of Things
XSA 2021   Explainable Deep Learning for Sentiment Analysis
IEEE COINS 2022   IEEE COINS 2022: Hybrid (3 days on-site | 2 days virtual)
[WWW 2021] FinSIM-2 Shared Task 2021   Learning Semantic Similarities for the Financial Domain
FinCausal 2021   Call for participation: FinCausal-2021 Shared Task, 3rd Financial Narrative Processing Workshop (FNP 2021)
SMART 2021   SeMantic Answer Type and Relation Prediction Task (SMART 2021)
FAIML 2022   2022 International Conference on Frontiers of Artificial Intelligence and Machine Learning (FAIML 2022)
SMM4H at NAACL 2021 2021   CFP ProfNER shared task: Identification of professions & occupations in Health-related Social Media (SMM4H at NAACL)
IEEE COINS 2022   Internet of Things IoT | Artificial Intelligence | Machine Learning | Big Data | Blockchain | Edge & Cloud Computing | Security | Embedded Systems |
CASE 2021   Call for Papers and Shared Task Participation: Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE) @ ACL-IJCNLP 2021