FNS 2021 : Training and validation FNS - 2021 released
Call For Papers
We have released the training and validation datasets for FNS 2021. The dataset can be found here:
We will be using the ROUGE-2 metric for evaluation.
Shared task details:
FNS-2021 Shared Task: “Financial Narrative Summarisation”
To be held at The 3rd Financial Narrative Processing Workshop (FNP 2021)
Lancaster, United Kingdom [online] on 15 and 16 September 2021. A free 2 day event.
Shared Task URL: http://wp.lancs.ac.uk/cfie/fns2021/
Workshop URL: http://wp.lancs.ac.uk/cfie/fnp2021/
Participation Form: http://bit.ly/34xWCCp
Awards and Prizes:
The winning team for FNS 2021 shared task will receive an achievement certificate and a money prize worth US$650. The team will also be given the chance to present their work at the workshop.
Shared Task Description:
The Structure-based Financial Narrative Summarisation (SB-FNS) aims to demonstrate the value and challenges of applying automatic text summarisation to financial text written in English, usually referred to as financial narrative disclosures. The task dataset has been extracted from UK annual reports published in PDF file format. The participants will be asked to provide structured summaries, based on real-world, publicly available financial annual reports of UK firms by extracting information from different key sections. Participants will be asked to generate summaries that reflects the analysis and assessment of the financial trend of the business over the past year, as provided by annual reports. The evaluation of the summaries will be performed using Rouge automatic metrics.
The shared task requires extraction from different key sections found in the annual reports produced by UK firms listed on The London Stock Exchange (LSE). Those sections are usually referred to as “narrative sections” or “front-end” sections and they usually contain textual information and reviews by the firm’s management and board of directors. Sections containing financial statements in terms of tables and numbers are usually referred to as “back-end” sections and are not supposed to be part of the narrative summaries. UK annual reports are lengthy documents with around 80 pages on average, some annual reports could span over more than 250 pages, making the summarisation task a challenging but an academically interesting one.
For the purpose of this task we will ask the participants to produce one summary for each annual report. The summary length should not exceed 1000 words. We advise that the summary is generated/extracted based on the narrative sections, therefore the participating summarisers need to be trained to detect narrative sections before creating the summaries. The MultiLing team along with help from Barcelona’s UPF summarisation team will help in organising the shared task including the generation of the evaluation results and final proceedings. The MultiLing team have a rich experience in organising summarisation tasks since 2011.
Participants should fill this short form to register to the task of interest. Registration will result in subscription to the task's mailing list. To register for multiple tasks, repeat the above registration process for each task of interest.
• 1st Call for participation: 27 April 2021
• 2nd Call for participation: 15 May 2021
• Training set release: 1st of June 2021
• Blind test set release: 1st of July 2021.
• Systems submission 1st of August 2021.
• Release of results: 1st of September 2021.
For any questions on the shared task please contact us on:
Shared Task Organisers:
- Ahmed AbuRa’ed (Universitat Pompeu Fabra).
- Nadhem Zmandar (Lancaster University).
- Nikiforos Pittaras (NCSR, Demokritos).
- Marina Litvak (Sami Shamoon College of Engineering).
- George Giannakopoulos (SKEL Lab – NCSR Demokritos).
- Mahmoud El-Haj, General Chair (Lancaster University)