Spain

The work proposes a combination of linguistic features with features derived from pre-trained BERT for training a supervised classifier for the task of Causality Detection. The Linguistic features help to inject knowledge about the semantic and syntactic structure of the input sentences. Experiments on the FinCausal Shared Task1 datasets indicate that the combination of Linguistic features with BERT improves overall performance for causality detection. The proposed system achieves a weighted average F1 score of 0.952 on the post-evaluation dataset.

COLING 2020

A Knowledge Induced Neural Net for Causality Detection

causality detection

linguistic features

bert

stages 

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

First established in 1965, the biennial COLING conference is held in diverse parts of the globe and attracts participants from both top-ranked research centers and emerging countries. Today, the most important developments in our field are taking place not only in universities and academic research institutes, but also in industrial research departments and in technological startups. COLING conferences provide opportunities for all these communities to showcase their exciting developments.

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

poster

This poster describes a system for causality extraction from financial documents submitted as part of the FinCausal 2020 Workshop. The proposed system achieved a weighted-averaged F1 score of more than 95% for the official blind test set during the post-evaluation phase and exact clauses match for 83% of the documents.

Span-based Causality Extraction for Financial Documents

Companies provide annual reports to their shareholders at the end of the financial year that describes their operations and financial conditions. The average length of these reports is 80, and it may extend up to 250 pages long. In this paper, we propose our methodology PoinT-5 (the combination of Pointer Network and T-5 (Test-to-text transfer Transformer) algorithms) that we used in the Financial Narrative Summarisation (FNS) 2020 task. The proposed method uses Pointer networks to extract important narrative sentences from the report, and then T-5 is used to paraphrase extracted sentences into a concise yet informative sentence. We evaluate our method using ROUGE-N (1,2), L,and SU4. The proposed method achieves the highest precision scores in all the metrics and highest F1 scores in ROUGE 1,and LCS and only solution to cross MUSE solution baseline in ROUGE-LCS metrics.


Pointer Network and T-5 based Financial Narrative
Summarisation


This paper describes the systems proposed to solve the FNS 2020 Shared Task on summarizing financial reports. We present an extractive approach that implements a statistical model comprised of different features that measure the relevance of the sentences using a combination of statistical and machine learning methods. 


Combining financial word embeddings and knowledge-based features for financial text summarization: UC3M-MC System at FNS-2020

In this poster, we describe the results of team LIORI at the FinCausal 2020 Shared task held as a part of the 1st Joint Workshop on Financial Narrative Processing and MultiLingual Financial Summarisation.

LIORI at FinCausal 2020, Tasks 1 & 2

This paper describes the approach we built for the Financial Document Causality Detection Shared Task (FinCausal-2020) Task 2: Cause and Effect Detection. Our approach is based on a multi-class classifier using BiLSTM with Graph Convolutional Neural Network (GCN) trained by minimizing the binary cross entropy loss. In our approach, we have not used any extra data source apart from combining the trial and practice dataset. We achieve weighted F1 score to 75.61 percent and are ranked at 7-th place.

Financial Document Causality Detection

The rapid growth of textual data published everyday on the web has prompted the need for automatic text summarization methodologies. In the financial domain, quoted companies are required to periodically publish a report in textual form.
Depending on the reader, those reports may contain redundant or irrelevant information. The proposed task aims at highlighting business-relevant information while analyzing the annual reports.
The proposed methodology exploit the advancements in the Natural Language Understanding field to create a fine-tuned architecture able to specialize the general knowledge towards the financial domain.

End-to-end Training For Financial Report Summarization

With the constantly growing amount of information, the need arises to automatically summarize this written information. One of the challenges in the summary is that it’s difficult to generalize. For example, summarizing a news article is very different from summarizing a financial earnings report. This paper reports an approach for summarizing financial texts, which are different from the documents from other domains at least in three parameters: length, structure, and format. Our
approach considers these parameters, it is adapted to hierarchical structure of sections, document length, and special “language”. The approach builds an hierarchical summary, visualized as a tree with summaries under different discourse topics. The approach was evaluated using extrinsic and intrinsic automated evaluations, which are reported in this paper. As all participants of the Financial Narrative Summarisation (FNS 2020) shared task, we used FNS2020 dataset for
evaluations.

SCE-SUMMARY at the FNS 2020 shared task

In our research work, we represent the content of the sentence in graphical form after extracting triples from the sentences. This poster gives an overview of novel methods to generate an extractive summary by scoring the triples. It also discusses the methods to generate extractive summary after performing binary classification using ML-based and DNN based approaches by utilizing features extracted from the triples. The poster concludes by highlighting the finding of our experiments.

Knowledge Graph and Deep Neural Network for Extractive Text Summarization by Utilizing Triples

We describe the work carried out by AMEX AI-LABS on an extractive summarization benchmark task focused on Financial Narratives Summarization (FNS). This task focuses on summarizing annual financial reports which pose two main challenges as compared to typical news document summarization tasks : i) annual reports are lengthier (average length about 80 pages) as compared to typical news documents, and ii) annual reports are more loosely structured e.g. comprising of tables, charts, textual data and images, which makes it challenging to effectively summarize. 

To address this summarization task we investigate a range of unsupervised, supervised and ensemble based techniques. We find that ensemble based techniques perform relatively better as compared to using only the unsupervised and supervised based techniques. Our ensemble based model achieved the highest rank of 9 out of 31 systems submitted for the benchmark task based on Rouge-L evaluation metric.

AMEX AI-Labs: An Investigative Study on Extractive Summarization of Financial Documents

FinCausal-2020 is the shared task which focuses on the causality detection of factual data for financial analysis. The financial data facts don’t provide much explanation on the variability of these data. This paper aims to propose an efficient method to classify the data into one which is having any financial cause or not. Many models were used to classify the data, out of which SVM model gave an F-Score of 0.9435, BERT with specific fine-tuning achieved best results with F-Score of 0.9677.

Downloads

Next from COLING 2020

Span-based Causality Extraction for Financial Documents

Similar lecture

Causality detection using Sentence Embeddings in Financial Reports

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from COLING 2020

Span-based Causality Extraction for Financial Documents

Similar lecture

Causality detection using Sentence Embeddings in Financial Reports

Downloads