Title Page
ABSTRACT
Contents
Chapter 1. Introduction 8
1.1. Problem Statement 10
1.2. Motivation 10
1.3. Thesis Outline 10
Chapter 2. Related Work 12
2.1. Tabular Deep Learning 12
Chapter 3. Proposed Method 14
3.1. FinBERT 15
3.1.1. FinBERT Pre-Training 15
3.1.2. Finetuning FinBERT for Text Classification 16
3.2. FT-Transformer 17
3.3. Text Formatter 18
3.3.1. Formatting Column Headers 18
3.3.2. Formatting Column Values 18
3.3.3. Putting Everything Together 19
Chapter 4. Experiment 20
4.1. Experiment Configuration 20
4.1.1. Dataset 20
4.1.2. Training Settings 20
4.1.3. Evaluation Metric 21
4.2. Experiment Results 23
4.2.1. Lending Club data 23
4.2.2. UCI Taiwan data 24
Chapter 5. Conclusion 25
Bibliography 26