A Survey on Multimodal Financial Foundation Models
📢 Update (Date: 03-01-2025)
🚀 We released MFFMs Documentation
📢 Update (Date: 11-15-2024) 🚀 We host the 1st International Workshop on Multimodal Financial Foundation Models (MFFMs) @ ICAIF'24 Workshop Page
- Awesome Papers
[4] What You Say and How You Say It Matters: Predicting Financial Risk Using Verbal and Vocal Cues ACL 2019. Data
[3] HTML: Hierarchical Transformer-based Multi-task Learning for Volatility Prediction, WWW 2020. Code.
[2] MAEC: A Multimodal Aligned Earnings Conference Call Dataset for Financial Risk Prediction, CIKM 2020. Data
[1] ECC Analyzer: Extracting Trading Signal from Earnings Conference Calls using Large Language Model for Stock Volatility Prediction, ICAIF 2024.
[2] MONOPOLY: Financial Prediction from MONetary POLicY Conference Videos Using Multimodal Cues, Multimedia 2022. Code
[1] Modal-adaptive Knowledge-enhanced Graph-based Financial Prediction from Monetary Policy Conference Calls with LLM, FinNLP Workshop 2024. Code
[2] Attentive statement fraud detection: Distinguishing multimodal financial data with fine-grained attention, Decision Support System 2023.
[1] XBRL-Agent: Leveraging large language models for financial report analysis, ICAIF 2024. Code
[1] Analyzing Cascading Outbreak of GameStop Event: A Practical Approach Using Network Analysis and Large Language Models, ICAIF 2024.
[2] FinRL: A deep reinforcement learning library for automated stock trading in quantitative finance, Deep Reinforcement Learning Workshop @ NeurIPS 2020. Code
[1]FinRL-Meta: Market Environments and Benchmarks for Data-Driven Financial Reinforcement Learning, NeurIPS 2022. Code
...
[1] High-Quality Financial Benchmark (QFinBen): Can LLMs Earn Degrees and Certificates?, Multimodal Financial Foundation Models Workshop @ ICAIF 2024.
[2] Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Models, ICAIF 2023.
[1] Customized fingpt search agents using foundation models, ICAIF 2024. Code
[1] High-Quality Financial Benchmark (QFinBen): Can LLMs Earn Degrees and Certificates?, Multimodal Financial Foundation Models Workshop @ ICAIF 2024.
[1] A Report on Financial Regulations Challenge at COLING 2025
[2] FinMem: A performance-enhanced LLM trading agent with layered memory and character design, LLM-Agent Workshop @ ICLR 2024. Code
[1] FINCON: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making, NeurIPS 2024. Code
[3] Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications
[2] FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Model
[1] FinVis-GPT: A multimodal large language model for financial chart analysis.