Lingua Custodia’s new compact open source language model Fin-Pythia-1.4B outperforms larger language models.

The French Fintech company Lingua Custodia, a specialist in Natural Language Processing (NLP) applied to Finance since 2011, releases its first open source language model on the Hugging Face Hub specifically trained for sentiment analysis of financial text.

Fin-Pythia-1.4B is a language model that’s been fine-tuned on financial documents and instructions. It can understand complex financial jargon and terminology. It is compact in size, which makes it fast to run without compromising the quality of the output.

Lingua Custodia’s open source language model is extremely accurate in analyzing financial sentiment and outperforms well-known models like GPT-4 and BloombergGPT. 

Raheel Qader, The head of Lingua Custodia’s Research and Development lab highlights “to produce accurate language models, the essential bases are data, expertise and experience.  Following 4 months of research, we were delighted to find that our open source language model outperformed both GPT-4 and and BloombergGPT in various financial NLP tasks.  This demonstrates clearly that size is not necessary to create powerful models and I am delighted that the research team here at Lingua Custodia was able to bring the model to the open source community so rapidly.  This places Lingua Custodia firmly at the forefront of generative ai technologies“

Fin-Pythia-1.4B model card is available at this link

https://huggingface.co/LinguaCustodia/fin-pythia-1.4b

Lingua Custodia will be releasing a series of other large language models targeting various financial document processing use cases as part of its research and development strategy for 2024.