Fine-tuned LLM for transforming the BFSI sector

LLM for transforming the BFSI sector: Unlocking innovation and efficiency

A specialized fine-tuned LLAMA 3.1-8B Instruct model, which aims at addressing the distinct challenges in customer care within India's BFSI sector.

Business challenge

The fine-tuned LLM addresses challenges in India's BFSI sector by understanding industry-specific terms and compliance requirements. Unlike general-purpose models, which may hallucinate or face regulatory restrictions when applied to BFSI tasks, this model is optimized for accuracy and cost-effectiveness, making it ideal for customer service applications like handling calls and long chats on platforms such as WhatsApp.

Solution benefits

  • Fine-tuned 8B LLM for the Indian BFSI sector handles 29 themes (108 subcategories) efficiently with lower infrastructure costs. 
  • Deployable on-premise or cloud with minimal GPU requirements, ensuring cost-effectiveness. 
  • Enhances customer service via text/voice channels, integrates enterprise systems, and ensures compliance with RAG capabilities.

Solution features and functionality

Why EY

  • Already developed, it offers plug-and-play use with minimal installation time.
  • The in-house expert team delivering to multiple clients instills confidence in what EY has already developed within the team.
  • A vast talent pool ensures seamless end-to-end integration.

Frequently Asked Questions (FAQs)

Download the full pdf

Our latest thinking

How much productivity can GenAI unlock in India? The AIdea of India 2025

Explore AIdea of India 2025 to find out how Generative AI is revolutionizing industries and productivity in India's digital transformation journey. Stay future-ready with EY India.

How can India drive financial inclusion through technology and literacy

Explore India's journey to financial inclusion via digital innovation, policy reforms, and improved literacy for sustainable development.

Money in motion: Enabling the evolving finance sector with wealthtech

Explore how wealthtech is transforming finance, offering innovative solutions for a dynamic industry and enhancing customer wealth management. Learn more.

Insurance for All: enhancing insurance coverage across India

India's insurance growth: Innovating with micro-agents, AI underwriting, digital platforms, and regulatory support for universal coverage.


    Contact us
    Like what you’ve seen? Get in touch to learn more.