Fine-tuned LLM for transforming the BFSI sector

LLM for transforming the BFSI sector: Unlocking innovation and efficiency

A specialized fine-tuned LLAMA 3.1-8B Instruct model, which aims at addressing the distinct challenges in customer care within India's BFSI sector.

Business challenge

The fine-tuned LLM addresses challenges in India's BFSI sector by understanding industry-specific terms and compliance requirements. Unlike general-purpose models, which may hallucinate or face regulatory restrictions when applied to BFSI tasks, this model is optimized for accuracy and cost-effectiveness, making it ideal for customer service applications like handling calls and long chats on platforms such as WhatsApp.

Solution benefits

  • Fine-tuned 8B LLM for the Indian BFSI sector handles 29 themes (108 subcategories) efficiently with lower infrastructure costs. 
  • Deployable on-premise or cloud with minimal GPU requirements, ensuring cost-effectiveness. 
  • Enhances customer service via text/voice channels, integrates enterprise systems, and ensures compliance with RAG capabilities.

Solution features and functionality

Why EY

  • Already developed, it offers plug-and-play use with minimal installation time.
  • The in-house expert team delivering to multiple clients instills confidence in what EY has already developed within the team.
  • A vast talent pool ensures seamless end-to-end integration.

Frequently Asked Questions (FAQs)

Download the full pdf

Our latest thinking

How financial services are strategically investing in technology

Read how financial services firms are investing in tech along with ROI alignment, cybersecurity, technologies like GenAI, quantum computing and sustainable tech.

14m 18s

From pilots to scale: How financial services firms invest in technology

FS firms in 2025 focused on cloud, AI, cybersecurity, core modernization, and customer experience; 2026 priorities shift to ROI, governance, and cost optimization.

How do global capability centers drive compliance and efficiency in intercompany processes?

Read how GCCs can manage intercompany processes, prevent piling up of intercompany balances and optimize processes from purchase order stage to month-end close.

RBI gold loan guidelines 2025: Impact assessment and key changes

Read our full report on the significant changes in RBI's Gold Loan Guidelines for 2025 and their potential impact on the financial landscape in India.

How financial services are adapting to global outsourcing trends

Explore GBS evolution in financial services, addressing regulatory challenges, digital transformation, and AI innovation for operational excellence.

Insight into the present and future of Indian affordable housing

India's affordable housing market is growing rapidly, driven by urbanization, Tier-II/III cities, and policies. EY highlights trends, challenges, and solutions.

How much productivity can GenAI unlock in India? The AIdea of India 2025

Explore AIdea of India 2025 to find out how Gen AI is transforming industries, boosting productivity & reshaping India’s digital economy with innovation.

How can India drive financial inclusion through technology and literacy

Explore India's journey to financial inclusion via digital innovation, policy reforms, and improved literacy for sustainable development.

Money in motion: Enabling the evolving finance sector with wealthtech

Explore how wealthtech is transforming finance, offering innovative solutions for a dynamic industry and enhancing customer wealth management. Learn more.

Insurance for All: enhancing insurance coverage across India

India's insurance growth: Innovating with micro-agents, AI underwriting, digital platforms, and regulatory support for universal coverage.


    Contact us
    Like what you’ve seen? Get in touch to learn more.