Skip to content

Why Standalone LLMs Fail at Financial Analysis: Try It, Build It, or Buy It

Why Standalone LLMs Fail at Financial Analysis: Try It, Build It, or Buy It

WEBINAR RECAP · AI STRATEGY FOR THE OFFICE OF THE CFO July 2026 · 7 min read · Recap of FYIsoft’s webinar presented by Spencer Kuo

Executive Summary

CFOs are actively exploring an AI strategy for financial reporting and analysis — not because they lack access to AI, but because they now have too many options and not enough clarity on which one fits. There are three real paths available today: chatting directly with a standalone model like Claude or ChatGPT, building a custom AI solution in-house, or buying a platform purpose-built for finance, like Telli, FYIsoft’s AI financial analyst. This guide breaks down what each path actually gets you, where it breaks down, and how to choose the right one for your organization.

Quick Answer: What AI Strategy Should CFOs Use for Financial Analysis?

CFOs choosing an AI strategy for financial reporting and analysis are generally deciding between three paths:

  • Try It — chat directly with Claude, ChatGPT, or Copilot for fast, one-off analysis and spreadsheet fixes
  • Build It — develop a custom AI solution in-house, if you have engineering resources and a multi-year mandate
  • Buy It — subscribe to a purpose-built platform, like Telli, for recurring, audit-ready financial reporting

Most finance teams end up using a combination of all three. The right mix depends on how repeatable, auditable, and organization-aware the reporting needs to be.

What Is an AI Strategy for Financial Reporting and Analysis?

An AI strategy for financial reporting and analysis is the plan a finance organization uses to decide how artificial intelligence gets applied to reporting, variance analysis, and executive commentary — and, just as importantly, who owns and maintains the system doing that work.

There are three models in active use today:

  • Try It — using a general-purpose chatbot directly, with no custom infrastructure
  • Build It — developing custom AI agents, skills, and integrations in-house
  • Buy It — subscribing to a platform purpose-built for finance

Each path produces an analysis. What differs is who owns the data pipeline, the memory, the governance, and the audit trail behind it.

The Real Problem: Finance Teams Don’t Know Which AI Path to Trust

Most finance leaders have already tried the fastest option — uploading a report to Claude or ChatGPT and asking a question. It works, until the same question needs to be asked again next month, by someone else, against updated numbers.

That gap is where finance teams get stuck:

  • A standalone chatbot answers convincingly but doesn’t remember the organization
  • A custom build takes months of engineering before it’s board-ready
  • A generic tool doesn’t understand entities, segments, or rollups

That’s the real decision every finance team faces — not whether to use AI, but which of the three paths should carry the recurring, audit-sensitive reporting.

8 Key Takeaways: How CFOs Should Think About AI for Financial Analysis

1. Every Finance Team Is Choosing Between Three AI Paths

A simple way to picture the three paths is a chef analogy. Try It is like inviting a talented friend to cook in your own kitchen, using whatever ingredients you already have on hand — fast and personal, but limited to what’s in your pantry. Build It is like hiring that same friend full-time and building a commercial kitchen around them, complete with staff, equipment, and safety systems you own and maintain. Buy It is like eating at a five-star restaurant where that chef now works — the restaurant owns the staff, the safety systems, and the menu, and you simply sit down and order. Each path gets you a finished analysis. What changes is who owns the kitchen behind it — the data pipeline, the memory, the governance, and everything that has to run correctly before the meal ever reaches the table.

2. “Try It” Is Great for Ad Hoc Fixes — But It Has No Memory

  • What it’s good at: tools like the Claude plugin for Excel can find and fix broken formulas, and generate a quick revenue forecast, in seconds — genuinely useful for one-off spreadsheet work
  • The catch: tell a standalone model to remember something mid-session — a name, a preference, a fact about your company — and it will. Open a fresh session, or a different workbook, and ask again: it has no memory of ever being told
  • Multiply that gap across a real close cycle — recurring accruals, materiality thresholds, prior variance explanations — and an analyst ends up re-teaching the model every month

3. “Build It” Gives You Full Control — At Full Engineering Cost

  • Advantages: fully tailored to your specs, KPIs, and output format; direct integration with your own data sources; one governance standard applied across every tool
  • What’s possible: a custom “Monthly Financial Review” skill can be built inside Claude, with dozens of underlying sub-skills defining everything from dashboard styling to review-cycle logic — and the output can be genuinely strong
  • The catch: a production-safe build still needs its own data ingestion pipeline, canonical data model, quality gates, persistent memory in a real database, and security layers — a multi-month to multi-year commitment, even with tools like Claude Code speeding up the coding

4. Purpose-Built AI Understands Your Organization, Not Just Your Spreadsheet

  • Telli is aware of entities, segments, and divisions, so a comparative analysis never mixes up levels of the org — a gap general-purpose chat tools don’t handle natively
  • That organizational awareness is what lets a location or entity comparison run correctly on the first try, without re-explaining the org chart every time

5. Persistent, Governed Memory Is What Makes AI Usable Month Over Month

  • A fact taught once — like a recurring accrual that “looks unusual but is normal for us” — carries forward automatically instead of being re-explained every reporting period
  • Telli’s governed memory goes a step further than most tools: each piece of learned guidance is scored on whether it actually helped (helpful, neutral, or harmful) and rated for quality — a stronger governance answer than a generic thumbs-up/thumbs-down signal

6. Model-Agnostic AI Protects Finance From Vendor Lock-In

  • Telli routes each task to whichever underlying model performs best — including Claude and others — instead of depending on a single vendor’s roadmap or pricing
  • Teams can also bring their own custom skills into Telli, rather than being limited only to what ships out of the box

7. Security and Auditability Are Non-Negotiable in Finance

  • Telli runs on a dedicated, isolated database per customer — hosted in FYIsoft’s secured Azure environment by default, or deployable into the customer’s own Azure tenant on request — with no cross-tenant data sharing and no use of customer data to train public models
  • Customers can pair Telli’s front end with their own Microsoft Foundry governance layer for enterprise-wide policy control
  • Every figure a session produces traces back to its source report and data

8. Most Finance Teams Will Land on a Hybrid Approach

The distinction that matters isn’t which underlying model is “smartest.” It’s whether the system around that model gives finance a trustworthy, repeatable, auditable answer, every time the question gets asked again:

  • A chat tool for quick, ad hoc questions
  • A purpose-built platform for recurring management reporting
  • Custom integrations layered on top, for the largest enterprises

How to Decide Which AI Path Fits Your Team (Step-by-Step)

  1. Map your use case: ad hoc questions, or recurring, audit-sensitive reporting?
  2. Inventory your resources: do you have in-house AI engineering, or a lean IT team?
  3. Test for repeatability: run the same request twice in a fresh session and compare the answers
  4. Ask for lineage: can every number be traced back to a report row, formula, and period?
  5. Price the full cost, not just the model: ingestion, governance, security review, and ongoing maintenance
  6. Choose the path — or hybrid — that matches your reporting cadence and audit requirements

Try It vs. Build It vs. Buy It

DimensionTry It (Claude / ChatGPT)Build It (Custom In-House)Buy It (Telli)
Speed to valueImmediateMonths to yearsDays to weeks
Organizational awarenessNone — flat file per promptCustom-built, if scopedNative — entities, segments, rollups
Memory across sessionsNone by defaultYes, if built and maintainedGoverned, persistent, scored for quality
Security & tenant isolationPublic/consumer endpointFully custom, self-managedIsolated database per customer, Azure-based
AuditabilityDifficult to reconstructMust be engineered inEvery figure traces to source
Ongoing maintenanceNone — but no reliability eitherSignificant — your team owns itHandled by the vendor
Vendor / model dependencyTied to one modelTied to your own stackModel-agnostic, routes to best model

Who Should Use Each AI Path?

  • Try It: analysts who need a quick answer to a one-off question and are comfortable validating the output themselves
  • Build It: large enterprises with in-house development teams (or a trusted AI consulting partner) and a top-down, enterprise-wide AI mandate
  • Buy It: mid-market finance teams with lean IT resources who want the benefits of AI without owning the engineering behind it

How CFOs Should Start Using AI in Finance

  1. Identify your biggest reporting bottleneck — where does the process actually slow down today?
  2. Start with a high-impact use case: monthly variance commentary, board packages, or entity comparisons
  3. Prioritize repeatability and lineage over speed alone
  4. Keep humans in the loop — AI drafts, analysts and controllers still validate
  5. Choose a finance-specific solution once the use case is recurring, not a one-off

See Telli in Action

SEE HOW A PURPOSE-BUILT FINANCIAL AI ANALYST WORKS

Missed the live session? Request a personalized Telli demo to see how a purpose-built financial AI analyst handles your own multi-entity reports.

👉 Start Your Free 30-Day Trial

👉 Request a Demo

Final Takeaway

Finance doesn’t need another chatbot. It needs an AI strategy — one that matches the tool to the task, keeps memory and governance intact, and gives every number a traceable source. That’s the difference between an impressive demo and a system finance can actually run its close on.

Frequently Asked Questions

Yes, for quick, ad hoc questions. Standalone LLMs can read a clean spreadsheet, explain patterns in plain language, and even fix broken formulas. What they don’t do natively is remember your organization across sessions, guarantee the same answer twice, or trace a number back to its source.
No. AI removes the manual first draft. Analysts and controllers still review, validate, and apply judgment — AI reduces how much time they spend producing routine commentary so they can spend more time interpreting results.

Telli is FYIsoft’s purpose-built AI financial analyst. It reads ReportFYI financial reports and produces variance commentary, KPI tracking, and executive-ready outputs, backed by governed persistent memory, multi-entity awareness, and full lineage back to the underlying report data.