Home / Insights / Generative AI and LLMs

Generative AI and LLMs

AI in Accounting Software: Use Cases, Model Choices and the Controls to Build First

AI can remove much of the manual work in accounts payable, reconciliation and month-end close, but accounting has a low tolerance for unexplained numbers. This guide matches each task to the right technique, walks through an invoice from capture to posting, and sets out the controls, metrics and audit trail to build before you automate.

TopicsGenerative AI and LLMsAI and Machine LearningBusiness Operations and Integration

Key takeaways

  • The best early uses are high-volume, rule-bound tasks: capturing invoice data, suggesting account codes, matching transactions and flagging anomalies for review.
  • Use the simplest technique that works for each task. Rules and classical machine learning often beat language models for matching and coding; language models shine with unstructured documents and explanations.
  • Every AI-suggested entry needs a confidence score, a reason and a clear path to human approval. Thresholds, not the model, decide what posts automatically.
  • Keep a complete audit trail: source document, extracted values, model and version, confidence, who approved and what changed.
  • Measure field-level accuracy, straight-through processing rate, exception rate and error escape rate — and report them by supplier and document type.

Accounting teams spend a large share of their time on work that is repetitive but exacting: keying invoice data, coding expenses, matching payments, chasing differences in reconciliations and assembling reports. It is natural territory for automation. It is also territory where a wrong number has consequences — misstated accounts, duplicate payments, tax errors and failed audits.

This guide is for product teams building accounting and finance software, and for finance leaders evaluating AI features. It matches accounting tasks to techniques, walks through a worked example, and focuses on the part most articles skip: the controls that let you automate without losing trust in the numbers.

Which accounting tasks AI can help with

TaskWhat AI doesTypical techniqueRisk if wrong
————
Invoice and receipt captureExtract supplier, dates, amounts, tax and line items from documentsDocument AI and OCR; language or vision models for unusual layoutsWrong amounts or tax posted
Expense and account codingSuggest the general-ledger account, tax code, cost centre and projectClassification models trained on past postings; rules for known suppliersMisclassified expenses; wrong tax treatment
Supplier and customer matchingLink documents and transactions to the right master recordFuzzy matching, embeddings, rules on tax IDs and bank detailsPayments to the wrong party
Bank reconciliationMatch bank lines to invoices, payments and receipts, including partial and grouped paymentsRules, scoring models and optimisation for many-to-many matchesUnreconciled or wrongly cleared items
Duplicate and anomaly detectionFlag duplicate invoices, unusual amounts, new bank details, out-of-pattern spendRules plus anomaly-detection modelsMissed fraud or error; too many false alarms
ForecastingProject cash flow, receivables and expensesTime-series models with business driversPoor planning decisions
Narrative and query supportExplain variances, draft commentary, answer questions about policies or ledgersLanguage models grounded in ledger data and policy documentsConfident but incorrect explanations

Most products combine several techniques; few tasks need a large language model alone.

Choosing the technique for each task

Vendor marketing often puts a large language model at the centre of everything. In practice:

  • Rules first for the certain cases. If a supplier always maps to one account and tax code, a rule is faster, cheaper and fully explainable.
  • Classical machine learning for coding and matching. Models trained on your own historical postings — gradient-boosted trees or simple neural networks — are accurate, fast and give calibrated confidence scores for these structured tasks.
  • Document AI for capture. Specialised document-extraction services and OCR handle standard invoices well; language and vision models help with unusual layouts, handwriting and multi-language documents.
  • Language models for language. Use them where understanding or producing text is the task: reading free-text descriptions, interpreting contract terms, drafting variance commentary, answering staff questions from policies.

A hybrid design is normal: rules handle known cases, a model handles the rest, and a person handles low-confidence results. Our guide to choosing between AI and rules explains how to make that split.

Worked example: an invoice from capture to posting

Consider a hypothetical mid-sized distributor receiving 6,000 supplier invoices a month by email and supplier portal.

  1. Capture. The document service extracts supplier name, tax ID, invoice number, dates, currency, net, tax and gross totals and line items, with a confidence score for each field.
  2. Validation rules. The system checks that lines sum to the net total, that net plus tax equals gross, that the tax rate is valid for the supplier’s jurisdiction and that the invoice number is not already recorded for that supplier.
  3. Supplier match. The tax ID and bank details are matched to the supplier master. A change in bank details is always routed to a separate verification process, never auto-accepted.
  4. Purchase-order and receipt match. For PO-backed invoices, quantities and prices are compared with the order and goods received, within agreed tolerances.
  5. Coding. For non-PO invoices, a classification model suggests account, tax code and cost centre, with a confidence score and the three most similar past postings as its explanation.
  6. Routing. Invoices that pass every check with high confidence go to a straight-through queue for batch approval by the budget holder. Anything else becomes an exception with a clear reason: low extraction confidence, price variance, possible duplicate, new bank details, unusual amount.
  7. Approval and posting. Approvers see the source document beside the extracted data and the reason for any flag. Posting records who approved and which values were changed.
StageAutomated controlHuman control
———
CaptureField confidence thresholds; arithmetic checksReview of low-confidence fields against the image
SupplierMatch on tax ID and bank detailsIndependent verification of bank-detail changes
MatchingPrice and quantity tolerancesApproval of variances above tolerance
CodingConfidence threshold; supplier-level rulesReview of low-confidence or new-supplier coding
PostingDuplicate check; period lockApproval by budget holder within delegated authority

Automated checks reduce the work; human controls keep the key judgements accountable.

In a design like this, the goal is not to eliminate people but to move them from typing to checking exceptions. The share of invoices that flow straight through will depend on supplier mix and data quality; measure it rather than assuming it.

Controls to build before you automate

Accounting automation succeeds when finance teams and auditors trust it. That trust comes from controls designed in from the start:

  • Thresholds set by the business, enforced in code. Confidence levels, amount limits and tolerances that determine automatic processing are configuration owned by finance, not behaviour inside a model.
  • Segregation of duties. The system should not allow the same person — or the same automated process — to create a supplier, change its bank details and approve its payment.
  • Explainability at the point of decision. Show why a suggestion was made: the matched rule, the similar historical postings or the fields that triggered a flag.
  • Complete audit trail. Keep the source document, extracted values, model name and version, confidence, rule results, approver, timestamp and every manual change.
  • Change control for models. Treat a model update like a change to a financial system: test on a holdout set, document results and approve before release.
  • Period-end protections. Prevent automated postings into closed periods and require approval for adjustments.
  • Data protection. Invoices and bank data contain personal and commercially sensitive information. Limit access, encrypt data and check how any external AI provider stores and uses it.

Bank reconciliation in more detail

Reconciliation is where simple matching breaks down. A single bank receipt may settle several invoices; a customer may pay one invoice in instalments; fees and currency differences leave small residuals; references are missing or mistyped. A good design layers techniques:

  1. Exact rules match on amount, date window and a clean reference such as an invoice number.
  2. Scored candidates rank possible matches using amount closeness, payer name similarity, reference fragments and the customer’s payment habits.
  3. Combination search looks for sets of open invoices that sum to a receipt, within a tolerance for fees.
  4. Suggestions with reasons go to the reviewer: “Matches invoices 1043 and 1047 (total $12,480.00); payer name matches customer; $15.00 difference consistent with bank fee.”
  5. Learning from decisions: accepted and rejected suggestions become training data and may create new rules — for example, a customer who always pays with a particular reference format.

Never let the system clear an item silently because the amounts happen to match. Coincidental matches are common in high-volume accounts, and an incorrect match can hide an unpaid invoice for months.

What the audit trail should record

ElementExampleWhy it matters
———
SourceOriginal document file and its hash; bank statement lineProves what the decision was based on
ExtractionEach extracted field, its value and confidenceShows what the system read
ProcessingRules applied, model name and version, suggestion and scoreExplains how the suggestion was produced
Human actionUser, timestamp, action (approve, edit, reject) and any changed valuesShows accountability and corrections
PostingJournal reference, period, accounts and amountsLinks the decision to the ledger
ChangesConfiguration and threshold changes with approverShows controls were governed

Store audit records in a way that cannot be edited by normal users, and keep them for your statutory retention period.

Metrics that show whether it works

MetricDefinitionWhat good looks like
———
Field-level accuracyCorrect extracted values ÷ fields extracted, measured on a sampled setHigh for amounts, dates and tax; tracked by supplier and layout
Straight-through processing rateDocuments posted without manual edits ÷ total documentsRising over time without a rise in errors
Coding acceptance rateSuggested codes accepted unchanged ÷ suggestionsHigh, with regular sampling to detect rubber-stamping
Exception rate and reasonsShare of documents needing review, by reasonFalling for data-quality reasons; stable for genuine anomalies
Error escape rateErrors found after posting ÷ documents postedVery low; every escape investigated
Cycle timeReceipt of invoice to approval or paymentShorter, enabling early-payment discounts and fewer late fees
Duplicate and fraud catchesConfirmed duplicates or suspicious changes caught before paymentTracked with false-alarm rate

Agree baselines before launch and report by supplier, entity and document type.

Building a test set you can trust

Accuracy claims mean little until they are measured on your own documents. Build a labelled test set before choosing or tuning a solution:

  1. Sample broadly: draw several hundred documents across suppliers, layouts, languages, currencies and quality levels, including scanned and photographed documents.
  2. Label carefully: have two people record the correct values for each field and the correct coding, and resolve disagreements. Disagreements often reveal ambiguous policies worth fixing.
  3. Score by field and segment: report accuracy separately for amounts, dates, tax, supplier and line items, and by supplier and document type. An average hides the supplier whose invoices always fail.
  4. Check confidence calibration: items with high confidence should almost always be correct. If they are not, thresholds cannot be trusted.
  5. Keep the set current: add new suppliers and difficult cases every month, and re-run after every model or rule change.

Where language models help most

Language models add value beyond data capture when they are grounded in the right data and checked:

  • Variance commentary. Drafting explanations of month-on-month changes from ledger data and known events, for a finance manager to edit.
  • Policy questions. Answering staff questions about expense policy or approval limits from the approved policy documents, with citations.
  • Contract terms. Extracting payment terms, discounts and renewal dates from supplier contracts to set up master data.
  • Exception notes. Summarising why an invoice was flagged and what the reviewer should check.

Keep numbers out of the model’s imagination: calculate figures in code or queries, and let the model explain the results rather than produce them. Validate that every number in generated commentary matches the source data.

Risks and how to reduce them

  • Poor training data. Historical coding may be inconsistent. Clean and review the training set, and start with suppliers and accounts where history is reliable.
  • Over-trust. Staff may approve suggestions without checking. Sample approved items for independent review and track acceptance rates by user.
  • Drift. New suppliers, layouts or tax rules reduce accuracy. Monitor accuracy continuously and retrain or update rules on a schedule.
  • Regulatory and tax change. Rates and rules change; keep tax logic in maintained rules or tax engines, not in a model’s learned behaviour.
  • Prompt injection in documents. Text inside an invoice or email could attempt to manipulate a language model. Treat document content as data, and never let it change instructions or approval logic.

Build, buy or extend

Many accounting platforms now include AI capture and coding features, and specialist accounts-payable products offer more. Buying is usually right for standard workflows. Building or extending makes sense when you are a software company adding AI to your own finance product, when your documents or processes are unusual, or when you need tighter integration with operational systems. Our guide to build versus buy decisions and to AI document processing cover these choices in more depth.

A phased plan

  1. Baseline (2–4 weeks): measure volumes, processing time, error rates and exception reasons; collect a labelled sample of documents.
  2. Assistive pilot (6–10 weeks): extraction and coding suggestions shown to staff, who still enter or confirm every item; measure accuracy and acceptance.
  3. Controlled automation: allow straight-through processing for high-confidence documents from selected suppliers within amount limits; sample-check results.
  4. Expand: add suppliers, entities and tasks such as reconciliation once metrics hold steady.

Frequently asked questions

Can AI fully automate bookkeeping?

It can automate a large share of routine capture, coding and matching for clean, repetitive transactions, but judgement, exceptions, period-end adjustments and approvals still need people.

Is a large language model needed for invoice processing?

Not always. Dedicated document-extraction services and classification models handle most standard invoices well and cost less. Language and vision models help with unusual or unstructured documents.

How do auditors view AI-processed transactions?

Auditors focus on controls and evidence. A clear audit trail, documented thresholds, segregation of duties and evidence of monitoring make AI-assisted processes easier to audit. Discuss your design with your auditors early.

How much data do we need to train a coding model?

It depends on the number of accounts and suppliers. Several months of consistently coded history usually gives a useful start; begin with suppliers and accounts that have enough examples.

Sources and methodology

Facts in this article were checked against the sources below on 6 November 2026. Directory data (ratings, review counts, rate bands and team sizes) changes over time and is shown as published on the date accessed. Illustrative examples are labelled as such and are not quotes.

  1. OWASP: Top 10 for LLM Applications 2025 — accessed 6 November 2026. LLM01 Prompt Injection and LLM05 Improper Output Handling
  2. NIST: AI Risk Management Framework — accessed 6 November 2026. Framework for governing, mapping, measuring and managing AI risk; Generative AI Profile released 26 July 2024

Building or improving accounting software with AI?

Tell us about the workflows and volumes you want to automate. We will help you choose techniques, design approval and audit controls, and prove accuracy on your own data.