Private AI, on your hardware
The model lives next to the ledger. Not in someone's cloud.
Finanly's own 8B finance model — custom trained on ledgers, reconciliations and statements — runs on your own machine behind an internal-only gateway. No public AI API ever sees a transaction, a customer or a balance.
- Runs on your own hardware
- AI never writes SQL
- Tenant isolation by Postgres RLS
- Every irreversible action audited
- Statements parity-gated hourly
Private AI isn't a setting. It's an architecture: an internal gateway, a local model, a semantic plan the ledger verifies before anything is answered.
Boundary
Internal-only by design. Audited by default.
The AI gateway is not reachable from the internet. core-api calls it with a short-lived JWT scoped to the gateway audience and the active tenant; the gateway serves the Finanly finance model on the same host.
- Endpoints for BI ask, vendor enrichment, compliance narrative and chat — all tenant-scoped
- Postgres row-level security plus application RBAC under every query
- Append-only audit log for every irreversible action
Grounding
Answers are plans, not prose.
The model produces a semantic plan JSON. core-api validates it against the governed Cube model and executes it. Three tools — chart of accounts, cube measures, period resolver — mean it cannot invent an account, a field or a date.
- Zero LLM-generated SQL executed
- Fails closed on ambiguity
- Every figure links to its rows
Where the model works
Four jobs, one finance model.
Ask your books
Conversational BI over the semantic layer, with drill-down.
Categorization
Third tier of the auto-categorizer, after exact and similarity matches.
Vendor enrichment
Counterparty names normalized and classified into governed groups.
Compliance narrative
Audit-report narratives for organic traceability, grounded in lot and certificate data.
FAQ
Straight answers
Which model, exactly?
The Finanly Finance Model: Finanly's own 8-billion-parameter model, custom trained for finance work and served on your hardware. It powers every AI feature — analysis, forecasts, reports, categorization, vendor enrichment and the compliance narrative.
Is there a cloud fallback?
Not in Finanly's gateway. We don't advertise one because we don't ship one. If the local model is down, AI features report unavailable; nothing is silently routed elsewhere.
What does the model actually see?
For Ask: your question plus the governed vocabulary (accounts, measures, dimensions) — it plans, it doesn't read the ledger. For categorization: the transaction text and your chart of accounts. Everything stays on the host, scoped to the active tenant by a short-lived JWT.
Where does data live?
In Postgres on the host you run Finanly on — one Docker Compose stack with core-api, the AI gateway, connectors and the jobs worker. Integration secrets are encrypted at rest (AES-GCM) and only decrypted inside the connector that owns them.
How is one tenant kept away from another?
Postgres row-level security is forced on every tenant-scoped table, the runtime refuses to start with a database role that could bypass it, and application RBAC sits above. The AI gateway receives a token bound to a single tenant per call.
Is Finanly SOC 2 certified?
No — not today, and we won't imply otherwise. The controls that matter (RLS, encrypted secrets, append-only audit, internal-only AI) are in place and documented; certification is a roadmap item.
What hardware does the model need?
A host that can serve an 8B-parameter model — in practice a GPU with enough memory for it, or a CPU box if you accept slower answers. Talk to us about the host that fits your volume.
Is every AI action logged?
Every irreversible action is written to an append-only audit log enforced by a database trigger. AI drafts themselves are suggestions, not actions — nothing changes until a human accepts.
Can I run it entirely offline?
The AI layer, yes. Connectors need to reach the services they sync (Mercury, Plaid, Shopify…); the model, the gateway and the ledger never need an outbound connection.
Keep the model where the ledger is.
Private beta. Tell us where to send your access, and which company you close first.