Can you actually put client files through ChatGPT?
Sometimes yes, once it's set up properly. Sometimes no, and then the answer is AI that runs on hardware you own, where the files never leave the building. I work out which one you're looking at and put it in writing you can hand to a client, a board or an insurer.
5.0 on Google
Most businesses don't need to buy a server. A few genuinely do.
Public AI tools are not designed for every risk profile, and that's a different statement from saying they're bad. I'm James, a family-run business on the Mid North Coast (who you'll work with). If the tool you're already paying for is fine once it's configured properly, I'll tell you that and charge you nothing for the relief.
There are three ways to fix this. Only one needs hardware.
Ranked cheapest and least disruptive first, which is also the order I work through them. Plenty of businesses stop at the first one.
- 01
Keep the tool you have, set up properly
Business and enterprise plans generally do not train on your data, and most consumer plans do. Half the risk people worry about is a settings problem, a plan problem or an over-shared folder. Often this is the whole fix, and it costs nothing.
- 02
Same tools, held in Australia
Some workloads can be pinned to Australian infrastructure so the processing happens here. That answers a data residency question. It does not answer a question about which country's laws could compel access, and I will not pretend otherwise.
- 03
Private AI on hardware you own
An open model running on a machine in your office or your rack. Nothing is sent to any AI company, because there is nowhere for it to go. No per-seat bill, no usage meter, and nothing that can be deprecated out from under you.
Australia's privacy regulator has said that deploying AI locally is "likely to be more privacy-preserving as it limits the risks of third party access to the data". That's a reason to consider option three, not a reason to skip one and two.
Where a private model earns its keep.
These are the jobs where an open model running on your own hardware is genuinely good enough, and where you would struggle to pick it from a cloud service.
-
Meeting and consult notes
Recording and transcription that happens on your own machine. Usually the best first project: quick to stand up, obviously sensitive, and the local quality genuinely competes with the cloud services.
-
A searchable company brain
Plain-English questions answered from your own files, with citations back to the source document. The hard part is permissions, not the AI, and that is where the work goes.
-
Pulling data out of documents
Invoices, purchase orders, forms and contracts turned into clean structured data. Header fields are close to solved. Line items still need a person checking the ones the system is unsure about.
-
Sorting and routing at volume
Tagging, triage and classification across thousands of items. This is where per-token cloud bills quietly compound, and where a small local model often beats a large rented one.
-
Redacting before anything leaves
Stripping names, numbers and identifiers out of a document before it goes anywhere near an outside service. This is what makes the safe use of cloud AI possible for the rest of the work.
-
Scanned archives you cannot search
Decades of paper turned into something you can actually find things in. Unglamorous, low risk, and it usually pays for itself faster than anything else on this list.
Where private AI falls short.
Open models sit roughly one release cycle behind the best cloud models. On the everyday work above you will not notice. On hard multi-step coding, long autonomous tasks and complex reasoning across a whole contract, the gap is real and it shows. Under about thirty staff, owning the hardware usually costs more than renting the software, so buy it for control rather than savings. Somebody has to spend a few hours a month keeping it healthy. And a model that talks to your customers needs guardrails around it, because open models refuse far less than the commercial ones do. If any of that rules it out for you, that's a useful thing to learn before you spend money, not after.
Private for the sensitive work. Rented for the rest.
Telling a business to abandon its whole stack is telling it something it will never do. The version that actually works sorts your information into three buckets. The genuinely confidential material never leaves your network. The middle tier can go out once names and identifying details are stripped from it. The public material goes wherever is cheapest and best. One gateway sits in front of all of it, enforcing the rule and keeping a log of what went where.
The part that makes this safe to commit to: local systems speak the same interface the big providers use. Pointing an existing tool at your own model is usually a change of address rather than a rebuild, so you can pilot something in the cloud, prove it works, and bring it in-house later without starting again.
Real numbers, including the bad ones.
A single capable machine for a small team starts around $3,500. A box that will comfortably serve a whole office runs to roughly $18,500 for the graphics card alone. Power is almost irrelevant, a few hundred dollars a year, so ignore anyone who leads with the electricity bill. The cost people miss is the five to ten hours a month of looking after it, which at consulting rates is often larger than the hardware.
One more thing worth saying out loud in 2026: memory prices have run hard this year, and graphics cards are selling well above their list price. If you can wait six months, waiting is a legitimate strategy. The full working, with the break-even seat counts, is in what it costs to run AI on your own hardware.
A free look at where your data goes.
Tell me what your team uses and what sort of information goes into it. I'll tell you which of the three answers you're most likely looking at, and whether it's worth going any further. No obligation.
If you need the full answer in writing, with every tool checked and your obligations verified, that's the AI audit: $2,450 fixed, and it comes off a build.
Prefer to just talk? Call 0418 858 937.
Got it, thanks.
That's landed with me. I'll read it properly and come back with an honest read on whether the audit is worth doing for you, usually within a few hours and always within one business day.