The Computer Says No

The Computer
Says No.

Formulas, algorithms and AI are being built into the systems that decide what help you get.

Robodebt showed what happens when nobody can check the machine.

Newsprint cut-out of an old desktop computer.
17.1

The Robodebt Royal Commission recommendation for a legal framework for automated decisions.[1]

Dec 2025

Government admitted unlawful automated payment cancellations under the Targeted Compliance Framework.[2]

April 2027

New NDIS planning starts, with an assessment used to help set budgets.[3]

22 of 31

NDIA documents about Palantir that the agency refused to release.[4]

Not All Computers Are the Same

“Automation” covers very different things, and each one can go wrong in its own way.

  • A fixed formula can calculate your budget. No AI needed, but if the formula is wrong, it’s wrong for everyone.
  • A machine-learning model can flag “unusual” claims. Unusual isn’t the same as dodgy, and disabled people’s lives are often unusual.
  • A generative AI model can summarise a complaint and leave out the one sentence that says it’s urgent.
  • A “human in the loop” only helps if that person can see the original, spot the mistake and change the outcome.

What’s Already Running

The NDIS Quality and Safeguards Commission says it uses Copilot Chat and a contact platform that transcribes calls and measures “sentiment”. It plans to use large language models to annotate complaints, incident reports and audits.[5]

The Commission says the models don’t make regulatory decisions or recommend action.[5] The NDIS Commission is the regulator. It’s separate from the NDIA, which runs people’s plans.

Veterans’ Affairs has trialled a prototype AI Claims Document Reader with RSL Queensland.[6]

The NDIA engaged with Palantir. Its schedule lists a proof of concept and a Foundry cloud architecture diagram. It refused to release 22 of the 31 documents it found.[4]

Where your records go

If you can’t see the reasons and the inputs behind a cut, you can’t fight it.

We’ve Seen This Before

  1. RobodebtIncome averaging was used to raise debts it could not lawfully prove.[1]
  2. 7 July 2023The Royal Commission recommends a consistent legal framework for automated government decisions, with transparency and real review.[1]
  3. 17 December 2025The employment department announces compensation for people whose payments were unlawfully cancelled under the Targeted Compliance Framework. It says it will bring back human decision-makers where the law requires.[2]
  4. February 2026The NDIS Commission publishes its AI statement.[5]
  5. April 2027New NDIS planning starts.[3]

The Assessment

In September 2025 the NDIA said I-CAN version 6 would be the basis of its new support needs assessment. It said a customised I-CAN had already been used for more than four years in the Disability Support for Older Australians programme.[7][8]

The health department says the assessment will help make budgets and won’t decide who gets into the scheme.[3]

That means the questions that matter are about money. What’s the formula? What are the exceptions? Can the person reviewing it change the result?

What They Should Hand Over

  1. The formula that turns answers into dollars.
  2. Accuracy tests, missed cases and error rates for different groups.
  3. Records of how often reviewers overrule the system.
  4. Your own inputs and reasons, with every decision.

What We Want Answered

  • Implement Robodebt recommendation 17.1 in full, before April 2027.
  • Publish every algorithm and model used in disability, aged care and veterans’ decisions.
  • Give people the reasons and inputs behind any reduced budget, with the decision.
  • Release the Palantir documents.
Your RecordsThe data being joined up behind these systems. Read itThe CutsWhat the budget formula is being asked to save. Read it

Sources

  1. Royal Commission into the Robodebt Scheme, Report, 7 July 2023, including recommendation 17.1 and findings about ministers. https://robodebt.royalcommission.gov.au/publications/report
  2. Department of Employment and Workplace Relations, An update on the Targeted Compliance Framework, 17 December 2025. https://www.dewr.gov.au/assuring-integrity-targeted-compliance-framework/announcements/update-targeted-compliance-framework
  3. Department of Health, Disability and Ageing, About the changes to the NDIS, accessed 6 October 2026. Implementation dates, plan-management panel, support coordination commissioning and the support needs assessment. https://www.health.gov.au/our-work/ndis-legislation-changes/amendments/ndis-amendment-securing-the-ndis-for-future-generations-bill-2026/about-the-changes-to-the-ndis
  4. NDIA, FOI 25/26-2104, decision dated 14 August 2026 and document schedule, via Right to Know. 31 documents identified; nine released in part; 22 refused. https://www.righttoknow.org.au/request/palantir_3
  5. NDIS Quality and Safeguards Commission, Artificial intelligence transparency statement, February 2026. https://www.ndiscommission.gov.au/about-us/corporate-reports/ai-statement
  6. Department of Veterans’ Affairs, Vetaffairs, April 2026, Artificial intelligence at DVA. Prototype AI Claims Document Reader trial with RSL Queensland. https://www.dva.gov.au/newsroom/vetaffairs/vetaffairs-vol-42-no1-april-2026/artificial-intelligence-at-dva-supporting-transparency-trust-and-better-services
  7. NDIA, Developing a new support needs assessment, 25 September 2025. https://ndis.gov.au/news/10926-developing-new-support-needs-assessment
  8. Centre for Disability Studies, I-CAN DSOA Project. https://cds.org.au/clinical-services/our-clinical-services/i-can-dsoa-project/