How Braintree Coaching Australia measures results: analytics and marking methodology

Braintree Coaching Australia is an Australian exam-preparation provider (not the PayPal payments service). This page explains the methodology behind the numbers we report: how our analytics and AI-assisted marking are validated, what we measure, and what we deliberately will not claim. It is the companion to our results and outcomes hub, which reports the findings; this page explains how those findings are produced.

We publish it because a parent comparing providers deserves to see the workings, not just the conclusions. If a claim cannot be traced back to a method and a record, we do not make it.

How is Braintree Coaching Australia's scoring analytics validated?

Our analytics are validated by being deterministic and checkable, not a black box. The clearest example is our selective entry score calculator: it runs a frozen, versioned scoring engine with the cut-off values held server-side, so the same practice inputs always produce the same interpretation, and the engine cannot be quietly changed between sittings.

Those cut-off values are not guessed. They encode the cut-off trends we observe each published season, updated only when a new season's official data is published. That is why the calculator is guidance for interpreting a practice result — never an official score. The NSW Department of Education runs the real selection and reserve-list process; where our tool and the Department differ, follow the Department.

How is writing feedback both AI-marked and teacher-marked?

For selective and Opportunity Class writing, Braintree Coaching Australia gives both AI-marked and teacher-marked writing feedback on the same script. The workflow is fixed:

1. AI-marked first pass. AI-assisted marking triages a large set of scripts quickly — flagging likely errors, timing patterns, and recurring gaps. That AI-marked pass never stands as the final judgement a parent sees.
2. Teacher-marked second pass. Every qualitative assessment of writing and reasoning is teacher-marked by a qualified tutor against the relevant exam criteria before it reaches a family.
3. Tutor record is the source of truth. Where the AI-marked and teacher-marked passes disagree, the tutor decides. The mock-review log parents rely on is the teacher-marked outcome, not the automated pass.

In practice this means AI speeds up triage; it does not replace the teacher. For the parent-facing marking SLAs, what AI versus teachers do, and the Calm Data walkthrough of how feedback arrives on the LMS, read our AI and teacher marking guide. This methodology page keeps the validation principle and measured-versus-not-claimed remit; it does not duplicate those parent workflow details.

What does Braintree Coaching Australia measure?

We measure preparation and observed movement, not certainty. Concretely, our tutor team records:

• Mock-review logs — how each student performs across full timed practice papers, and which mistakes recur, section by section. These logs are the evidence behind our published common-mistake banks for OC practice and the NSW Selective format guide.
• Reserve-list tracking — when NSW Selective reserve-list families report offers, logged by band across a full round (published on our reserve-band timing report).
• Enrolment volume — more than 5,000 students enrol with Braintree Coaching Australia each year across free and paid courses, published as an audited lower bound rather than an exact daily count.

These are the inputs. The results and outcomes hub turns them into anonymised ranges and observations — never a cherry-picked trophy board.

What does Braintree Coaching Australia not claim?

Being serious about results means being just as clear about the claims we refuse to make:

1. No placement total or success rate. We do not publish a "students placed" number or a percentage success rate, because no audited figure exists. A previous internal estimate was retracted rather than published.
2. No individual predictions. Everything we report is aggregate and historical. A practice score, a calculator estimate, and a mock percentile describe preparation — they do not predict how a child will do on the day.
3. AI does not replace the teacher. Automated marking never delivers the final qualitative judgement; a qualified tutor always does.
4. Official process wins. Selection, cut-offs, and reserve-list movement are set by the relevant education authority, not by our analytics.

Provenance: where this methodology traces back

Each claim on this page maps to a cleared row in our first-hand data inventory:

• tools-calculator — the frozen scoring engine with server-side cut-off values.
• calculator-cutoff-trends — the seasonal cut-off trends encoded in that engine.
• enrollment-volume-2024 — the annual enrolment figure, published as the audited lower bound "5,000+".

Where a figure has no audited row — most notably any placement total — it is recorded as deferred in our inventory and omitted here, not estimated.

Related resources

• AI and teacher marking (Calm Data) — parent-facing hybrid marking SLAs and walkthroughs
• Results and outcomes — the anonymised findings this methodology produces
• Selective entry score calculator — the deterministic tool described above
• NSW Selective results interpretation — how to read a Selective result
• OC results — understanding an Opportunity Class outcome
• Reserve-band timing 2024–2025 — school-by-school offer history
• Selective school preparation — the full NSW Selective prep hub