Build your baseline of truth with North Star

What you can measure, you can understand.

North Star — Dataset view showing candidate screening scenarios with labels and status

Run your requirements

Turn what product writes into artifacts engineering can build and everyone can measure.

Product requirements → Golden seed

From a doc everyone reads once to a charter everything is measured against.

How it used to be

The PRD was the single source of truth. Goals, users, and stories spelled out in prose. The whole team read the same doc, aligned on intent, and engineering built against it.

What breaks with AI

Prose can't check anything. The doc can't tell you whether an AI output is on target. What good looks like stays implicit, so every reviewer interprets it differently.

The North Star way

North Star distills the PRD into a golden seed: the task's input, its output, and what a good output must satisfy. Paste a PRD and the seed pre-fills itself. From there it anchors everything downstream: dataset, scorers, evals.

Acceptance criteria → Scorers

From a checklist walked at sign-off to graders that run on every change.

How it used to be

Acceptance criteria defined done for each story. A checklist agreed between product and engineering, it settled scope before building and converted straight into QA test cases.

What breaks with AI

Binary pass or fail doesn't survive AI. The same prompt gives different outputs every run, and the quality you care about can't be written as one expected answer. Checking once fails when every change shifts the results.

The North Star way

Each criterion becomes a scorer: same intent, now executable. An LLM judge grades every output in the dataset against it, and grades again on every change. A one-time gate becomes a living measure of good.

Vision → Benchmark

From a direction you point at to a yardstick you score against.

How it used to be

The vision set the direction. It rallied the team and stakeholders around where the product is headed, and it justified the roadmap and its bets.

What breaks with AI

Better and smarter have no number behind them. Each release gets judged on vibes, regressions slip through, and the goal never touches the day-to-day work.

The North Star way

The vision becomes a benchmark: a labeled dataset plus scorers that make good measurable. Every change is scored against the same yardstick. Progress is a number, and regressions show up across the whole dataset.

Two jobs, one source of truth

The same seed and scorers from each side of the team, and the ROI both can point to.