Technology

A stack built to run experiments, not demonstrations

Automating discovery takes more than a good model. It takes the silicon the trials execute on, the scheduler that places them, the models that propose them, and the harnesses that decide whether anything was learned. We build all four as one system.

01 · The stack

Four layers, one conveyor

Each layer exists so the one above it can stop worrying about something. When a layer works, nobody above it has to think about that problem again.

Silicon & kernels

Search that reaches below the framework: precision, memory layout, fusion, and the scheduling of work on the device. Small wins here multiply across every trial the loop runs.

PrecisionKernelsMemory

Compute orchestration

Queueing, placement, preemption and recovery so that thousands of trials share a finite cluster without starving each other or losing results to a restart.

SchedulingCheckpointing

Frontier proposers

Models that convert an objective and prior results into the next set of candidates — ranked, justified, and shaped to be worth the compute they will consume.

HypothesesSearch spaces

Evaluation & products

Harnesses that score every run against a fixed objective, and the surfaces that let a person inspect what happened and act on it. Unscored output is not a result.

BaselinesReporting
02 · Anatomy of a cycle

Eight steps, one unbroken chain

A cycle is only as autonomous as its weakest hand-off. These are the steps we drive to zero human latency between, while keeping a person able to stop the line at every gate.

1 · Objective
Declared before any experiment runs: metric, constraint, budget and what would count as failure.
2 · Search space
What may vary, what is fixed, and which interactions are worth spending trials on.
3 · Propose
Frontier models draft candidates with reasoning and predicted cost, then rank them.
4 · Schedule
Trials are placed against the cluster: batching, device fit, priority, cost ceiling.
5 · Execute
Isolated runs with pinned environments, retries on failure, checkpointing for long jobs.
6 · Score
Automatic evaluation against the frozen baseline, with uncertainty recorded beside each number.
7 · Promote
Winners advance; losers are logged with the reason they lost. Nothing is silently dropped.
8 · Iterate
The next round starts from updated priors — not from a meeting invitation.
See the conceptual loop

Run record · example

Illustrative
Objectiveval loss
Baselinefrozen
Environment pinneddigest ok
Trials scored512 / 512
Promotion decisionafter re-run
03 · Measurement

The harness is the product

An autonomous loop is dangerously easy to fool. Most of our engineering effort goes into making it hard to fool ourselves: instruments that catch the specific ways a search lies to its operator.

We measureInstrumentFailure mode it catches
Delta against a frozen baselineBaseline pinned per objective, re-scored at the end of each cycleDrift, where a “win” is really a change to the measuring stick
Spread across seedsRepeated runs of promoted candidatesLucky single runs presented as improvements
Compute spent per gainCost accounting attached to every trialExpensive noise: more compute, no more information
Held-out generalisationObjectives the proposer never seesOverfitting to the visible metric
Failure taxonomyClassified error records for every discarded trialSurvivorship bias in the search history
ReproducibilityVersioned code, data references, environment digestsResults that cannot be replayed by anyone, including us
Rule of the house: if a number cannot be reproduced from the run record, it is not reported — internally or externally. Promotion decisions follow the same rule.
04 · Parallelism

A thousand trials, one waiting room

Parallelism is where the theory meets the power bill. Three problems dominate everything else.

01

Scheduling & queueing

Trials differ wildly in size. Placement, batching and priority decide whether a cluster runs at 40% or 95% utilisation, and whether a small experiment waits behind a giant one.

02

Preemption & recovery

Hardware fails, jobs are evicted, nodes are drained. Checkpointing and honest retry policy decide whether a cycle survives the night or quietly returns half its answers.

03

Cost ceilings

An autonomous loop will happily spend forever. Every objective carries a budget, and the scheduler enforces it before a trial starts, not after the invoice arrives.

We measure orchestration in one number: effective trials per hour at a fixed cost. It is the closest thing this stack has to a heartbeat.

05 · Interfaces

Built for researchers, engineers — and the loop itself

For researchers

State an objective and the space you are willing to explore. The system handles the rest of the cycle and hands back evidence, not a dashboard of noise.

For engineers

Experiments as artefacts with identifiers, diffs and rollbacks — closer to continuous integration than to a notebook, so a good result can be shipped instead of admired.

For the loop itself

The same interfaces are exposed to the system, which is what lets it optimise its own stack — our first and most demanding customer, with no patience for flaky tooling.

Want the deep version of any of this?

We are happy to talk architecture with people who have run experiments at scale — and to argue about scheduling.