Model & architecture design
Variants of attention, routing, depth and connectivity, proposed against a fixed objective and pruned early when the cost of a full run is unlikely to be repaid.
Autonomous experimentation is only useful where a cycle exists and an outcome can be measured. We start in the domain that satisfies both conditions most ruthlessly — machine learning — and expand outward in sequence, not in parallel.
ML is our first domain because the feedback loop is short, honest and cheap enough to run at volume: either an experiment improves a measurable objective or it does not, and we can tell within hours rather than seasons.
Variants of attention, routing, depth and connectivity, proposed against a fixed objective and pruned early when the cost of a full run is unlikely to be repaid.
Optimiser settings, schedules, precision and data composition searched together rather than one variable at a time — the interactions are where the gains hide.
Throughput-first optimisation of kernels, memory pressure, parallelism strategy and scheduling — measured in time and euros per finished experiment.
Nothing here is exotic in isolation. The difference is that all of it runs as one closed cycle, thousands of trials at a time, with the results feeding the next round automatically.
Research gains are worthless if they cannot be shipped. The second front carries the same loop from model work into the systems, pipelines and products built on top of it — which is also where an autonomous lab stops needing a hand-off to production.
Machine learning is where our own stack lives. Optimising it with the loop means every improvement to the system is spent immediately on improving the system — a compounding advantage that is hard to buy and impossible to fake.
Each domain below shares a familiar structure: a slow manual cycle, expensive iterations, and an outcome that can be measured. We describe our intended approach honestly — including what has to exist first, and what we do not have yet.
Enthusiasm is not a selection criterion. A domain has to pass all five tests before the loop is pointed at it — otherwise we would be automating noise.
Describe the objective, the cost of one iteration, and why it cannot be parallelised by hand. That is the whole conversation.