Skip to content
DesignBench

Generated by Fable 5 · DurkBench design benchmark

1m 51s start to finish

Everything below this bar is the page the model wrote. DurkBench did not change a word of it, and the company it describes is made up.

Skip to content

Lisbon · RemoteNine people, one discipline

We design the systems behind the systems.

Agent architectures, evaluation harnesses, retrieval pipelines, and the operational plumbing that keeps them honest in production.

Systems taken to production
31
Senior engineers, no juniors
9
Countries we are currently on-call in
4
Clients still dependent on us daily
0

01Services

Four things, done properly.

We turned down the fifth. Depth in a narrow band is the whole point of a nine-person firm.

  • 01

    Agent architecture

    We design multi-step agents with explicit state, bounded tool access, and failure paths you can read. You get a system diagram your engineers will still agree with six months later.

  • 02

    Evaluation harnesses

    We build the test suites that tell you whether a model change is an improvement or a regression. Graded datasets, judge calibration, and dashboards wired into your CI.

  • 03

    Retrieval pipelines

    Chunking, indexing, reranking, and freshness are decisions, not defaults. We tune each against your real queries and leave behind the tooling to re-tune them.

  • 04

    Operational plumbing

    Tracing, cost attribution, prompt versioning, rollback, and on-call runbooks. The unglamorous layer that decides whether a demo becomes a product.

02How we work

Four steps. The last one is the one we get judged on.

  1. 1

    Diagnose

    Two weeks reading your code, your traces, and your incident history. We end with a written assessment naming the three things most likely to break.

  2. 2

    Design

    A reference architecture, an evaluation plan, and a cost model. Reviewed with your team in one room until nobody has an unanswered objection.

  3. 3

    Build alongside

    We pair with your engineers rather than shipping a black box. Every component arrives with tests, a runbook, and a named owner on your side.

  4. 4

    Hand over

    We stay on a light retainer for one quarter, then step back. If you still need us daily after that, we designed it wrong.

03Case studies

Recent work

Every number below was measured by the client, not by us, on production traffic.

Logistics · Rotterdam

Halden Maritime

Problem
A claims-triage assistant hallucinated vessel identifiers and nobody could tell which prompt version had produced a given answer.
What we built
A retrieval layer over their registry with strict citation, plus a versioned prompt store and a 1,400-case graded eval set.

−94%

Identifier errors in production

Retail · Manchester

Cinder & Vale

Problem
Their support agent escalated half of all conversations to humans because it could not safely issue refunds or check stock.
What we built
A tool-using agent with scoped permissions, a two-stage approval path for money movement, and replayable traces for every session.

71%

Conversations resolved without handoff

Clinical software · Porto

Tessellate Health

Problem
Model upgrades were decided by vibes. Each one took three weeks of manual review and still shipped regressions.
What we built
An evaluation harness with clinician-graded rubrics, automated judges calibrated against them, and a go/no-go report in CI.

3 wk → 4 h

Time to validate a model change

04Team

The four people you will actually talk to.

The other five are engineers who would rather be in your repository than on this page. You will meet them in week one.

  • Inês Carvalho

    Founding partner, architecture

    Spent nine years building trading infrastructure before deciding agents were the more interesting distributed system.

  • Tomás Reis

    Partner, evaluation

    Former measurement lead at a search company. Believes every metric should come with a story about how it can lie.

  • Priya Raman

    Principal engineer, retrieval

    Has rebuilt the same document pipeline four times for four industries and still finds chunking strategy genuinely contentious.

  • Jonas Weber

    Principal engineer, operations

    Ran on-call for a payments platform. Writes runbooks first and code second, to everyone's mild irritation.

05FAQ

Things people ask on the first call

Do you build the whole product, or just the AI parts?

Just the AI systems and the operational layer around them. We work inside your codebase alongside your team; we are not a product studio and will say so early if that is what you need.

Which model providers do you work with?

All the major ones, plus open-weight models you host yourself. We are deliberately unaffiliated. Our architectures assume you will swap providers at least once, because every client so far has.

How long does a typical engagement last?

Diagnosis takes two weeks and is priced fixed. Design and build usually run eight to sixteen weeks. The handover retainer is one quarter. We decline engagements that look open-ended.

Will our data leave our environment?

No. We work inside your cloud account with access you grant and can revoke. Evaluation datasets stay with you. We sign your DPA, not the other way round.

What does it cost?

Diagnosis is €18,000. Build phases are scoped weekly at a published day rate, agreed before we start. We do not bill for rework caused by our own design mistakes.

06Contact

Tell us what keeps breaking.

We reply within two working days, usually with three questions and a suggested time. We take on two new diagnoses a month.

Prefer email? hello@orrery.systems