Skip to content
ammaradam

Deciding what not to expose

Infrastructure was largely designed for people who read docs and debug by hand; building for agents and for non-infrastructure users both raise the question of what to hide.

The idea in brief

Much cloud infrastructure assumes a person who can read documentation, write configuration and debug when something breaks. A Latent Space episode on agent experience argues that agents don't have that context. The same question applies to people who use a platform without being infrastructure specialists.

Person or agent using the platformusesevidence: errors,trace IDs, model usedSurface: API, CLI, templatesHidden by defaultClustersNetworkingIdentity plumbingGateway policiesProvider APIsQuota internals
A small surface sits over the hidden detail, with a window that still passes evidence up to the user.

Points from the Latent Space episode

In "Why AI Infrastructure must evolve for Agent Experience" (July 2026), Akshat Bubna, CTO of Modal, talks with swyx and Vibhu. Points from the episode:

  • Traditional cloud tooling assumed a human operator who carries implicit context about how it works.
  • Modal shifted part of its SDK work from developer experience to agent experience, and argues the same improvements help both.
  • Defining infrastructure in code rather than configuration files makes it easier for agents to change and observe their environments.
  • Guardrails for agent sandboxes should rely on hard boundaries, not only permissions mediated by a model.

A thin layer over what exists

The CNCF Platforms White Paper recommends building the thinnest reasonable layer over existing managed services, and offering capabilities through self-service APIs, CLIs and templates. That is a way of exposing a smaller surface without rebuilding what is underneath.

The balance

Usually hiddenStill worth showing
Cluster and network layoutWhich deployment served the request
Identity plumbingWhich identity and scope were used
Gateway policy internalsWhich policy acted on the request
Provider APIsWhich model version answered
Quota mechanicsQuota used and when it resets

Hiding detail and hiding evidence are different things. A user may not need to know about clusters, identity plumbing or gateway policies, but still needs enough signal to tell where a problem is. The post on abstractions and evidence looks at that side.

Limitations

Agents and people differ.

The episode notes that people still need good dashboards for judgement calls, even when agents work through a CLI.

Hidden still has to work.

Whatever the platform hides, it has to keep reliable, because users can no longer work around it.

Abstractions leak.

Some failures will always need lower-level detail to resolve.

Sources

Cite this post

Adam, Ammar. (Sep 2026). Deciding what not to expose. www.ammaradam.dev. https://www.ammaradam.dev/posts/what-not-to-expose/.
BibTeX
@article{adam2026whatnottoexpose,
  title   = {Deciding what not to expose},
  author  = {Adam, Ammar},
  journal = {www.ammaradam.dev},
  year    = {2026},
  month   = {Sep},
  url     = {https://www.ammaradam.dev/posts/what-not-to-expose/}
}
Share

Comments

Sign in with GitHub to like this post or join the discussion.

Read next