Deciding what not to expose
Infrastructure was largely designed for people who read docs and debug by hand; building for agents and for non-infrastructure users both raise the question of what to hide.
The idea in brief
Much cloud infrastructure assumes a person who can read documentation, write configuration and debug when something breaks. A Latent Space episode on agent experience argues that agents don't have that context. The same question applies to people who use a platform without being infrastructure specialists.
Points from the Latent Space episode
In "Why AI Infrastructure must evolve for Agent Experience" (July 2026), Akshat Bubna, CTO of Modal, talks with swyx and Vibhu. Points from the episode:
- Traditional cloud tooling assumed a human operator who carries implicit context about how it works.
- Modal shifted part of its SDK work from developer experience to agent experience, and argues the same improvements help both.
- Defining infrastructure in code rather than configuration files makes it easier for agents to change and observe their environments.
- Guardrails for agent sandboxes should rely on hard boundaries, not only permissions mediated by a model.
A thin layer over what exists
The CNCF Platforms White Paper recommends building the thinnest reasonable layer over existing managed services, and offering capabilities through self-service APIs, CLIs and templates. That is a way of exposing a smaller surface without rebuilding what is underneath.
The balance
| Usually hidden | Still worth showing |
|---|---|
| Cluster and network layout | Which deployment served the request |
| Identity plumbing | Which identity and scope were used |
| Gateway policy internals | Which policy acted on the request |
| Provider APIs | Which model version answered |
| Quota mechanics | Quota used and when it resets |
Hiding detail and hiding evidence are different things. A user may not need to know about clusters, identity plumbing or gateway policies, but still needs enough signal to tell where a problem is. The post on abstractions and evidence looks at that side.
Limitations
Agents and people differ.
The episode notes that people still need good dashboards for judgement calls, even when agents work through a CLI.
Hidden still has to work.
Whatever the platform hides, it has to keep reliable, because users can no longer work around it.
Abstractions leak.
Some failures will always need lower-level detail to resolve.
Sources
Cite this post
Adam, Ammar. (Sep 2026). Deciding what not to expose. www.ammaradam.dev. https://www.ammaradam.dev/posts/what-not-to-expose/.
BibTeX
@article{adam2026whatnottoexpose,
title = {Deciding what not to expose},
author = {Adam, Ammar},
journal = {www.ammaradam.dev},
year = {2026},
month = {Sep},
url = {https://www.ammaradam.dev/posts/what-not-to-expose/}
}
Comments
Sign in with GitHub to like this post or join the discussion.