Engineering

What Blackreach taught me about reliable browser agents


Blackreach is the public browser and research agent behind these lessons. The case study includes the current public-safe overview, exact test evidence, and a controlled 27-second cinematic real-web browser proof.

The first version looked convincing in short demos and became unreliable during real research. That gap changed how I judge agent infrastructure. A fluent action trace is not proof that useful work happened.

Observation quality sets the ceiling

A model cannot reason well over a page it cannot interpret. Passing more markup into context usually added noise instead of understanding. The useful direction was to present a smaller, current description of what a person could see and act on.

State is part of the product

Research work is interrupted. Networks fail, pages change, and long tasks outlive one process. A browser agent becomes more useful when progress is explicit enough to resume, inspect, and reject instead of restarting or inventing completion.

Verification must be independent

A request can succeed while returning the wrong page. A file can exist while containing an error message. Blackreach pushed me to separate the agent's report from checks on the artifact, source, and final state.

Failure should stay visible

Silent recovery feels smooth until it produces the wrong result. I now prefer systems that expose uncertainty, record why a task stopped, and require a deliberate choice before weakening a boundary.

These ideas now apply to more than browser agents: reduce the observation, preserve state, verify the outcome, and fail loudly when evidence is weak.

Inspect the public project on GitHub. Implementation-specific browsing environments, evasion techniques, private session details, and deployment topology are intentionally not documented here.