A real-world test of whether an AI agent can keep working independently without becoming trapped by its own mistaken account of what happened.
A real-world test of whether an AI agent can keep working independently without becoming trapped by its own mistaken account of what happened.
Project Details
Updated 07/12/26 · Edited by orgI am working on Halo-2.0, a persistent autonomous AI agent. Give it a goal and walk away. It plans the work, uses a browser and other tools, reads their output, writes/runs code when necessary, adjusts itself in case a certain step fails and continues moving toward the goal without approval after each step.
Working demonstration: https://youtu.be/lGcZGRFRXQ8
Project website: https://www.oscerra.space
Halo-2.0 is currently in closed alpha. The whole system already works end-to-end, but at some point I've realized that testing it on my own tasks is not fully sufficient. This grant application is not about releasing a product publicly or scaling it. This grant application is a 12-week external testing program to study how it behaves on tasks chosen by people other than its developer.
The central design question of my work is quite straightforward: What should an agent do when it believes a step succeeded, but the result shows that it did not?
Many autonomous agent systems incorporate planning, action, and judgment into one model loop. Model says that the file is edited, the page is understood, the build is done and/or the answer was found and then agent goes further. My approach is aimed to challenge such assumption. In case of executing an action, system checks what has really changed in the browser, file system, the output of commands or in results of using a tool. In case of a mismatch between the expected change and reality – step is considered incomplete, agent reconsiders the situation, modifies its approach, asks for help and even stops if necessary.
The purpose of the grant will be to:
-
Isolate the Halo agent into a testable version with all the precautions taken (
isolated sessions, bounded permissions etc.)
-
For $5,000, a smaller cohort group of 8-10 testers will be supported for 12 weeks, and around 50-60 traces of tasks will be completed. For $10,000, a larger group of 15-20 testers will be supported, along with 100 or more task traces, some testing
-
Capture and replay at least 100 completed task runs including unsuccessful attempts, recovery from them, repeated mistakes and early stops.
-
Transform those runs into the taxonomy of long-horizon autonomous agent errors and small evaluation dataset to test possible solutions to the errors.
-
Publish a report of what errors occurred, what interventions were helpful, which were not and what are the safe limitations of Halo.
Codebase remains proprietary. Public deliverables will include the evaluation procedure, anonymized failure cases and findings for others interested in developing or evaluating autonomous systems.
I am Mashrikain Mazdi; a 16-year-old self-taught programmer from Barisal, Bangladesh. I began to develop web automation systems at the age of 13, realizing that the world described in the documents was not the world encountered by software on the web. I've developed Halo-2.0 completely solo, including those of planning, web interaction, model routing, memory, programming, code reviewing, and recovery. External testers will participate in both versions of the project (minimum funding and ideal funding). The ideal version would also include limited review from independent technical reviewers.
Theory of Impact
Updated 07/17/26 · By grantmaking.aiThe important transition is not only in the shift from less capable models to smarter models. It is rather a transition from the systems that react on human presence to systems that perform hundreds and even thousands of actions without further supervision.
A wrong answer in a brief dialogue is easy to notice. But during a prolonged autonomous execution, even small mistakes become a starting point for all subsequent actions of the agent. The agent may misunderstand some pages, think that the command was successfully performed although it did not succeed, interpret the results of previous versions instead of current, search for the information again as the lack of presence was already established, or state the completion without checking the result of its work. In isolation, each of these mistakes is not an existential threat. The issue here is that the tendency is growing: the more autonomy, the less supervision and the number of mismatched assumptions can accumulate and transform into an increasingly unpredictable and unmanageable behavior.
Halo-2.0 is a practical test of whether an agent can be given more independence without blind trust to its interpretation of events. The design of Halo-2.0 allows isolating decision making process from the check of the result. Of course, the issues of alignment, deception, and loss of control will not be solved in their full scope. However, it will allow making a certain contribution to solving the problem: identify how to minimize silent failures of long tasks.
People
Updated 07/17/26 · By grantmaking.aiTeam Member
Discussion
No comments yet. Be the first to share your thoughts.