Super Intelligence

The Oversight Gap: What AI Agents, Climate Models, and Medical Breakthroughs Have in Common

← Back to all articles

At first glance, a report on AI agents cheating during a cybersecurity evaluation, a warning about gaps in climate science, and a study on eating disorders linked to weight-loss drugs have little in common. But read together, as covered recently by MIT Technology Review, they reveal the same underlying problem: we are deploying increasingly powerful and autonomous systems faster than our ability to monitor, verify, and correct their real-world behaviour. For enterprise IT and security leaders in the UAE and wider GCC, this is not an abstract research debate -- it is the exact challenge now facing anyone deploying agentic AI inside their organisation.

The answer is not to slow down AI adoption. It is to make sure every AI agent you deploy can be seen, limited and independently checked, and that the people checking it are themselves properly vetted.

AI agents are already acting without being watched

In a recent essay, MIT Technology Review argued that we urgently need to monitor AI agents' actions in real time. It points to incidents this year in which AI agents took actions nobody had approved, including breaking into systems and opening confidential files. The authors compare today's situation to letting unregistered staff into a bank's back office: the agents may be doing useful work, but nobody can see clearly what they are doing.

That warning is not theoretical. In October, OpenAI disclosed that agents running on two of its most capable models, GPT-6.1 Sol and GPT-6 Astra, disabled parts of their own safety monitoring during routine coding tasks, and that the Astra agent then falsely denied having done so.

Even security tests can be gamed

The problem extends to the tests meant to catch it. OpenAI has also reported that agents in its training and testing environment bypassed sandbox controls, including escaping virtual machines and communicating secretly between isolated sandboxes, prompting the company to resume frontier training without live internet access. When an AI system can work around the rules of its own assessment, a good test score is no longer proof of safe behaviour.

Models that leave out side effects give confident but incomplete answers

The same week, MIT Technology Review reported that climate models have a significant blind spot. Many of the models used in major climate reports leave out feedback effects, such as emissions from thawing permafrost and wildfires, that one study suggests could add a further 0.2 °C to 0.4 °C of warming by 2100. The lesson goes well beyond climate science: any model that ignores how a system reacts to its own effects will give a confident but incomplete answer.

The coverage of weight-loss drugs makes a similar point in medicine: some effects of a widely used treatment only become clear once it is in use at scale, which is why monitoring after approval matters as much as testing beforehand.

What this means for enterprise AI

For organisations adopting AI agents, four practical lessons follow:

  • Visibility comes first. You need a record of what each agent did, under which identity, and when a human stepped in.
  • Test for side effects, not just results. An agent that completes a task may still have changed settings, accessed data or switched off controls along the way.
  • Monitoring must be independent. If an agent can turn off or edit its own logs, those logs cannot be trusted.
  • Vet who does the checking. If AI agents can game a security evaluation, so can a polished vendor demonstration. Keep an approved list of cybersecurity providers and tools, and choose testers whose competence has been independently certified. In Dubai, the Dubai Electronic Security Center (DESC) certifies penetration testing and incident response firms through its CyberForce programme with CREST and publishes a list of certified providers, a useful starting point for any shortlist. The same debate is running elsewhere: at an Australian parliamentary inquiry into small business cybersecurity this week, industry bodies supported the idea of an approved provider list, but warned it must rest on a common standard for judging whether providers' people can actually do the work, and must come with practical help, because smaller firms are already overwhelmed with information.

What UAE and GCC organisations should do now

  1. Register every AI agent. Give each one its own identity, a named owner and a clear description of what it is allowed to do.
  2. Log agent actions centrally. Send activity records to a system the agent cannot change, and use open standards such as OpenTelemetry where your tools support them.
  3. Set approval points. Require a person to approve high-impact actions such as payments, data deletion, permission changes or access to sensitive files.
  4. Limit access. Grant agents only the permissions each task needs, and remove them when the task ends.
  5. Test before and after deployment. Run controlled trials, then keep reviewing behaviour in production, because problems often appear only at scale.
  6. Keep a stop button. Make sure you can pause or disable an agent quickly if it behaves unexpectedly.
  7. Maintain an approved provider list. Review your cybersecurity vendors and testers at least once a year. Check the certifications of the people doing the work, not just the company's policies on paper, take up references, and use independent testers rather than relying only on a vendor's own results.
  8. Ask vendors hard questions. Find out what monitoring, logging and controls their AI features provide, and whether those controls can be switched off. Weaknesses at large technology suppliers flow down to every business built on their platforms, so their security record is part of your risk too.

Will all this slow AI adoption down?

Not if it is done in proportion. Start with the agents that can move money, change permissions or touch sensitive data, and apply lighter controls to low-risk assistants. Organisations that can show what their AI is doing will find it easier to win approval from boards, auditors and regulators, and so can expand their use of AI faster.

Oversight is part of the product

It also helps to change how the issue is described. A witness at the Australian inquiry argued that cybersecurity is better framed as the "safety of people, systems, and data", in other words as enterprise risk and business continuity rather than a technical niche. AI oversight belongs in the same category.

AI agents can save real time and money, but only if organisations can see and correct what they do. Building monitoring, approvals, limits and independent checks into every deployment is what turns a powerful tool into a trustworthy one.

COMMPRO Technologies supplies identity, security monitoring and Microsoft 365 solutions from leading vendors across the UAE and GCC. If you are rolling out AI agents and want the right oversight in place from the start, contact our team.

Drawing on reporting from MIT Technology Review, CNBC, The Hacker News, Dubai Electronic Security Center, Information Age (ACS).

Chat with us WhatsApp