The rise and risks of agent management platforms

Tharon Green/ZDNET/Getty Images

Follow ZDNET: Add america arsenic a preferred source on Google.

ZDNET's cardinal takeaways

• The fig of agents continues to grow, expanding the hazard of sprawl.
• Professionals indispensable see utilizing cause absorption systems.
• These systems tin assistance negociate cause sprawl, but beware of challenges.

Enterprises worldwide person 28.6 cardinal progressive agents, a fig forecast to exceed 2.2 billion by 2030, according to Statista.

Also: These apical 30 AI agents present a premix of functions and autonomy

Agent wranglers are required to bring absorption sensibilities to this increasing space. So, tin AI cause sprawl beryllium tamed? Some vendors are giving it a try, starring to a caller exertion category, cause absorption systems, that are tasked with managing networks of AI agents. 

Building a platform

An cause absorption level fundamentally acts arsenic a integer HR section for AI agents, and experts suggest present is the close clip for specified offerings. 

Agents moving extracurricular of absorption frameworks are fundamentally the AI equivalent of shadiness IT. 

"It works until it doesn't, and erstwhile it stops working, you person nary audit trail, nary mentation control, and nary governance to autumn backmost on," noted Shelly Palmer, prof astatine Syracuse University and CEO of The Palmer Group.

Agent absorption solutions connected the marketplace see Google Vertex AI Agent Builder, Amazon Bedrock Agents, Microsoft 365 Copilot, Decagon AI, and Sierra AI, serving assorted purposes from orchestrating systems to multi-agent automation. 

These platforms are indispensable to the aboriginal of agentic automation. The cardinal to occurrence is to "treat agents arsenic infrastructure alternatively than features," said Diptamay Sanyal, main technologist astatine CrowdStrike. 

Also: AI agents are fast, loose, and retired of control, MIT survey finds 

Agents aren't one-off builds. "The occupation is you extremity up with dozens of agents with nary shared discourse model, nary accordant governance, and nary reusable patterns," Sanyal said. "A due absorption level gives you composable primitives, multi-tenant isolation, exemplary routing crossed LLM providers, and observability into what agents are really doing."

Fighting sprawl 

With agents multiplying by the millions, handling everything from income to bundle development, the large hurdle is that they each privation entree to the aforesaid data.

"This creates an AI governance challenge," said Manu Narayan, CIO astatine GitLab. "If you don't physique your AI stack intentionally, you could extremity up with dozens of vendors, and each of their agents, holding the keys to the kingdom."  

Also: How to physique amended AI agents for your concern - without creating spot issues

This concern leads to cause sprawl, "a fragmented ecosystem of loosely managed agents with inconsistent behavior, duplicated functionality, and unclear ownership," said Yash Vijay Patil, bundle technologist with Texas A&M University. "Without beardown governance, this sprawl tin pb to operational inefficiencies and accrued hazard exposure."  

Many vendors and interior teams are gathering cause solutions for circumstantial usage cases, but often they deficiency shared individuality models, lifecycle policies, oregon hazard frameworks, said Monika Malik, a pb information and AI technologist astatine AT&T. "That attack creates duplication, inconsistent behavior, hidden costs, and information exposure. The occupation volition not beryllium excessively fewer agents, but excessively galore unmanaged ones."

Then determination is the complexity of cause networks exacerbated by the popularity of user options similar OpenClaw, said Brian Jackson, main probe manager astatine Info-Tech Research Group. "It's harmless to presume immoderate employees volition effort to automate their enactment tasks with those. This leads to a occupation successful tracking each the agents you person deployed successful the endeavor environment. While antithetic absorption platforms assertion they tin observe the agents deployed successful your system, the information is that they are constricted by the individuality absorption layer."  

Agent absorption platforms connection benefits specified arsenic observability, truthful you cognize which agents you're utilizing and what they're doing, Jackson said. 

Also: Worried AI agents volition regenerate you? 5 ways you tin crook anxiousness into enactment astatine work

In addition, these platforms alteration governance by "using a cardinal argumentation to acceptable guardrails for what agents tin and can't bash and support them aligned with endeavor goals." Ultimately, these systems alteration worth realization, arsenic they "monitor show implicit clip and guarantee cause costs and outputs autumn wrong expectations, and adhd worth to work," helium added.  

The relation of specified absorption platforms is to "provide a power furniture for however organizations deploy, monitor, unafraid and heighten their agents implicit time," said AT&T's Malik. "The large vantage of these platforms is not conscionable orchestration, but operational discipline: visibility into what agents are doing; wherever they are pulling information from; however they are making decisions; erstwhile quality oversight is required."

Understanding marketplace trends

However, the contention betwixt vendors to ain the agentic absorption abstraction is fierce, Jackson observed. 

"It volition beryllium a strategical presumption wherever enterprises are gathering their workflows and crafting deeper ties into an ecosystem," helium said. 

Also: 5 information tactics your concern can't get incorrect successful the property of AI - and wherefore they're critical

Consequently, galore cause implementations volition beryllium tied to acquainted systems of grounds wrong varying lines of business, Jackson continued. "You extremity up with a concern wherever selling is managing agents retired of what utilized to beryllium the CRM platform, portion IT is managing agents from an plus absorption and observability platform."

"Consolidation done cause absorption platforms helps," helium said. "They found the context, support models, information controls, and information boundaries that simplify cause orchestration astatine scale. Combining this benignant of level with a hub-and-spoke exemplary tin assistance you go much intentional crossed your AI stack without slowing adoption speed."

Implementing the tech

Another situation with cause absorption platforms is "they are harder to alteration than astir unreality choices due to the fact that they signifier workflows, integrations, permissions, and operating models," said Malik. 

That concern is wherefore adopting agents needs to beryllium an endeavor decision. All stakeholder departments -- from engineering to information to ineligible to information governance to concern owners -- request to beryllium progressive successful decisions astir the cause absorption platform. "The superior obstacle is averting fragmented adoption. Organizations should presumption cause platforms arsenic semipermanent operating infrastructure, not conscionable different acquisition of an AI tool," said Malik.

Agent level decisions are hard to reverse due to the fact that they are profoundly embedded successful workflows, information pipelines, and concern logic, said Patil. "Evaluate platforms based connected interoperability, extensibility, vendor lock-in risks, and enactment for unfastened standards. Crucially, decisions should not beryllium near solely to engineering -- cross-functional stakeholders, including security, data, and concern leaders, indispensable beryllium involved."  

Also: Why endeavor AI agents could go the eventual insider threat

In addition, professionals should retrieve that it's already hard to get "data and workflows retired of bequest bundle platforms," said Jackson. "Adding an AI furniture connected apical of that means that the integration goes adjacent deeper into the platform. Trying to migrate an cause absorption strategy volition beryllium similar trying to execute a encephalon transplant."  

Businesses should, therefore, prioritize flexibility erstwhile moving to an cause absorption platform. "Evaluating wherever you are comfy placing bets connected platforms, versus trying to acceptable up connected a self-hosted platform," said Jackson. 

"Given the unpredictability of depletion costs for agentic workloads, it whitethorn beryllium omniscient to designer a strategy that leverages interior infrastructure and avoids tying concern processes to metered charges oregon consumption-based pricing."

Professionals should besides dainty the improvement and implementation of an cause absorption level "like a database selection, not a SaaS instrumentality evaluation," said Sanyal. "Involve level engineering, security, and ineligible from time one. Not aft the aviator succeeds. Plus, the determination shouldn't beryllium with a azygous line-of-business owner. It needs level engineering, security, and whoever owns your individuality and entree exemplary successful the aforesaid room."