Why Capital One built its multi-agent AI platform around open-weight models

Presented by Capital One At VB Transform 2026 , Kel Vanee, MVP of machine learning engineering at Capital One, spoke with Sam Witteveen, Senior Technology Contributor at VentureBeat, about how the bank built a scalable multi-agent AI architecture around deeply customized open-weight models rather than relying on an off-the-shelf foundation model. "At Capital One, we're not just using AI, we're building AI," Vanee said.

The groundwork was laid years ago with Capital One's early investments in data transformation and cloud adoption, which Vanee said were foundational to moving quickly when the current wave of AI arrived. That technical foundation enabled the company to make several deliberate architectural decisions, including building a centralized, enterprise-wide AI platform with built-in governance, deeply customizing open models with proprietary data, and constructing its own multi-agent orchestration harness. Customizing open-weight models with proprietary data Rather than relying solely on off-the-shelf frontier models, Capital One fine-tunes open-weight models using its rich, proprietary data. "We view our data as a huge advantage and something that nobody else has, something that the general frontier models cannot provide. So we are taking that data and deeply customizing these models," Vanee explained. He added that real-time data is absolutely critical to bring in fresh context during live customer or associate interactions. Vanee also revealed an unexpected benefit of this approach: extensibility across the enterprise. “As we customize those open-source models for one use case, we actually see benefits across our whole portfolio," he noted. "We are training that model to be an expert at Capital One use cases, policy, and nomenclature. As we do that training, we see a general lift." Inside Capital One's multi-agentic AI workflow As an example of the approach, Vanee pointed to a customer-service workflow for bank fraud that handles millions of calls a year, where interactions range from roughly four minutes to as long as sixty minutes, and where an initial attempt at engaging a single large language model proved insufficient. With Capital One's multi-agentic workflow (MACAW), interactions are routed through specialized agents with governance and guardrails built in. "The MACAW workflow is made up of a number of different agents," he said. "The first one is an understanding agent. Its purpose is to look at what the customer is saying and try to understand what their intention is.” From there, a reasoning agent is given several specific instructions to generate a summary; a validation agent fact-checks the summary to ensure it is accurate; and an explaining agent turns the summary into a formatted document with all necessary details that is then shared with agents. For the consumer banking use case, this workflow helps several hundred customer-service agents who specialize in complex fraud calls. The post-call summaries it generates help document long, back-and-forth interactions that agents previously had to reconstruct by hand. Capital One’s multi-agentic architecture also underpins Chat Concierge, a customer-facing auto-shopping assistant, which further leverages a version of Meta's open-weight Llama model that has been customized with Capital One's proprietary data. It uses the same division of labor, with one agent conversing with the customer, one building an action plan from business rules, one evaluating accuracy, and one explaining and validating the result. Optimizing latency and cost with an agentic research system Beyond customer-facing solutions, Capital One is also leveraging agentic AI to automate rote tasks for its employees and help them focus on high-leverage aspects of their work. In one example, the company built an autonomous agentic optimization solution to tune backend hosting infrastructure. Vanee explained that in the world of LLMs, where new optimizations are delivered every day, they aren't all complementary. Combining two good optimizations can sometimes cause a performance regression. "This agentic system will run through a search space that is designed by the researcher, handle all the mechanics of setting up that experiment and running the experiment, and then put a whole summarization of the results in front of the researcher," Vanee said. Vanee added that the system allows researchers to “find the series of optimizations and configurations that's really going to give [them] the best latency possible.” What's next: model routing and proactive, event-driven AI Looking ahead, one big trend Vanee sees is routing abstraction layers that a platform seeks to validate over multiple models, both for cost and accuracy. "We actually think that you can get better accuracy than any individual model simply by routing across a broader set of available models, because different models are going to excel in different areas," he said. His second prediction was a shift toward systems that act without waiting to be asked, while also emphasizing that deploying such proactive agents would demand rigorous testing and monitoring. "The thing I think is going to become bigger in the future is more proactive and event-driven AI," Vanee said. Rather than waiting for a human prompt, AI would step in as soon as it detects conditions that warrant action. "This is going to enable more monitoring and larger-scale monitoring, and it'll empower us as we fight fraud and address these opportunities," Vanee said. "So proactive AI is going to be a really important trend." Driving continuous AI innovation in financial services Capital One’s approach underscores a broader truth for enterprise technology leaders: driving measurable value with AI requires moving beyond off-the-shelf software toward deeply customized, highly governed architectures. By combining fine-tuned open-weight models, a multi-agent orchestration harness, and proprietary data assets, the bank has established a repeatable blueprint for deploying scalable AI in financial services. "All of those ingredients were absolutely critical to differentiating in this space and hitting the quality bars as well as the cost and latency thresholds we set for ourselves,” Vanee said. As the company expands these capabilities across new use cases, its enterprise platform approach helps to ensure that technical breakthroughs translate into safer, faster, and more personalized experiences for its millions of customers. Sponsored articles are content produced by a company that is either paying for the post or has a business relationship with VentureBeat, and they’re always clearly marked. For more information, contact sales@venturebeat.com .