This article introduces an infrastructure system for flexibly managing isolated, stateful execution environments for training and evaluating large agentic LLMs.
- •Isolated environments are required for models to browse repositories and execute commands via tool calls.
- •These workloads temporarily create many sandboxes with varying features and isolation requirements, maintaining state over long interactions.
- •Flexible execution environment support is essential for retrieving data from large image corpora with limited reusability.