AWS

AWS Bedrock 'Terra' Model Reaches GA; Step Functions Exposed to LLM Agents

Bedrock adds a new Terra model in GA and AWS Step Functions are now callable by LLM agents, reuse workflows across 200+ services, but widen IAM and ops risk.

November 6, 2026·3 min read·AI researched · AI written · AI reviewed

AWS dropped a lot this week, but the single change that will actually force platform teams to rethink guardrails is Step Functions becoming an agent-callable tool. Letting LLM agents StartExecution against your existing state machines is a brilliant operational shortcut — it preserves established orchestrations across 200+ services — and simultaneously hands you a fresh, remote RPC surface that most IAM and observability setups didn't anticipate.

Step Functions just became an agent API

Agents can now call Step Functions like any other tool: they can invoke StartExecution against existing state machines instead of reauthoring workflows or rebuilding orchestration glue. From a product standpoint, this is the right call. Teams have spent years encoding business logic into state machines; forcing every agent integration to reimplement that logic would have produced brittle, un-audited orchestration spaghetti. Instead, AWS gives agents the ability to reuse proven workflows.

Reality check: reuse is powerful, but it widens the trust boundary. An LLM that previously only queried a read-only API can now trigger executions that spin up resources, send emails, or mutate data. That means teams must treat state machines as public-facing APIs (within the org) — add per-agent RBAC, step-level audit trails, execution time limits, and quota enforcement. If your governance treats Step Functions as "internal only," this changes the threat model overnight.

For a deeper look at the mechanics, see our companion piece on Step Functions agent tools AWS Step Functions Agent Tools — Let LLM Agents StartExecution of Existing State Machines.

Bedrock: 'Terra' model hits GA

Amazon Bedrock has added a new "Terra" model family to GA on Bedrock endpoints. The practical implication: you can run Terra through Bedrock's managed endpoints and integrate it with Bedrock features like streaming and model routing. For platform teams that standardize on Bedrock for governance, this reduces the operational friction of supporting multiple LLM providers. It's less about provider lock-in and more about offering a single control plane for provisioning, observability, and billing.

EKS Auto Mode adds Gateway API

EKS Auto Mode now understands Gateway and HTTPRoute from the Kubernetes Gateway API and can provision AWS-managed load-balancing infrastructure behind the scenes. That matters: teams can declare Gateway/HTTPRoute for complex routing and let EKS Auto Mode handle the load-balancer lifecycle instead of maintaining separate ALB/NGINX stacks. This reduces YAML-to-LB drift and makes the Gateway API genuinely useful in production EKS clusters.

Lambda Managed Instances: seekable OCI lazy loading

Lambda Managed Instances gained seekable OCI lazy loading for container images — AWS says this can substantially reduce container startup time in many cases. This follows the SOCI-style pattern of fetching only the image segments you need at runtime. The practical effect is faster cold starts and the potential to build larger, more modular images without penalizing startup. Teams who optimize image layout and OCI indexing will see immediate wins.

Other launches that matter

  • AWS KMS added support for a post-quantum key-encapsulation mechanism option, with keys protected by FIPS 140-3 HSMs — notable for teams that need post-quantum choices without rearchitecting key storage.
  • IAM Identity Center now offers improved cross-Region identity propagation for multi-Region service access — easing identity flows for distributed services.
  • Amazon ECS added NVIDIA MPS GPU sharing so concurrent tasks can share a single NVIDIA GPU — a practical efficiency boost for inference density.
  • Amazon S3 announced managed migration tooling to move table formats like Hive to Iceberg without requiring customer-managed pipelines — useful if you trust AWS migration logic to handle schema and partition changes.

My take: AWS is wiring the cloud for agents and lazy resource acquisition. Both are overdue and mostly the right moves — but both increase operational complexity in specific ways. Step Functions-as-tool solves a governance problem (don’t copy your state machines) and hands you another attack surface. Seekable OCI for Lambda solves startup latency and makes large images viable again. Your team’s next sprint should not be a new feature; it should be tightening execution policies, improving per-execution telemetry, and rethinking image layout.

If you treat state machines as "internal primitives" rather than APIs with clients, you will be surprised. If you treat your container images as monoliths, you will miss the gains from lazy-loading. Both changes reward platform teams who invest in governance and image hygiene today.

Sources

amazon-bedrockaws-step-functionseks-gateway-apilambda-lazy-loading
← All articles
AWS

Amazon Bedrock 'Terra', Step Functions as Agent Tools, and AgentCore Decision-Model Evaluations

Bedrock adds a new model 'Terra' and AgentCore decision-model evaluations; Step Functions can be exposed to LLM agents—platform teams must secure and test.

Nov 5, 2026·3mamazon-bedrockbedrock-terra
AWS

AWS Step Functions Agent Tools — Let LLM Agents StartExecution of Existing State Machines

Expose AWS Step Functions as agent tools so LLM agents can StartExecution of state machines—enabling governed automations while adding a new trust boundary.

Nov 4, 2026·3maws-step-functionsamazon-bedrock
AWS

SageMaker SOCI-indexed images (-soci) and MoE multimodal deployment patterns

SOCI-indexed SageMaker images lazily pull layers to cut container cold-starts; AWS also published EKS and HyperPod patterns for MoE multimodal deployments.

Nov 2, 2026·3msagemakersoci