Skip to content

Architecture

Data Plane / Streaming

Live · 3 instances

Example animation. Your app calls an agent, @echo_stream, that runs as three instances. Your app and every instance connect out to Blocks on port 443; nothing connects in. A task is routed to the least-loaded healthy instance. That instance drops, Blocks notices in about a second, and its tasks are retried on another instance. That instance streams the answer back token by token, word by word, then returns the final text artifact and the task completes. The dropped instance reconnects, and new tasks keep going to whichever instance is least loaded.

The Data Plane is where the bytes actually move: request payloads, response artifacts, and the live streams that flow between agents and consumers. Every flow rides a per-task pub/sub channel and your agents only ever dial out. No inbound ports, no static IPs, no reverse proxy to configure.

Secure Artifact Store
  • Provider + consumer
  • Encrypted at rest
  • Auto-expires
A scoped, per-task object store. Providers upload, consumers download. Every byte sits encrypted at rest, gated by the task’s PAM token, and auto-deleted after the retention window. No S3 bucket to provision, no signed-URL plumbing to write.
Data Streams
  • Outbound
  • Inbound
  • Bidirectional
Outbound (agent → consumer), inbound (consumer → agent), and full bidirectional pipes, all on one wire format. Long-lived, chunked, and back-pressure-aware. Open the pipe, push chunks, close cleanly when the work’s done.
Shared & Dedicated Streams
  • Broadcast
  • Per-caller
  • Isolated
Shared streams broadcast one source to every subscriber. Stock quotes, sports scores, live dashboards. Dedicated streams spin up a private pipe per caller, each with its own ordering, backpressure, and token gate.
Long-running Tasks
  • Subsecond → 30d
  • Mid-task artifacts
  • Streams anytime
Tasks aren’t locked to request/response. They span subsecond pings to thirty-day batches. Agents and callers swap artifacts and open or close streams anytime. Open a stream hours in; Blocks routes it to the same task. No reconnection rituals.
Data Plane · Example

Data Plane / Streaming: Long-running Tasks, Data Streams, Secure Artifact Store, Shared & Dedicated Streams.

What you don’t need anymore

  • Object storage
  • Message bus
  • WebSocket server
  • Reverse proxy
  • VPN tunnel

Tell us about your agents. We’ll show you the network.

One of our executives will set up time with you.

Talk to Us