
High-performance stream processor for data pipelines
Benthos (now Redpanda Connect) is a high-performance, open-source stream processor that connects various data sources and sinks. With 300+ pre-built connectors and at-least-once delivery guarantees, it makes building reliable data pipelines operationally simple.
Connect databases, message queues, cloud services, caches, and HTTP endpoints out of the box
Guarantees message delivery even during crashes or server faults without disk persistence
Transform, filter, and enrich data using Bloblang, a purpose-built mapping language
Support for complex routing patterns, content-based routing, and windowed aggregations
Handle failed messages gracefully with automatic dead letter queue routing
Built-in metrics, tracing, and logging for full pipeline visibility
Deploy as a static binary or Docker image with minimal resource requirements
Move and transform data between databases, warehouses, and analytics platforms
Stream data between microservices, APIs, and message queues in real-time
Process and route events with content-based routing and enrichment
Reliably migrate data between systems with guaranteed delivery
Define entire pipelines in YAML configuration files for easy version control

The fastest AI code editor — built in Rust for speed and collaboration