Data Engineering Hub
GitHub Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode

Benthos

![[Assets/benthos.png|100]]

Benthos is a free and open source data streaming engine written entirely in Go and packaged as a static single-binary command line tool. It comes with a wide range of connectors and is totally data agnostic.

Data transformations can be expressed using a high-level DSL called Bloblang, or blobl for short, which is a language designed for mapping data of a wide variety of forms.

It also exposes a Go API which allows users to import Benthos as a library and extend it through custom plugins.

Benthos Studio is an application that provides visual editing and testing capabilities for Benthos pipelines.

The Community page contains links to various places where you can reach out and ask for help with Benthos.

Benthos Advantages

  • Can be used for both realtime and batch processing use cases
  • Provides a unified framework for building data streaming pipelines
  • Simple and easy to deploy
  • Well-maintained and organized codebase written in pure Go
  • Stateless
  • Reading to / Writing from [[Apache Kafka|Kafka]] and similar event streaming platforms
  • Windowed Processing