Article illustration 1

For developers wrestling with complex stream processing pipelines, a new open-source toolkit offers liberation from domain-specific languages (DSLs) and vendor lock-in. Tangent, developed by Telophase, reimagines data transformation by treating plugins as first-class citizens—written in real programming languages and executable in secure WebAssembly (WASM) sandboxes.

Why Tangent Breaks the Mold

Traditional stream processing frameworks often force engineers into proprietary DSLs that limit flexibility and create maintenance headaches. Tangent flips this paradigm:

  • Real languages over DSLs: Write transformations in Go or Python—languages developers already know. This enables better code review, testing, and even LLM-assisted development
  • WASM-powered isolation: Each plugin runs in a lightweight WebAssembly sandbox, combining near-native performance with security boundaries
  • Shareable ecosystem: A public plugin library allows teams to reuse common transformations (e.g., converting AWS GuardDuty alerts to OCSF format)
  • Benchmark-first approach: The tangent bench CLI measures throughput/latency before deployment, preventing performance surprises

"Plugins run in a lightweight WASM sandbox with near-native speed and full language flexibility — no DSLs, no vendor-locked runtimes," states the project documentation. This philosophy targets the pain points of Kafka Streams, Flink, and other pipeline tools.

Developer Workflow Revolution

Tangent’s CLI streamlines plugin development:

tangent plugin scaffold my_transform --lang=go  # Generate boilerplate
tangent plugin test                             # Validate logic
tangent plugin compile                          # Build WASM artifact
tangent bench --input=data.json                 # Performance test

The toolkit supports multiple installation methods including Homebrew, Cargo, and Docker, lowering adoption barriers. Sources (SQS, Kafka, files) and sinks (S3, files) integrate with existing infrastructure.

Implications for Data Engineering

  1. Security: WASM sandboxing mitigates risks of malicious or buggy transformations crashing entire pipelines
  2. Portability: Compile once, run anywhere—cloud, edge, or on-premises
  3. Community potential: Shared plugins could accelerate development like Docker Hub did for containers

While still emerging, Tangent’s approach aligns with the industry’s shift toward WebAssembly for secure, portable computation. As real-time data processing becomes ubiquitous, eliminating DSL friction might finally let developers focus on transformation logic rather than framework constraints.

Source: Tangent GitHub Repository