You are here:  Home  >  Education Resources For Use & Management of Data  >  Data Daily | Data News  >  Current Article

StreamSets Delivers Ultralight Open Source Ingestion for Edge Devices

By   /  November 30, 2017  /  No Comments

by Angela Guess

According to a recent press release, “StreamSets Inc., provider of the industry’s first enterprise data operations platform, today debuted StreamSets Data Collector Edge (SDC Edge), enabling the industry’s first end-to-end data ingestion solution for resource- and connectivity-constrained systems such as Internet of Things (IoT) devices and the network infrastructure and personal devices that inform cybersecurity applications. Available today as open source software, SDC Edge packs the core functionality of the widely adopted StreamSets Data Collector into a footprint of less than 5MB, an order of magnitude smaller than alternatives. This makes it ideal for IoT use cases, where today ingestion logic is often hand-coded and tightly coupled to the specific device. As a result, dataflows are difficult to maintain as devices are upgraded, are poorly instrumented for operational dataflow management, and often require a gateway that adds cost, complexity and latency.”

The release goes on, “The benefits of a small footprint also apply to cybersecurity initiatives, where its low CPU consumption and limited attack surface allow deployment of SDC Edge across large populations of mobile endpoints and networking systems. Key characteristics of SDC Edge include: Ultralight — Requires less than 5MB and does not need additional software (e.g. Java) to operate. Platform-independent — Based on Go, SDC Edge runs on a broad range of operating systems, including Linux, OS X, Windows and Android. Drag-and-drop dataflow design — Identical to StreamSets Data Collector, pipelines are built using origin, destination and transformation objects, with the option to plug in scripts and trigger custom code execution.”

Read more at Marketwired.

Photo credit: StreamSets

You might also like...

Thinking Inside the Box: How to Audit an AI

Read More →