New solution prevents loss and corruption in big data environments

The pressure to move towards using big data can often lead to management practices lagging behind. While storage is managed often data flows aren't, which leads to breakdowns and corruption of the data.

The bigger and more complex the data, the greater the problem becomes. To address this, San Francisco-based StreamSets is launching its Dataflow Performance Manager (DPM), a solution that makes it possible to manage the operations of a company's end-to-end dataflows within a single pane.

StreamSets DPM unifies visibility and control of dataflows, which reduces management costs, improves data quality and enables IT agility. Customers can map dataflows to topologies and business processes, manage releases and track changes in topologies over time. The solution also lets them measure and establish baselines for end-to-end and point-in-flow performance indicators for data availability and accuracy, as well as mastering dataflow operations by creating data service level agreements and detecting and fixing violations.

"StreamSets Dataflow Performance Manager uniquely addresses the pain enterprises experience when they try to manage a multitude of dataflows manually or with legacy technologies in the face of data drift and dynamic use cases," says Girish Pancha, CEO of StreamSets. "Data is a key asset that requires the same performance management practices that have been adopted for networks and applications. DPM brings operational intelligence to dataflow management so enterprises can be sure that the data driving their key applications is always timely and trustworthy".

StreamSets DPM will be generally available later this month, initially as a cloud-based service. You can find out more on the company's website and there's special pricing available for early adopters.

Image Credit: Tashatuvango / Shutterstock