Your browser is out of date

Update your browser to view this website correctly. Update my browser now

×

Cloudera uses cookies to provide and improve our site services.

By using this site, you consent to use of cookies as outlined in Cloudera's Privacy and Data Policies.

  • Cloudera Cloudera
    • Why Cloudera
      Enterprise Data Cloud

      Enterprise-class security and governance. Multi-function data analytics. An elastic cloud experience. No silos. No lock-in. Ever.

      • Industrialize AI
      About
      • Careers
      • Customers
      • Events
      • Leadership
      • Locations
      • Newsroom
      • Partners
      • Investor Relations
    • Products
      Cloudera Data Platform
      • Data Engineering
      • Data Hub
      • Data Warehouse
      • Machine Learning
      • Operational Database
      • CDP Private Cloud

      Products
      • DataFlow
      • Data Science Workbench
      • Enterprise Data Hub
      • Fast Forward Labs Research
      • Hortonworks Data Platform
    • Solutions
      BY INDUSTRY
      • Financial Services
      • Manufacturing
      • Insurance
      • Telecommunications
      • Retail
      • Technology
      • Public Sector
      • Healthcare
      • Energy & Utilities
      • Education
      By Use Case
      • Customer Analytics
      • IoT/Connected Products
      • Security, Risk, & Compliance

       

    • Services & Support
      Services
      • Professional Services
      • Machine Learning Services

       

       

       

       

      Support
      • Training
      • Upgrades & Migrations
      • Documentation
      • MyCloudera Support Portal
      • Community
    Call us at(888) 789-1488
    International:+1 (650) 362-0488
    Email Sales
    Support Portal
      • Log In
      • Register
      • Cloudera| Customer

      • My Profile
      • My Applications
      • Log Out
      • English
      • Spanish
      • French
      • German
      • Italian
      • Polish
      • Portuguese
      • Russian
      • Korean
      • Chinese
      • Japanese
    • Log In
    • Register
    • Misa Amane

      Cloudera | Customer

    • My Profile
    • My Applications
    • Log Out
    • English
    • Spanish
    • French
    • German
    • Italian
    • Polish
    • Portuguese
    • Korean
    • Chinese
    • Japanese
    • Why Cloudera
      • Why Cloudera Overview
      Enterprise Data Cloud

      Enterprise-class security and governance. Multi-function data analytics. An elastic cloud experience. No silos. No lock-in. Ever.

      • Industrialize AI
      About
      • Careers
      • Customers
      • Events
      • Leadership
      • Locations
      • Newsroom
      • Partners
      • Investor Relations
    • Products
      • Products Overview
      Cloudera Data Platform
      • Data Engineering
      • Data Hub
      • Data Warehouse
      • Machine Learning
      • Operational Database
      • CDP Private Cloud

      Products
      • DataFlow
      • Data Science Workbench
      • Enterprise Data Hub
      • Fast Forward Labs Research
      • Hortonworks Data Platform
    • Solutions
      • Solutions Overview
      BY INDUSTRY
      • Financial Services
      • Manufacturing
      • Insurance
      • Telecommunications
      • Retail
      • Technology
      • Public Sector
      • Healthcare
      • Energy & Utilities
      • Education
      By Use Case
      • Customer Analytics
      • IoT/Connected Products
      • Security, Risk, & Compliance

       

    • Services & Support
      • Services & Support Overview
      Services
      • Professional Services
      • Machine Learning Services

       

       

       

       

      Support
      • Training
      • Upgrades & Migrations
      • Documentation
      • MyCloudera Support Portal
      • Community

    Edge & Flow Management


    Ingestion and management of real-time streaming data from edge to cloud.

    • Overview
    • Use cases
    • Features
    • Getting started
    • Resources
    Overview

    What is Edge and Flow Management?

    Cloudera DataFlow (CDF) is a real-time streaming data platform for managing your data from edge to cloud. One of the key tenets of CDF is Edge and Flow Management.

    The Flow Management capabilities of CDF, powered by Apache NiFi, deliver high-scale data ingestion, transformation, and management to enterprises from any-to-any environments. These address key enterprise and hybrid cloud use cases like data movement; log data ingestion; and acquisition of all types of streaming data including social, mobile, clickstream, and IoT data.

    The Edge Management capabilities of CDF are made up of edge agents (MiNiFi) and an edge management hub called Edge Flow Manager. It manages, controls, and monitors edge agents to collect data from edge devices and push intelligence back to the edge. This addresses IoT use cases such as predictive maintenance, fleet management, and asset tracking.

    play icon
    Edge Management Video

    Use cases

    • Predictive maintenance
    • Patient monitoring
    • Data movement

    Predictive maintenance


    Lower costs and reduce downtime with predictive maintenance. 

    Predictive Maintenance is a data-driven approach to analyze IoT and sensor data from connected equipment to effectively predict when and how an asset might fail, detect variances, understand warning signals, and quickly identify patterns that might indicate a potential breakdown. Cloudera DataFlow’s Edge and Flow Management capabilities modernize and simplify data ingestion from hundreds of connected assets to enhance predictive maintenance.

    play icon
    Smart Factory video

    Navistar: Delivering IoT-enabled predictive maintenance to help fleet and truck owners minimize downtime

    Reducing maintenance costs more than 30 percent for connected vehicles.

    Read the success story

    Patient monitoring


    Capture real-time feeds from patient-monitoring devices to detect anomalies.

    Biometric and telemetric devices are used in healthcare organizations to monitor post-surgery or high-risk patients. Ingesting sensor data from these devices about various patient vitals helps detect abnormalities or concerning patterns. Cloudera DataFlow’s Edge and Flow Management helps capture patient-monitoring data and delivers them to stream-processing engines for insights.

    play icon
    Cloudera in healthcare & life sciences video

    Clearsense: Improving healthcare—and saving lives—with SMART data

    Making mission-critical decisions 20 times faster.

    Read the success story

    Data movement


    Connect, integrate, and move massive volumes of data across hybrid and multi-cloud environments.

    Traditional ETL processes are for use cases where data must move from one database to another. Modern enterprises transfer data from on-premises to cloud or cloud-to-cloud, moving petabytes of information in a matter of just hours. Cloudera DataFlow’s Flow Management capabilities are purpose-built for such use cases.

    play icon
    Cloudera DataFlow Logging Modernization demo

    Rabobank: Facilitating financial independence through real-time data insights

    8.3 million customers worldwide.

    Read the success story

    Key features

    • Intuitive no-code drag-and-drop UI
    • Data provenance and full lineage
    • Extensible architecture for any requirement
    • Vertical and horizontal scaling
    • Enterprise-grade security & DevOps models
    • Edge management and data collection

    Hundreds of prebuilt processors are available to connect with a range of data sources, devices, and protocols. The user interface allows you to build sophisticated data flow pipelines with drag-and-drop ease.

    Understand the origin and attribution of data as it moves throughout the enterprise, empowering the governance team to explain how any data point is affected by any system. Data lineage information is generated for everything it does at a fine-grained level, even when records change before and after an event. 

    Ingest, capture, and deliver data in real time from any streaming source, including clickstreams, social media, mobile, or IoT devices. Enable actionable insights by easily connecting, transforming, and managing it using complex data flow applications built with NiFI’s 300+ processors. 

    Handle any throughput by moving petabytes of data from one data center to another in just a few hours or move data from your on-premises environment to the cloud or vice versa. Enable a multi-cloud model with a cloud-vendor-agnostic approach to managing data. 


    Adopt a DevOps-style data flow development lifecycle with NiFi Registry to deliver your flow applications faster and deploy them easily from one environment to another. Enable your development team to version their data flows and set up promotion schemes across environments.

    Enable edge management at scale with command, control, and monitoring of hundreds of thousands of agents with minimal footprint to collect, filter, and process data. Allow end-to-end machine learning algorithms at the edge with automated learning loops.

    Getting started

    Product documentation

    Read about technical specifications, architecture, tutorials, and how-to articles about Apache NiFi.

    Learn more

    CDP Data Hub pricing


    Evaluate CDP Public Cloud pricing for Data Hub across various instance types and cloud providers.

    Get the details

    Logging Modernization

    Learn more about one of the common use cases of flow management— Logging Modernization.

    Read now

    NiFi on the cloud

    Extend your flow management capabilities to the cloud with CDP Data Hub. 

    Watch a quick intro video

    Cloudera Community on NiFi

    Connect with your peers, ask questions, troubleshoot, and learn more about Apache NiFi.

    Explore now

    Training

    Book a three day hands-on training course on Apache NiFi fundamentals and more.

    Go learn

    Analyst Report

    451 Research: Cloudera updates DataFlow for IoT data processing at the edge

    Ebook

    Apache NiFi for Dummies

    Webinar

    Edge management: Gaining value from IoT

    Solution Brief

    Data-in-motion philosophy: A blueprint for enterprise-wide streaming data architecture

    World-class training, support, & services

    Cloudera Support
    Professional Services
    Training
    Community

       

    • Partners
    • Resources
    • Community
    • Documentation
    • Careers

    Contact Us

    US: +1 888 789 1488
    Outside the US: +1 650 362 0488

    Company

    • About us
    • Leadership
    • Newsroom
    • Investor Relations
    • Events
    • Careers
    • Locations

    Get started

    • Downloads
    • Training 
    • Certification
    • Find a partner 
    • Find a solution
    • Contact us

    Resources

    • Blog
    • CDP resources
    • CDP Trust Center
    • Community
    • Documentation
    • Resources library
    • Tutorials

    © 2021 Cloudera, Inc. All rights reserved. Terms & Conditions | Privacy Policy and Data Policy | Unsubscribe / Do Not Sell My Personal Information
    Apache Hadoop and associated open source project names are trademarks of the Apache Software Foundation. For a complete list of trademarks, click here.

    Your form submission has failed.

    This may have been caused by one of the following:

    • Your request timed out
    • A plugin/browser extension blocked the submission. If you have an ad blocking plugin please disable it and close this message to reload the page.