Data Collector User Guide

Home
StreamSets Data Collector Edge

Getting Started
What's New
Installation
Configuration
Upgrade
Pipeline Concepts and Design
Pipeline Configuration
Data Formats
Origins
Processors
Destinations
Executors
StreamSets Data Collector Edge
- Meet StreamSets Data Collector Edge
  StreamSets Data Collector Edge^TM (SDC Edge) is a lightweight execution agent without a UI that runs pipelines on edge devices with limited resources. Use SDC Edge to read data from an edge device or to receive data from another pipeline and then act on that data to control an edge device.
- Supported Platforms
- Install SDC Edge
  Download and install SDC Edge on each edge device where you want to run edge pipelines.
- Getting Started with SDC Edge
  Data Collector Edge (SDC Edge) includes several sample pipelines that make it easy to get started. You simply import one of the sample edge pipelines, create the appropriate Data Collector receiving pipeline, download and install SDC Edge on the edge device, and then run the sample edge pipeline.
- Design Edge Pipelines
  Edge pipelines run in edge execution mode. You design edge pipelines in Data Collector.
- Design Data Collector Receiving Pipelines
- Administer SDC Edge
  Administering SDC Edge involves configuring, starting, shutting down, and viewing logs for the agent. When using StreamSets Control Hub, you can also use the SDC Edge command line interface to register SDC Edge with Control Hub.
- Deploy Pipelines to SDC Edge
  After designing edge pipelines in Data Collector, you deploy the edge pipelines to SDC Edge installed on an edge device. You run the edge pipelines on SDC Edge.
- Downloading Pipelines from SDC Edge
- Manage Pipelines on SDC Edge
  After designing edge pipelines in Data Collector and then deploying the edge pipelines to SDC Edge, you can manage the pipelines on SDC Edge. Managing edge pipelines includes previewing, validating, starting, stopping, and monitoring the pipelines as well as resetting the origin for the pipelines.
StreamSets Control Hub
Dataflow Triggers
Drift Synchronization Solution for Hive
Drift Synchronization Solution for PostgreSQL
Multithreaded Pipelines
Microservice Pipelines
SDC RPC Pipelines
Cluster Pipelines
Data Preview
Rules and Alerts
Pipeline Monitoring
Pipeline Maintenance
Administration
Tutorial
Troubleshooting
Glossary
Data Formats by Stage
Expression Language
Regular Expressions
Grok Patterns

StreamSets Data Collector Edge

Meet StreamSets Data Collector Edge
StreamSets Data Collector Edge^TM (SDC Edge) is a lightweight execution agent without a UI that runs pipelines on edge devices with limited resources. Use SDC Edge to read data from an edge device or to receive data from another pipeline and then act on that data to control an edge device.
Supported Platforms
Install SDC Edge
Download and install SDC Edge on each edge device where you want to run edge pipelines.
Getting Started with SDC Edge
Data Collector Edge (SDC Edge) includes several sample pipelines that make it easy to get started. You simply import one of the sample edge pipelines, create the appropriate Data Collector receiving pipeline, download and install SDC Edge on the edge device, and then run the sample edge pipeline.
Design Edge Pipelines
Edge pipelines run in edge execution mode. You design edge pipelines in Data Collector.
Design Data Collector Receiving Pipelines
Administer SDC Edge
Administering SDC Edge involves configuring, starting, shutting down, and viewing logs for the agent. When using StreamSets Control Hub, you can also use the SDC Edge command line interface to register SDC Edge with Control Hub.
Deploy Pipelines to SDC Edge
After designing edge pipelines in Data Collector, you deploy the edge pipelines to SDC Edge installed on an edge device. You run the edge pipelines on SDC Edge.
Downloading Pipelines from SDC Edge
Manage Pipelines on SDC Edge
After designing edge pipelines in Data Collector and then deploying the edge pipelines to SDC Edge, you can manage the pipelines on SDC Edge. Managing edge pipelines includes previewing, validating, starting, stopping, and monitoring the pipelines as well as resetting the origin for the pipelines.

© Apache License, Version 2.0.