Control Hub On-Premises User Guide

Home
Pipeline Design (Data Collector/Edge)
Origins

Getting Started
What's New
Installation
Upgrade
System Administration
Tutorials
Pipeline Repository
Pipeline Design (Data Collector/Edge)
- Pipeline Concepts and Design
- Pipeline Configuration
- Data Formats
- Origins
  - Origins
    An origin stage represents the source for the pipeline. You can use a single origin stage in a pipeline.
  - Amazon S3
  - Amazon SQS Consumer
  - Azure Data Lake Storage Gen1
  - Azure Data Lake Storage Gen2
  - Azure IoT/Event Hub Consumer
  - CoAP Server
  - Cron Scheduler
  - Directory
  - Elasticsearch
  - File Tail
  - Google BigQuery
  - Google Cloud Storage
  - Google Pub/Sub Subscriber
  - Groovy Scripting
  - gRPC Client
  - Hadoop FS
  - Hadoop FS Standalone
  - HTTP Client
  - HTTP Server
  - HTTP to Kafka (Deprecated)
  - JavaScript Scripting
  - JDBC Multitable Consumer
  - JDBC Query Consumer
  - JMS Consumer
  - Jython Scripting
  - Kafka Consumer
  - Kafka Multitopic Consumer
  - Kinesis Consumer
  - MapR DB CDC
  - MapR DB JSON
  - MapR FS
  - MapR FS Standalone
  - MapR Multitopic Streams Consumer
  - MapR Streams Consumer
  - MongoDB
  - MongoDB Oplog
  - MQTT Subscriber
  - MySQL Binary Log
  - NiFi HTTP Server
  - Omniture
  - OPC UA Client
  - Oracle Bulkload
  - Oracle CDC Client
  - PostgreSQL CDC Client
  - Pulsar Consumer
  - RabbitMQ Consumer
  - Redis Consumer
  - REST Service
  - Salesforce
  - SAP HANA Query Consumer
  - SDC RPC
  - SDC RPC to Kafka (Deprecated)
  - SFTP/FTP/FTPS Client
  - SQL Server 2019 BDC Multitable Consumer
  - SQL Server CDC Client
  - SQL Server Change Tracking
  - Start Jobs
  - Start Pipelines
  - System Metrics
  - TCP Server
  - Teradata Consumer
  - UDP Multithreaded Source
  - UDP Source
  - UDP to Kafka (Deprecated)
  - WebSocket Client
  - WebSocket Server
  - Windows Event Log
- Processors
- Destinations
- Executors
- Dataflow Triggers
- Solutions
- Edge Pipelines
- Multithreaded Pipelines
- Microservice Pipelines
- Orchestration Pipelines
- SDC RPC Pipelines
- Cluster Pipelines
- Data Preview
- Rules and Alerts
- Troubleshooting
- Data Formats by Stage
- Expression Language
- Regular Expressions
- Grok Patterns
Pipeline Design (Transformer)
Connections
Jobs
Scheduler
Topologies
Reports
Subscriptions
Data Collectors
Transformers
Edge Data Collectors
Provisioned Data Collectors
Labels
Export and Import
Organization Security
Glossary

Origins

© 2021 StreamSets, Inc.