Field Remover

The Field Remover removes fields from records. Use the Field Remover to discard field data that you do not need in the pipeline.

You configure the Field Remover to complete one of the following actions:
  • Keep listed fields - You list the fields that you want to keep, and the Field Remover removes the remaining fields.
  • Remove listed fields - You list the fields that you want to remove, and the Field Remover removes all of the listed fields.
  • Remove listed fields if their values are null - You list the fields that you want to remove, and the Field Remover removes the listed fields when they contain null values.

Configuring a Field Remover

Configure a Field Remover to remove unwanted fields from the pipeline.
  1. In the Properties panel, on the General tab, configure the following properties:
    General Property Description
    Name Stage name.
    Description Optional description.
    Required Fields Fields that must include data for the record to be passed into the stage.
    Tip: You might include fields that the stage uses.

    Records that do not include all required fields are processed based on the error handling configured for the pipeline.

    Preconditions Conditions that must evaluate to TRUE to allow a record to enter the stage for processing. Click Add to create additional preconditions.

    Records that do not meet all preconditions are processed based on the error handling configured for the stage.

  2. On the Remove tab, configure the following properties:
    Field Remover Property Description
    Action Action to complete:
    • Keep listed fields
    • Remove listed fields
    • Remove listed fields if their values are null
    Fields List of fields to keep or remove.

    You can use the asterisk wildcard to represent array indices and map elements.