StreamSets Classification Rules

Data Protector includes a wide range of general and country-specific classification rules.

You can find the list of categories that StreamSets automatically detects in the list below. The name in capital letters is the classification category. You use the classification category when creating policies that protect the data identified by the classification.

For example, to protect data automatically classified as email, you use the EMAIL classification category in a protection policy procedure.

StreamSets classification rules use a combination of field path and field value classifiers. When using a StreamSets classification rule to protect data, verify that the rule properly identifies the data in your environment.

To classify sensitive data not classified by the StreamSets classification rules, create custom classification rules.

For example, you might find that the GENDER classification rule properly identifies gender data in a gender field, but misses gender data in a m_f field. To identify that data, you create a classification rule with a field path classifier for the m_f field.

StreamSets Scoring Guidelines

Each StreamSets classification rule is unique, so classification score generation will also vary. Like custom classification scores, the values range from 0 to 1.0.

Generally, StreamSets classification rules include classifiers that identify data based on both field paths and field values. As a result, the scoring takes both types of matching into account.

The following table provides general guidelines on what StreamSets classification scores typically mean:
Classification Score Description
1 Not used by StreamSets classification rules.
.95 Used for classifications with strong matches for both field name and data.
.85 Used for classifications with a strong field name match, but only a moderate to weak data match.
.75 Used for classifications with a strong data match, but only a moderate to weak field name match.
.65 Used for classifications with a moderate to weak data match and a weak field name match.
.5 or below Used for weak field name matches and/or weak data matches.

Classification List

The following is the full list of StreamSets classification rules included with Data Protector:

General
  • COUNTRY - Country
  • CREDIT_CARD - Credit card number
  • CREDIT_CARD_CVV - Credit card CVV number
  • CURRENCY - Currency
  • EMAIL - Email
  • ESN - Mobile device Electronic Serial Number
  • IBAN - International Bank Account Number
  • IDENTIFIER - Identifier
  • IMEI - Mobile Device International Mobile Equipment Identity
  • IMPI - IP Multimedia Private Identity
  • IMPU - IP Multimedia Public Identity
  • IMSI - International Mobile Subscriber Identity
  • IP_ADDRESS - IP address
  • IP_ADDRESS_V6 - IP address version 6
  • ISBN - International Standard Book Number (ISBN)
  • LANGUAGE - Language
  • MAC_ADDRESS - MAC Address
  • MSISDN - Mobile Station International Subscriber Directory Number
  • PHONE - International E.164 format of phone number
  • URL - Uniform Resource Locator
  • VIN - Vehicle identification number
Argentina
  • AR_NATIONAL_ID_CARD - National Identity Document (Documento Nacional de Identidad)
Australia
  • AU_BANK - Bank account number
  • AU_DRIVER_LICENSE - Driver's license
  • AU_MC - Medicare card
  • AU_PASSPORT - Passport number
  • AU_PHONE - Phone number
  • AU_POSTAL_CODE - Postal code
  • AU_TFN - Tax file number (TFN)
Austria
  • AT_ASVG - General Social Security Act (ASVG)
  • AT_CCRID - Central Register of Residents ID
  • AT_SSPIN - Sector-Specific Personal Identifier
Belgium
  • BE_NATIONAL_ID_CARD - National identity card (Identiteitskaart)
  • BE_NIN - National Register number (Rijksregisternummer)
  • BE_POSTAL_CODE - Postal code
Brazil
  • BR_CNPJ - National Registry of Legal Entities (Cadastro Nacional da Pessoa Jurídica)
  • BR_CPF - Natural Persons Register (Cadastro de Pessoas Físicas)
  • BR_POSTAL_CODE - Postal code
  • BR_RG - National identity document (Cédula de identidade)
Bulgaria
  • BG_UCN - Uniform civil number (Единен граждански номер)
Canada
  • CA_BANK - Bank account number
  • CA_PASSPORT - Passport number
  • CA_PHIN - Personal Health Identification Number
  • CA_POSTAL_CODE - Postal code
  • CA_SIN - Social Insurance number
Chile
  • CL_CDI - National ID card (Cédula de identidad)
China
  • CN_PRC - Resident Identity card (居民身份证)
Croatia
  • HR_OI - National ID card (Osobna iskaznica)
  • HR_OIB - National ID (Osobni identifikacijski broj)
Czech Republic
  • CZ_OP - National ID card (Občanský průkaz)
  • CZ_PHONE - Phone number
  • CZ_POSTAL_CODE - Postal code
  • CZ_RC - National ID (Rodné číslo)
  • GENDER - Gender
  • MARITAL_STATUS - Marital status
Denmark
  • DK_CPR - National ID (Personnummer)
  • DK_POSTAL_CODE - Postal code
Estonia
  • EE_IK - National ID (Isikukood)
Finland
  • FI_ HETU - National ID (Henkilötunnus)
  • FI_PASSPORT - Passport number
France
  • FR_CNI - National ID card (Carte nationale d’identité)
  • FR_DRIVER_LICENSE - Driver's license
  • FR_INSEE - National ID (Institut national de la statistique et des études économiques)
  • FR_PASSPORT - Passport number
  • FR_POSTAL_CODE - Postal code
Germany
  • DE_ RVNR - Pension insurance number (Rentenversicherungsnummer)
  • DE_DRIVER_LICENSE - Driver's license
  • DE_ID - National ID card (Personalausweis)
  • DE_IDNR - Taxpayer ID (steuerliche Identifikationsnummer)
  • DE_PASSPORT - Passport number
  • DE_PK - National ID (Personenkennziffer)
  • DE_POSTAL_CODE - Postal code
Greece
  • GR_ID_CARD - National ID card (Δελτίο αστυνομικής ταυτότητας)
Greenland
  • GL_POSTAL_CODE - Postal code
Hong Kong
  • HK_HKID - National ID card (香港身份證)
Hungary
  • HU_SZAM - National ID (Személyi szám)
  • HU_TAJ - Taxpayer ID
India
  • IN_AADHAAR - National ID (Aadhaar)
  • IN_PAN - Taxpayer ID
Indonesia
  • ID_KTP - National ID card (Kartu Tanda Penduduk)
Ireland
  • IE_PPS - Personal Public Service Number
Israel
  • IL_BANK - Bank account number
  • IL_MZ - National ID (מספר זהות)
Italy
  • IT_CF - National ID (Codice fiscale)
  • IT_DRIVER_LICENSE - Driver's license
  • IT_POSTAL_CODE - Postal code
Japan
  • JP_BANK - Bank account number
  • JP_DRIVER_LICENSE - Driver's license
  • JP_IC - National ID card (住民基本台帳カード)
  • JP_PASSPORT - Passport number
  • JP_SIN - National ID (個人番号)
Korea
  • KR_RRN - National ID (주민등록번호)
Latvia
  • LV_PK - National ID (Personas kodas)
Lithuania
  • LT_AK - National ID (Asmens kodas)
Malaysia
  • MY_MYKAD - National ID card (kad pengenalan Malaysia)
Netherlands
  • NL_BSN - National ID (Burgerservicenummer)
  • NL_POSTAL_CODE - Postal code
New Zealand
  • NZ_NHI - National Health Index (NHI) number
Norway
  • NO_FN - National ID (Fødselsnummer)
  • NO_POSTAL_CODE - Postal code
Philippines
  • PH_UMID - Unified Multi-Purpose ID
Poland
  • PL_DT - National ID card (Dokument tożsamości)
  • PL_PASSPORT - Passport number
  • PL_PESEL - National ID (Powszechny Elektroniczny System Ewidencji Ludności)
Portugal
  • PT_CC - National ID card (Cartão de cidadão)
Romania
  • RO_CNP - National ID (Cod Numeric Personal)
Saudi Arabia
  • SA_ID - National ID card (بطاقة الهوية الوطنية)
Singapore
  • SG_NRIC - National ID card (Kad Pengenalan Pendaftaran Negara)
Slovakia
  • SK_OP - National ID card (Občiansky preukaz)
  • SK_RC - National ID (Rodné číslo)
South Africa
  • ZA_ID - National ID
Spain
  • ES_DNI - National ID (Documento Nacional de Identidad)
  • ES_POSTAL_CODE - Postal code
Sweden
  • SE_ID - National ID (Personnummer)
  • SE_PASSPORT - Passport number
Switzerland
  • CH_AVS - Social Security number
  • CH_POSTAL_CODE - Postal code
Taiwan
  • TW_ARC - Foreign ID (居留證)
  • TW_ID - National ID (國民身分證)
  • TW_PASSPORT - Passport number
United Kingdom
  • GB_DRIVER_LICENSE - Driver's license
  • GB_EIC - Electoral Identity card
  • GB_NHS - National Health Service number
  • GB_NINO - National Insurance number
  • GB_PHONE - Phone number
  • GB_POSTAL_CODE - Postal code
United States
  • BIRTH_DATE - Birthday
  • COUNTRY - Country
  • CREDIT_CARD - Credit card number
  • GENDER - Gender
  • MARITAL_STATUS - Marital status
  • NAME - Human name
  • SALARY - Salary
  • SWIFT - Bank SWIFT code
  • US_ABA - ABA routing transit number
  • US_BANK - Bank account number
  • US_CREDIT_SCORE - U.S. credit score
  • US_DEA - DEA registration number
  • US_DRIVER_LICENSE - Driver's license
  • US_ETHNICITY - Person's ethnicity
  • US_ITIN - Individual Taxpayer Identification Number
  • US_PASSPORT - Passport number
  • US_PHONE - Phone number
  • US_SSN - Social Security number
  • US_STATE - U.S. state name
  • US_ZIP_CODE - ZIP code