Parquet is a column-oriented file format primarily used for exchanging data with data lakes and analytics tools. This section describes the settings for the Document type Parquet in Phase 2.
NOTE:
Parquet is a binary format. To ensure that the data remains unchanged when reading a Parquet source, the encoding must be set to
ISO-8859-1– as is the case with other binary formats (e.g., PDF, Excel).
Settings
Setting | Description |
|---|---|
Check input format | If this checkbox is selected, the source structure fields are checked against the format templates stored there during parsing. If a value violates the field's format template or exceeds the field length, an error is generated. In the event of an error, the process does not stop immediately in Phase 2, but only at the end of Phase 2 or after 50 errors. CAUTION: Using the format check affects performance and should only be used when absolutely necessary. |
Check min/max settings | Specifies whether to check the number of repetitions (of fields and nodes) in the source structure. |
Remove blanks (XML will be normalized)) | Leading and trailing spaces in string values are removed. |
Execute Semantic check | Not available for Parquet. |