ploosh.

Documentation

This connector is used to read Parquet files from local file system.

Connection configuration

No connection is required by this connector

Test case configuration

Test case configuration

NameMandatoryDefaultDescription
pathyesPath to the Parquet file
columnsnoNoneSubset of columns to load
engineno"auto"Parquet engine to use ('auto', 'pyarrow', 'fastparquet')
filtersnoNoneRow group filters to apply (for 'pyarrow')

Example

Example PARQUET:
  source:
    type: parquet
    path: ../data/parquet/source/example.parquet
    columns:  ["id", "name"]
    filters:
        - column: "id"
          operator: "!="
          value: 2
  expected:
    type: csv
    infer: True
    delimiter: ";"
    encoding: "utf-8"
    engine: "python"
    path: data/example.csv