Hive Discovery Metastore Connection Parameters

Lists Hive discovery metastore connection parameters, parameter descriptions, default values, and supported data types.

Use the Hive discovery metastore to query CSV and Parquet files. Hive discovery metastore automatically scans CSV files and Parquet footers in the specified directory to discover table schema. Hive discovery metastore does not require a Hive metastore service. For additional information, see Connecting to CSV and Parquet Data in an External S3 Data Source via Hive Connector.

The following sections list the required and optional Hive discovery metastore connection parameters.

Required Connection Parameters

The following table lists the required connection parameters:
Parameter Description Default Value Data Type
Data Dir Location of the directory where files are stored. STRING

Optional Connection Parameters

The following table lists the optional connection parameters:
Parameter Description Default Value Data Type
File Type Type of files stored CSV or Parquet. STRING
Csv Header Specifies that the file contains a header line with the names of each column in the file. false BOOLEAN
Csv Separator Specifies the string that separates columns within each row (line) of the file. , STRING
Csv Date Format Specifies the format for date fields yyyy-MM-dd STRING
Csv Timestamp Format Specifies the format for timestamp fields yyyy-MM-dd HH:mm:ss STRING
Csv Row Count Specifies the number of rows used for schema discovery. 1000 INTEGER
Csv Escape Specifies the escape character used in the csv file. \ STRING