Hive Discovery Metastore Connection Parameters
Lists Hive discovery metastore connection parameters, parameter descriptions, default values, and supported data types.
Use the Hive discovery metastore to query CSV and Parquet files. Hive discovery metastore automatically scans CSV files and Parquet footers in the specified directory to discover table schema. Hive discovery metastore does not require a Hive metastore service. For additional information, see Connecting to CSV and Parquet Data in an External S3 Data Source via Hive Connector.
The following sections list the required and optional Hive discovery metastore connection parameters.
Required Connection Parameters
The following table lists the required connection parameters:
Parameter | Description | Default Value | Data Type |
---|---|---|---|
Data Dir | Location of the directory where files are stored. | STRING |
Optional Connection Parameters
The following table lists the optional connection parameters:
Parameter | Description | Default Value | Data Type |
---|---|---|---|
File Type | Type of files stored CSV or Parquet. | STRING | |
Csv Header | Specifies that the file contains a header line with the names of each column in the file. | false | BOOLEAN |
Csv Separator | Specifies the string that separates columns within each row (line) of the file. | , | STRING |
Csv Date Format | Specifies the format for date fields | yyyy-MM-dd | STRING |
Csv Timestamp Format | Specifies the format for timestamp fields | yyyy-MM-dd HH:mm:ss | STRING |
Csv Row Count | Specifies the number of rows used for schema discovery. | 1000 | INTEGER |
Csv Escape | Specifies the escape character used in the csv file. | \ | STRING |