package file
- Alphabetic
- Public
- All
Type Members
-
case class
FileInput(name: String, path: Option[String], paths: Option[Seq[String]], warehousePath: Option[String], catalogName: Option[String], schemaName: Option[String], tableName: Option[String], metastoreUris: Option[String], options: Option[Map[String, String]], format: Option[String], isMetric: Option[Boolean], icebergCatalogType: Option[String], incremental: Option[Incremental], schema: Option[Schema]) extends IncrementalReader with DatasourceReader with FileInputBase with Product with Serializable
Case class representing a file input configuration.
Case class representing a file input configuration.
- name
The name of the file input.
- path
Optional single file path.
- paths
Optional list of file paths.
- warehousePath
Optional warehouse path.
- catalogName
Optional catalog name.
- schemaName
Optional schema name.
- tableName
Optional table name.
- metastoreUris
Optional metastore URIs.
- options
Optional additional options for reading files.
- format
Optional file format.
- isMetric
Optional flag indicating if the input is for metrics.
- icebergCatalogType
Optional catalog type for Iceberg tables.
- incremental
Optional incremental configuration.
- schema
Optional schema info.
- trait FileInputBase extends AnyRef
-
case class
FileStreamInput(name: String, path: String, warehousePath: Option[String], catalogName: Option[String], schemaName: Option[String], tableName: Option[String], metastoreUris: Option[String], options: Option[Map[String, String]], format: Option[String], icebergCatalogType: Option[String], isMetric: Option[Boolean], schema: Option[Schema]) extends IncrementalReader with DatasourceReader with FileInputBase with Product with Serializable
Represents a file stream-based input configuration.
Represents a file stream-based input configuration.
- name
The name of the file stream input.
- path
The path of the file stream input.
- warehousePath
An optional warehouse path for the input.
- catalogName
An optional catalog name for the input.
- schemaName
An optional schema name for the input.
- tableName
An optional table name for the input.
- metastoreUris
An optional string representing metastore URIs for the input.
- options
An optional map of options for the input.
- format
An optional string representing the format of the input.
- icebergCatalogType
An optional string representing the catalog type for Iceberg format.
- isMetric
An optional flag indicating if the input is for metrics.
- schema
An optional Schema for the input.
-
case class
FilesInput(name: String, paths: Seq[String], warehousePath: Option[String], catalogName: Option[String], schemaName: Option[String], tableName: Option[String], metastoreUris: Option[String], options: Option[Map[String, String]], format: Option[String], isMetric: Option[Boolean], icebergCatalogType: Option[String], incremental: Option[Incremental], schema: Option[Schema]) extends FileInputBase with Product with Serializable
Represents a file-based input configuration.
Represents a file-based input configuration.
- name
The name of the file input.
- paths
The sequence of file paths for the input.
- warehousePath
An optional warehouse path for the input.
- catalogName
An optional catalog name for the input.
- schemaName
An optional schema name for the input.
- tableName
An optional table name for the input.
- metastoreUris
An optional string representing metastore URIs for the input.
- options
An optional map of options for the input.
- format
An optional string representing the format of the input.
- isMetric
An optional flag indicating if the input is for metrics.
- icebergCatalogType
An optional string representing the catalog type for Iceberg format.
- incremental
An optional Incremental configuration for the input.
- schema
An optional Schema for the input.