Packages

package file

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. case class FileInput(name: String, path: Option[String], paths: Option[Seq[String]], warehousePath: Option[String], catalogName: Option[String], schemaName: Option[String], tableName: Option[String], metastoreUris: Option[String], options: Option[Map[String, String]], format: Option[String], isMetric: Option[Boolean], icebergCatalogType: Option[String], incremental: Option[Incremental], schema: Option[Schema]) extends IncrementalReader with DatasourceReader with FileInputBase with Product with Serializable

    Case class representing a file input configuration.

    Case class representing a file input configuration.

    name

    The name of the file input.

    path

    Optional single file path.

    paths

    Optional list of file paths.

    warehousePath

    Optional warehouse path.

    catalogName

    Optional catalog name.

    schemaName

    Optional schema name.

    tableName

    Optional table name.

    metastoreUris

    Optional metastore URIs.

    options

    Optional additional options for reading files.

    format

    Optional file format.

    isMetric

    Optional flag indicating if the input is for metrics.

    icebergCatalogType

    Optional catalog type for Iceberg tables.

    incremental

    Optional incremental configuration.

    schema

    Optional schema info.

  2. trait FileInputBase extends AnyRef
  3. case class FileStreamInput(name: String, path: String, warehousePath: Option[String], catalogName: Option[String], schemaName: Option[String], tableName: Option[String], metastoreUris: Option[String], options: Option[Map[String, String]], format: Option[String], icebergCatalogType: Option[String], isMetric: Option[Boolean], schema: Option[Schema]) extends IncrementalReader with DatasourceReader with FileInputBase with Product with Serializable

    Represents a file stream-based input configuration.

    Represents a file stream-based input configuration.

    name

    The name of the file stream input.

    path

    The path of the file stream input.

    warehousePath

    An optional warehouse path for the input.

    catalogName

    An optional catalog name for the input.

    schemaName

    An optional schema name for the input.

    tableName

    An optional table name for the input.

    metastoreUris

    An optional string representing metastore URIs for the input.

    options

    An optional map of options for the input.

    format

    An optional string representing the format of the input.

    icebergCatalogType

    An optional string representing the catalog type for Iceberg format.

    isMetric

    An optional flag indicating if the input is for metrics.

    schema

    An optional Schema for the input.

  4. case class FilesInput(name: String, paths: Seq[String], warehousePath: Option[String], catalogName: Option[String], schemaName: Option[String], tableName: Option[String], metastoreUris: Option[String], options: Option[Map[String, String]], format: Option[String], isMetric: Option[Boolean], icebergCatalogType: Option[String], incremental: Option[Incremental], schema: Option[Schema]) extends FileInputBase with Product with Serializable

    Represents a file-based input configuration.

    Represents a file-based input configuration.

    name

    The name of the file input.

    paths

    The sequence of file paths for the input.

    warehousePath

    An optional warehouse path for the input.

    catalogName

    An optional catalog name for the input.

    schemaName

    An optional schema name for the input.

    tableName

    An optional table name for the input.

    metastoreUris

    An optional string representing metastore URIs for the input.

    options

    An optional map of options for the input.

    format

    An optional string representing the format of the input.

    isMetric

    An optional flag indicating if the input is for metrics.

    icebergCatalogType

    An optional string representing the catalog type for Iceberg format.

    incremental

    An optional Incremental configuration for the input.

    schema

    An optional Schema for the input.

Value Members

  1. object FileType extends Enumeration

    Enumeration representing different types of file formats.

Ungrouped