Packages

p

io.dataos.spark.writers

elasticsearch

package elasticsearch

Type Members

  1. class ElasticsearchOutputWriter extends DatasourceWriter

    A custom ElasticsearchOutputWriter class that extends the DatasourceWriter.

    A custom ElasticsearchOutputWriter class that extends the DatasourceWriter. This class provides methods to write DataFrame data to Elasticsearch using the Elasticsearch-Spark connector.

  2. case class ElasticsearchWriterOptions(esNodes: String, resource: String, username: Option[String], password: Option[String], indexType: String, addTimestampToIndex: Option[Boolean], skipIndexType: Boolean, saveMode: SaveMode = SaveMode.Append, options: Map[String, String] = Map.empty) extends Product with Serializable

    A case class that represents the configuration options for the Elasticsearch writer.

    A case class that represents the configuration options for the Elasticsearch writer.

    esNodes

    Comma-separated Elasticsearch nodes' addresses.

    resource

    The Elasticsearch resource to write data to.

    username

    An optional username for HTTP authentication with Elasticsearch.

    password

    An optional password for HTTP authentication with Elasticsearch.

    indexType

    The type of the Elasticsearch index to write data to.

    addTimestampToIndex

    An optional flag to add timestamp to the Elasticsearch index.

    skipIndexType

    A flag indicating whether to skip the index type in the Elasticsearch resource.

    saveMode

    The SaveMode used for writing data to Elasticsearch (default is Append).

    options

    Additional options as key-value pairs to configure the writer (default is an empty Map).

Ungrouped