Packages

c

io.dataos.spark.session

SparkSessionBuilder

class SparkSessionBuilder extends AnyRef

SparkSessionBuilder is a builder pattern to create instances of FlareSession with customizable configurations.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SparkSessionBuilder
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SparkSessionBuilder()

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def build(): FlareSession

    Build and return a FlareSession instance based on the configured options.

    Build and return a FlareSession instance based on the configured options.

    returns

    A new FlareSession instance.

  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. var conf: Map[String, String]
  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  18. def toString(): String
    Definition Classes
    AnyRef → Any
  19. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  22. def withAddressResolver(ar: AddressResolver): SparkSessionBuilder

    Set the AddressResolver to be used for resolving data addresses.

    Set the AddressResolver to be used for resolving data addresses.

    ar

    The AddressResolver instance.

    returns

    The SparkSessionBuilder instance with the specified AddressResolver.

  23. def withAppName(name: String): SparkSessionBuilder

    Set the application name for the SparkSession.

    Set the application name for the SparkSession.

    name

    The application name.

    returns

    The SparkSessionBuilder instance with the specified application name.

  24. def withDataPolicyClient(dp: DataPolicyClient): SparkSessionBuilder

    Set the DataPolicyClient to be used for enforcing data governance policies.

    Set the DataPolicyClient to be used for enforcing data governance policies.

    dp

    The DataPolicyClient instance.

    returns

    The SparkSessionBuilder instance with the specified DataPolicyClient.

  25. def withDepot(name: String, acl: String = "r"): SparkSessionBuilder

    Set the depot and access control list (ACL) for the specified depot.

    Set the depot and access control list (ACL) for the specified depot.

    name

    The name of the depot.

    acl

    The access control list (ACL) for the depot. Default is "r" (read access).

    returns

    The SparkSessionBuilder instance with the specified depot and ACL.

  26. def withDepotServiceUrl(url: String): SparkSessionBuilder

    Set the Depot Service URL to be used for accessing the Depot service.

    Set the Depot Service URL to be used for accessing the Depot service.

    url

    The Depot Service URL.

    returns

    The SparkSessionBuilder instance with the specified Depot Service URL.

  27. def withReaderFactory(rf: ReaderFactory): SparkSessionBuilder

    Set the ReaderFactory to be used for creating data source readers.

    Set the ReaderFactory to be used for creating data source readers.

    rf

    The ReaderFactory instance.

    returns

    The SparkSessionBuilder instance with the specified ReaderFactory.

  28. def withSecretProvider(providerType: SecretProviderType): SparkSessionBuilder

    Specify a secret provider type [SecretProviderType] Heimdall/KeyValueProperties, default: [KeyValueProperties]

    Specify a secret provider type [SecretProviderType] Heimdall/KeyValueProperties, default: [KeyValueProperties]

    providerType

    secret provider type

  29. def withSparkConf(conf: Map[String, String]): SparkSessionBuilder

    Set SparkConf options for configuring the SparkSession.

    Set SparkConf options for configuring the SparkSession.

    conf

    The SparkConf options as a Map.

    returns

    The SparkSessionBuilder instance with the specified SparkConf options.

  30. def withUserAgent(userAgent: String): SparkSessionBuilder

    Set the user agent to be used for API requests.

    Set the user agent to be used for API requests.

    userAgent

    The user agent.

    returns

    The SparkSessionBuilder instance with the specified user agent.

  31. def withUserApiKey(apikey: String): SparkSessionBuilder

    Set the user API key to be used for accessing secrets.

    Set the user API key to be used for accessing secrets.

    apikey

    The user API key.

    returns

    The SparkSessionBuilder instance with the specified user API key.

  32. def withWriterFactory(wf: WriterFactory): SparkSessionBuilder

    Set the WriterFactory to be used for creating data source writers.

    Set the WriterFactory to be used for creating data source writers.

    wf

    The WriterFactory instance.

    returns

    The SparkSessionBuilder instance with the specified WriterFactory.

Inherited from AnyRef

Inherited from Any

Ungrouped