class SparkSessionBuilder extends AnyRef
SparkSessionBuilder is a builder pattern to create instances of FlareSession with customizable configurations.
- Alphabetic
- By Inheritance
- SparkSessionBuilder
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new SparkSessionBuilder()
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
build(): FlareSession
Build and return a FlareSession instance based on the configured options.
Build and return a FlareSession instance based on the configured options.
- returns
A new FlareSession instance.
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
- var conf: Map[String, String]
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
withAddressResolver(ar: AddressResolver): SparkSessionBuilder
Set the AddressResolver to be used for resolving data addresses.
Set the AddressResolver to be used for resolving data addresses.
- ar
The AddressResolver instance.
- returns
The SparkSessionBuilder instance with the specified AddressResolver.
-
def
withAppName(name: String): SparkSessionBuilder
Set the application name for the SparkSession.
Set the application name for the SparkSession.
- name
The application name.
- returns
The SparkSessionBuilder instance with the specified application name.
-
def
withDataPolicyClient(dp: DataPolicyClient): SparkSessionBuilder
Set the DataPolicyClient to be used for enforcing data governance policies.
Set the DataPolicyClient to be used for enforcing data governance policies.
- dp
The DataPolicyClient instance.
- returns
The SparkSessionBuilder instance with the specified DataPolicyClient.
-
def
withDepot(name: String, acl: String = "r"): SparkSessionBuilder
Set the depot and access control list (ACL) for the specified depot.
Set the depot and access control list (ACL) for the specified depot.
- name
The name of the depot.
- acl
The access control list (ACL) for the depot. Default is "r" (read access).
- returns
The SparkSessionBuilder instance with the specified depot and ACL.
-
def
withDepotServiceUrl(url: String): SparkSessionBuilder
Set the Depot Service URL to be used for accessing the Depot service.
Set the Depot Service URL to be used for accessing the Depot service.
- url
The Depot Service URL.
- returns
The SparkSessionBuilder instance with the specified Depot Service URL.
-
def
withReaderFactory(rf: ReaderFactory): SparkSessionBuilder
Set the ReaderFactory to be used for creating data source readers.
Set the ReaderFactory to be used for creating data source readers.
- rf
The ReaderFactory instance.
- returns
The SparkSessionBuilder instance with the specified ReaderFactory.
-
def
withSecretProvider(providerType: SecretProviderType): SparkSessionBuilder
Specify a secret provider type [SecretProviderType] Heimdall/KeyValueProperties, default: [KeyValueProperties]
Specify a secret provider type [SecretProviderType] Heimdall/KeyValueProperties, default: [KeyValueProperties]
- providerType
secret provider type
-
def
withSparkConf(conf: Map[String, String]): SparkSessionBuilder
Set SparkConf options for configuring the SparkSession.
Set SparkConf options for configuring the SparkSession.
- conf
The SparkConf options as a Map.
- returns
The SparkSessionBuilder instance with the specified SparkConf options.
-
def
withUserAgent(userAgent: String): SparkSessionBuilder
Set the user agent to be used for API requests.
Set the user agent to be used for API requests.
- userAgent
The user agent.
- returns
The SparkSessionBuilder instance with the specified user agent.
-
def
withUserApiKey(apikey: String): SparkSessionBuilder
Set the user API key to be used for accessing secrets.
Set the user API key to be used for accessing secrets.
- apikey
The user API key.
- returns
The SparkSessionBuilder instance with the specified user API key.
-
def
withWriterFactory(wf: WriterFactory): SparkSessionBuilder
Set the WriterFactory to be used for creating data source writers.
Set the WriterFactory to be used for creating data source writers.
- wf
The WriterFactory instance.
- returns
The SparkSessionBuilder instance with the specified WriterFactory.