Google Cloud Dataproc V1 Client - Class SparkSqlJob (3.14.0)

Reference documentation and code samples for the Google Cloud Dataproc V1 Client class SparkSqlJob.

A Dataproc job for running Apache Spark SQL queries.

Generated from protobuf message google.cloud.dataproc.v1.SparkSqlJob

Namespace

Google \ Cloud \ Dataproc \ V1

Methods

__construct

Constructor.

Parameters
Name
Description
data
array

Optional. Data for populating the Message object.

↳ query_file_uri
string

The HCFS URI of the script that contains SQL queries.

↳ query_list
↳ script_variables
array| Google\Protobuf\Internal\MapField

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value"; ).

↳ properties
array| Google\Protobuf\Internal\MapField

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

↳ jar_file_uris
array

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

↳ logging_config
Google\Cloud\Dataproc\V1\LoggingConfig

Optional. The runtime log config for job execution.

getQueryFileUri

The HCFS URI of the script that contains SQL queries.

Returns
Type
Description
string

hasQueryFileUri

setQueryFileUri

The HCFS URI of the script that contains SQL queries.

Parameter
Name
Description
var
string
Returns
Type
Description
$this

getQueryList

A list of queries.

Returns
Type
Description

hasQueryList

setQueryList

A list of queries.

Parameter
Name
Description
Returns
Type
Description
$this

getScriptVariables

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value"; ).

Returns
Type
Description

setScriptVariables

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value"; ).

Parameter
Name
Description
Returns
Type
Description
$this

getProperties

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Returns
Type
Description

setProperties

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.

Parameter
Name
Description
Returns
Type
Description
$this

getJarFileUris

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Returns
Type
Description

setJarFileUris

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Parameter
Name
Description
var
string[]
Returns
Type
Description
$this

getLoggingConfig

Optional. The runtime log config for job execution.

Returns
Type
Description

hasLoggingConfig

clearLoggingConfig

setLoggingConfig

Optional. The runtime log config for job execution.

Parameter
Name
Description
Returns
Type
Description
$this

getQueries

Returns
Type
Description
string
Design a Mobile Site
View Site in Mobile | Classic
Share by: