Reference documentation and code samples for the Google Cloud Dataproc V1 Client class SparkSqlJob.
A Dataproc job for running Apache Spark SQL queries.
Generated from protobuf message google.cloud.dataproc.v1.SparkSqlJob
Methods
__construct
Constructor.
data
array
Optional. Data for populating the Message object.
↳ query_file_uri
string
The HCFS URI of the script that contains SQL queries.
↳ query_list
↳ script_variables
array| Google\Protobuf\Internal\MapField
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";
).
↳ properties
array| Google\Protobuf\Internal\MapField
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
↳ jar_file_uris
array
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
↳ logging_config
getQueryFileUri
The HCFS URI of the script that contains SQL queries.
string
hasQueryFileUri
setQueryFileUri
The HCFS URI of the script that contains SQL queries.
var
string
$this
getQueryList
A list of queries.
hasQueryList
setQueryList
A list of queries.
$this
getScriptVariables
Optional. Mapping of query variable names to values (equivalent to the
Spark SQL command: SET name="value";
).
setScriptVariables
Optional. Mapping of query variable names to values (equivalent to the
Spark SQL command: SET name="value";
).
$this
getProperties
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
setProperties
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
$this
getJarFileUris
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
setJarFileUris
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
var
string[]
$this
getLoggingConfig
Optional. The runtime log config for job execution.
hasLoggingConfig
clearLoggingConfig
setLoggingConfig
Optional. The runtime log config for job execution.
$this
getQueries
string
