Class HiveJob (2.5.0)

  HiveJob 
 ( 
 mapping 
 = 
 None 
 , 
 * 
 , 
 ignore_unknown_fields 
 = 
 False 
 , 
 ** 
 kwargs 
 ) 
 

A Dataproc job for running Apache Hive <https://hive.apache.org/> __ queries on YARN.

Attributes

Name
Description
query_file_uri
str
The HCFS URI of the script that contains Hive queries.
query_list
continue_on_failure
bool
Optional. Whether to continue executing queries if a query fails. The default value is false . Setting to true can be useful when executing independent parallel queries.
script_variables
Sequence[ google.cloud.dataproc_v1.types.HiveJob.ScriptVariablesEntry ]
Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value"; ).
properties
Sequence[ google.cloud.dataproc_v1.types.HiveJob.PropertiesEntry ]
Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/hive/conf/hive-site.xml, and classes in user code.
jar_file_uris
Sequence[str]
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.

Classes

PropertiesEntry

  PropertiesEntry 
 ( 
 mapping 
 = 
 None 
 , 
 * 
 , 
 ignore_unknown_fields 
 = 
 False 
 , 
 ** 
 kwargs 
 ) 
 

The abstract base class for a message.

Parameters
Name
Description
kwargs
dict

Keys and values corresponding to the fields of the message.

mapping
Union[dict, .Message ]

A dictionary or message to be used to determine the values for this message.

ignore_unknown_fields
Optional(bool)

If True, do not raise errors for unknown fields. Only applied if mapping is a mapping type or there are keyword parameters.

ScriptVariablesEntry

  ScriptVariablesEntry 
 ( 
 mapping 
 = 
 None 
 , 
 * 
 , 
 ignore_unknown_fields 
 = 
 False 
 , 
 ** 
 kwargs 
 ) 
 

The abstract base class for a message.

Parameters
Name
Description
kwargs
dict

Keys and values corresponding to the fields of the message.

mapping
Union[dict, .Message ]

A dictionary or message to be used to determine the values for this message.

ignore_unknown_fields
Optional(bool)

If True, do not raise errors for unknown fields. Only applied if mapping is a mapping type or there are keyword parameters.

Create a Mobile Website
View Site in Mobile | Classic
Share by: