A Dataproc job for runningApache Pigqueries on YARN.
JSON representation
{"continueOnFailure":boolean,"scriptVariables":{string:string,...},"properties":{string:string,...},"jarFileUris":[string],"loggingConfig":{object (LoggingConfig)},// Union fieldqueriescan be only one of the following:"queryFileUri":string,"queryList":{object (QueryList)}// End of list of possible types for union fieldqueries.}
Fields
continueOnFailure
boolean
Optional. Whether to continue executing queries if a query fails. The default value isfalse. Setting totruecan be useful when executing independent parallel queries.
scriptVariables
map (key: string, value: string)
Optional. Mapping of query variable names to values (equivalent to the Pig command:name=[value]).
An object containing a list of"key": valuepairs. Example:{ "name": "wrench", "mass": "1.3kg", "count": "3" }.
properties
map (key: string, value: string)
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API might be overwritten. Can include properties set in/etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.
An object containing a list of"key": valuepairs. Example:{ "name": "wrench", "mass": "1.3kg", "count": "3" }.
jarFileUris[]
string
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
Optional. The runtime log config for job execution.
Union fieldqueries. Required. The sequence of Pig queries to execute, specified as an HCFS file URI or a list of queries.queriescan be only one of the following:
queryFileUri
string
The HCFS URI of the script that contains the Pig queries.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-06-20 UTC."],[[["\u003cp\u003eThis document describes the JSON representation of a Dataproc job for running Apache Pig queries on YARN, detailing its structure and fields.\u003c/p\u003e\n"],["\u003cp\u003eThe \u003ccode\u003equeries\u003c/code\u003e field is required and can be specified as either a URI to a file containing Pig queries (\u003ccode\u003equeryFileUri\u003c/code\u003e) or a list of queries (\u003ccode\u003equeryList\u003c/code\u003e).\u003c/p\u003e\n"],["\u003cp\u003eThe job configuration supports optional fields like \u003ccode\u003econtinueOnFailure\u003c/code\u003e (to dictate behavior on query failure), \u003ccode\u003escriptVariables\u003c/code\u003e (for Pig variable substitution), \u003ccode\u003eproperties\u003c/code\u003e (for Pig configuration), \u003ccode\u003ejarFileUris\u003c/code\u003e (for including JAR files), and \u003ccode\u003eloggingConfig\u003c/code\u003e (for runtime log configuration).\u003c/p\u003e\n"],["\u003cp\u003e\u003ccode\u003escriptVariables\u003c/code\u003e and \u003ccode\u003eproperties\u003c/code\u003e utilize a map structure to assign strings as key-value pairs, allowing for query variable and Pig property settings respectively.\u003c/p\u003e\n"]]],[],null,["# PigJob\n\n- [JSON representation](#SCHEMA_REPRESENTATION)\n\nA Dataproc job for running [Apache Pig](https://pig.apache.org/) queries on YARN."]]
