Select persistent boot disk types for cluster nodes
You can select the persistent boot disk type when you create a cluster using the
Google Cloud console, Google Cloud CLI, or Dataproc API.
Console
You can create a cluster and select a standard, SSD, balanced Persistent Disk,
orHyperdisk Balancedboot disk for manager (master), primary worker, andsecondary workercluster nodes from theConfigure nodespanel on the DataprocCreate a clusterpage
of the Google Cloud console.
gcloud CLI
You can create a cluster and select a standard, SSD , balanced persistent boot disk,
orHyperdisk balancedfor manager (master), primary worker, andsecondary workercluster nodes using thegcloud dataproc clusters createcommand with the--master-boot-disk-type,--worker-boot-disk-type, and--secondary-worker-boot-disk-typeflags.
The default persistent boot disk type for Dataproc cluster manager (master) and
primary worker nodes ispd-standard. If the VMmachine typesupports onlyHyperdisk Balancedas the boot disk,
the default boot disk ishyperdisk-balanced.
The default persistent boot disk type for cluster
secondary worker nodes is the primary worker node persistent boot disk type.
You can pass a value ofpd-standard,pd-ssd,pd-balanced, orhyperdisk-balancedto the--master-boot-disk-type,--worker-boot-disk-type, and--secondary-worker-boot-disk-typeflags. Any of the valid
disk type values can be set on any cluster node type.
The default boot disk type for Dataproc cluster manager (master) and primary worker
nodes ispd-standard. If the VMmachine typesupports onlyHyperdisk Balancedas the boot disk,
the default boot disk ishyperdisk-balanced. The default boot disk type forsecondary workernodes is the
primary work node boot disk type.
You can set a value ofpd-standard,pd-ssd,pd-balanced, orhyperdisk-balancedin theInstanceGroupConfig.DiskConfig.bootDiskTypefield in themasterConfig,workerConfig, andsecondaryWorkerConfigas part of acluster.createAPI request. Any of the valid boot disk type type values can be set on any cluster node type.
Hyperdisk settings
When you create a cluster with a Hyperdisk Balanced volume
as the boot disk for a Dataproc cluster node, you can set theprovisioned IOPS and throughput.
Console
Hyperdisk Balancedis selected as the default
primary boot disk type for manager (master) and primary worker cluster nodes from theConfigure nodespanel on the DataprocCreate a clusterpage
of the Google Cloud console. You can set IOPS and throughput, or accept the default
values.
gcloud CLI
You can set provisioned IOPS and provisioned throughput for cluster nodes with the
hyperdisk-balanced boot disks using thegcloud dataproc clusters createcommand--master-boot-disk-provisioned-iops,--worker-boot-disk-provisioned-iops,--master-boot-disk-provisioned-throughput, and--worker-boot-disk-provisioned-throughputflags.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-09-04 UTC."],[[["\u003cp\u003eYou can select between standard, SSD, balanced persistent disks, or hyperdisk balanced as boot disks for your Dataproc cluster nodes.\u003c/p\u003e\n"],["\u003cp\u003eThe Google Cloud console, gcloud CLI, and Dataproc API offer ways to choose the persistent boot disk type for master, primary worker, and secondary worker nodes during cluster creation.\u003c/p\u003e\n"],["\u003cp\u003eThe default boot disk type is \u003ccode\u003epd-standard\u003c/code\u003e, unless the VM machine type only supports hyperdisk, in which case \u003ccode\u003ehyperdisk-balanced\u003c/code\u003e is the default, and secondary workers default to the primary worker node's type.\u003c/p\u003e\n"],["\u003cp\u003eWhen using \u003ccode\u003ehyperdisk-balanced\u003c/code\u003e boot disks, you can use the gcloud CLI or the Dataproc API to set the provisioned IOPS and provisioned throughput settings for the master and worker nodes.\u003c/p\u003e\n"],["\u003cp\u003eYou are able to configure the size of the persistent boot disk as well when creating a new cluster.\u003c/p\u003e\n"]]],[],null,["You select standard, SSD, balanced [Persistent Disk](/compute/docs/persistent-disks#disk-types),\nor [Google Cloud Hyperdisk Balanced](/compute/docs/disks/hd-types/hyperdisk-balanced) as boot disks for\nDataproc cluster nodes.\n\nSelect persistent boot disk types for cluster nodes\n\nYou can select the persistent boot disk type when you create a cluster using the\nGoogle Cloud console, Google Cloud CLI, or Dataproc API. \n\nConsole\n\nYou can create a cluster and select a standard, SSD, balanced Persistent Disk,\nor [Hyperdisk Balanced](/compute/docs/disks/hd-types/hyperdisk-balanced) boot disk for manager (master), primary worker, and\n[secondary worker](/dataproc/docs/concepts/compute/secondary-vms)\ncluster nodes from the **Configure nodes** panel on the Dataproc\n[**Create a cluster**](https://console.cloud.google.com/dataproc/clustersAdd) page\nof the Google Cloud console.\n\ngcloud CLI\n\nYou can create a cluster and select a standard, SSD , balanced persistent boot disk,\nor [Hyperdisk balanced](/compute/docs/disks/hd-types/hyperdisk-balanced) for manager (master), primary worker, and\n[secondary worker](/dataproc/docs/concepts/compute/secondary-vms) cluster nodes using the\n[gcloud dataproc clusters create](/sdk/gcloud/reference/dataproc/clusters/create)\ncommand with the `--master-boot-disk-type`,\n`--worker-boot-disk-type`, and\n`--secondary-worker-boot-disk-type` flags.\n\nThe default persistent boot disk type for Dataproc cluster manager (master) and\nprimary worker nodes is `pd-standard`. If the VM\n[machine type](/dataproc/docs/concepts/compute/supported-machine-types)\nsupports only [Hyperdisk Balanced](/compute/docs/disks/hd-types/hyperdisk-balanced) as the boot disk,\nthe default boot disk is `hyperdisk-balanced`.\nThe default persistent boot disk type for cluster\nsecondary worker nodes is the primary worker node persistent boot disk type.\n\nYou can pass a value of `pd-standard`, `pd-ssd`,\n`pd-balanced`, or `hyperdisk-balanced` to the\n`--master-boot-disk-type`, `--worker-boot-disk-type`, and\n`--secondary-worker-boot-disk-type` flags. Any of the valid\ndisk type values can be set on any cluster node type.\n**Example:** \n\n```\ngcloud dataproc clusters create CLUSTER_NAME \\\n --region=REGION \\\n --master-boot-disk-type=pd-ssd \\\n --worker-boot-disk-type=hyperdisk-balanced \\\n --secondary-worker-boot-disk-type=pd-standard \\\n other args ...\n```\np You can set the size of persistent boot disks using the [`--master-boot-disk-size`](/sdk/gcloud/reference/dataproc/clusters/create#--master-boot-disk-size), [`--worker-boot-disk-size`, and](/sdk/gcloud/reference/dataproc/clusters/create#--worker-boot-disk-size)[`--secondary-worker-boot-disk-size`](/sdk/gcloud/reference/dataproc/clusters/create#--secondary-worker-boot-disk-size) flags.\n\nREST API\n\nThe default boot disk type for Dataproc cluster manager (master) and primary worker\nnodes is `pd-standard`. If the VM [machine type](/dataproc/docs/concepts/compute/supported-machine-types)\nsupports only [Hyperdisk Balanced](/compute/docs/disks/hd-types/hyperdisk-balanced) as the boot disk,\nthe default boot disk is `hyperdisk-balanced`. The default boot disk type for\n[secondary worker](/dataproc/docs/concepts/compute/secondary-vms) nodes is the\nprimary work node boot disk type.\n\nYou can set a value of `pd-standard`, `pd-ssd`,\n`pd-balanced`, or `hyperdisk-balanced` in the\n[`InstanceGroupConfig.DiskConfig.bootDiskType`](/dataproc/docs/reference/rest/v1/InstanceGroupConfig#DiskConfig)\nfield in the `masterConfig`, `workerConfig`, and\n`secondaryWorkerConfig` as part of a\n[`cluster.create`](/dataproc/docs/reference/rest/v1/projects.regions.clusters/create)\nAPI request. Any of the valid boot disk type type values can be set on any cluster node type.\n| Note: Set the per-node boot disk **size** using the [`InstanceGroupConfig.DiskConfig.bootDiskSizeGb`](/dataproc/docs/reference/rest/v1/InstanceGroupConfig#DiskConfig) field in the master, worker, or secondary worker config.\n\nHyperdisk settings\n\nWhen you create a cluster with a Hyperdisk Balanced volume\nas the boot disk for a Dataproc cluster node, you can set the\n[provisioned IOPS and throughput](/compute/docs/disks/hd-types/hyperdisk-balanced#about-provisioned-performance-for-hyperdisk-balanced). \n\nConsole\n\n[Hyperdisk Balanced](/compute/docs/disks/hd-types/hyperdisk-balanced) is selected as the default\nprimary boot disk type for manager (master) and primary worker cluster nodes from the\n**Configure nodes** panel on the Dataproc\n[**Create a cluster**](https://console.cloud.google.com/dataproc/clustersAdd) page\nof the Google Cloud console. You can set IOPS and throughput, or accept the default\nvalues.\n\ngcloud CLI\n\nYou can set provisioned IOPS and provisioned throughput for cluster nodes with the\nhyperdisk-balanced boot disks using the\n[gcloud dataproc clusters create](/sdk/gcloud/reference/dataproc/clusters/create)\ncommand `--master-boot-disk-provisioned-iops`,\n`--worker-boot-disk-provisioned-iops`,\n`--master-boot-disk-provisioned-throughput`, and\n`--worker-boot-disk-provisioned-throughput` flags.\n**Example:** \n\n```\n gcloud dataproc clusters create CLUSTER_NAME \\\n --region=REGION \\\n --master-boot-disk-type=hyperdisk-balanced \\\n --master-boot-disk-provisioned-iops=MASTER_BOOT_DISK_IOPS \\\n --master-boot-disk-provisioned-throughput=MASTER_BOOT_DISK_THROUGHPUT \\\n --worker-boot-disk-type=hyperdisk-balanced \\\n --worker-boot-disk-provisioned-iops=WORKER_BOOT_DISK_IOPS \\\n --worker-boot-disk-provisioned-throughput=WORKER_BOOT_DISK_THROUGHPUT \\\n other args ...\n \n```\n| Secondary workers are configured with primary worker boot disk settings.\n\nREST API\n\nYou can set provisioned IOPS and provisioned throughput for cluster nodes with\nHyperdisk boot disks using the [`InstanceGroupConfig.DiskConfig.bootDiskProvisionedIops`](/dataproc/docs/reference/rest/v1/InstanceGroupConfig#DiskConfig.FIELDS.boot_disk_provisioned_iops) and [`InstanceGroupConfig.DiskConfig.bootDiskProvisionedThroughput`](/dataproc/docs/reference/rest/v1/InstanceGroupConfig#DiskConfig.FIELDS.boot_disk_provisioned_throughput) fields for\nthe manager (master) and worker configs."]]
