Version 1.16. This version is no longer supported. For information about how to upgrade to version 1.28, seeUpgrade clustersin the latest documentation. For more information about supported and unsupported versions, see theVersioningpage in the latest documentation.
Occasionally, Google Distributed Cloud may run into conditions where you need to
start an upgrade over again, or fix an error condition to complete the upgrade
successfully. The following conditions may occur when upgrading clusters. Try
to complete the cluster upgrade as noted with the condition.
Recover admin, hybrid, and standalone cluster upgrades
Admin, hybrid, and standalone clusters are all upgraded with thebmctl upgradecommand.
If your upgrade doesn't complete successfully, check the following conditions
and try the upgrade again.
bmctlfails to parse the config file due to a mistake. Fix the config file
and rerun the command.
bmctlfails to bootstrap the temporary cluster. Retry the command.
the log files indicate that the upgrade failed apreflight check. Correct the preflight condition, or force
the upgrade.
the upgrade took too long (more than 30 minutes) or timed out. Retry the
upgrade command.
If your upgrade doesn't complete successfully, check the following conditions
and try the upgrade again.
Preflight check failed. Check the preflight check log and fix the
corresponding error.
You may need to construct a new preflight custom resourcefollowing these instructionsand apply it to the cluster. Check that the
triggered preflight passes, and that the cluster reconciler
picks up the latest passing state.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-09-04 UTC."],[[["\u003cp\u003eUpgrades for admin, hybrid, and standalone clusters are managed using the \u003ccode\u003ebmctl upgrade\u003c/code\u003e command, and if unsuccessful, issues like configuration errors, bootstrap failures, preflight check failures, or timeouts should be addressed.\u003c/p\u003e\n"],["\u003cp\u003eUser cluster upgrades are initiated from an associated admin cluster via the \u003ccode\u003ekubectl apply\u003c/code\u003e command, and recovery involves checking for preflight check failures and potentially creating a new preflight custom resource.\u003c/p\u003e\n"],["\u003cp\u003eCommon issues that can occur during upgrades of all clusters include configuration file mistakes, failed bootstrapping, preflight check failures, and timeouts.\u003c/p\u003e\n"],["\u003cp\u003eRerunning commands or making configuration changes based on logged errors or failures are common methods to address upgrade issues.\u003c/p\u003e\n"]]],[],null,["# Recover a failed upgrade in Google Distributed Cloud\n\n\u003cbr /\u003e\n\nOccasionally, Google Distributed Cloud may run into conditions where you need to\nstart an upgrade over again, or fix an error condition to complete the upgrade\nsuccessfully. The following conditions may occur when upgrading clusters. Try\nto complete the cluster upgrade as noted with the condition.\n\nRecover admin, hybrid, and standalone cluster upgrades\n------------------------------------------------------\n\nAdmin, hybrid, and standalone clusters are all upgraded with the [`bmctl upgrade`\ncommand](/anthos/clusters/docs/bare-metal/1.16/how-to/upgrade).\n\nIf your upgrade doesn't complete successfully, check the following conditions\nand try the upgrade again.\n\n- `bmctl` fails to parse the config file due to a mistake. Fix the config file and rerun the command.\n- `bmctl` fails to bootstrap the temporary cluster. Retry the command.\n- the log files indicate that the upgrade failed a [preflight check](/anthos/clusters/docs/bare-metal/1.16/installing/preflight). Correct the preflight condition, or force the upgrade.\n- the upgrade took too long (more than 30 minutes) or timed out. Retry the upgrade command.\n\nRecover user cluster upgrades\n-----------------------------\n\nUser clusters are [upgraded from an associated admin cluster](/anthos/clusters/docs/bare-metal/1.16/how-to/upgrade)\nwith the `kubectl apply` command.\n\nIf your upgrade doesn't complete successfully, check the following conditions\nand try the upgrade again.\n\n- Preflight check failed. Check the preflight check log and fix the corresponding error.\n- You may need to construct a new preflight custom resource [following these instructions](/anthos/clusters/docs/bare-metal/1.16/installing/preflight#re-enabling_preflight_checks) and apply it to the cluster. Check that the triggered preflight passes, and that the cluster reconciler picks up the latest passing state."]]
