Gather and troubleshoot AKS Edge Essentials using logs.

Learn how to troubleshoot and mitigate an issue that occurs when storage provisioning fails.

The document outlines support policies for AKS on Azure Local, including technical support limitations, shared responsibilities, and version support. It emphasizes the importance of keeping Kubernetes clusters updated to remain eligible for support.

This document provides guidance on upgrading an Azure Kubernetes Service (AKS) cluster, detailing the process for managing application and cluster lifecycle, including OS version updates and Kubernetes version upgrades. It emphasizes the continuous, rolling upgrade method to ensure uninterrupted availability of workloads.

The AKS cluster upgrade tutorial has been updated to reflect the latest Kubernetes versions, now showing 1.34.10 as the target version for upgrades. Users are now advised to review the AKS release notes for breaking changes and validate their workloads' Pod Disruption Budgets, compute quota, and subnet IP capacity before upgrading. Additionally, the documentation clarifies that supported non-LTS clusters must upgrade sequentially by minor version, and it provides updated commands for checking available cluster versions using both Azure CLI and PowerShell.

This article provides instructions on managing node pools in AKS, including scaling, upgrading, and configuring node pools. It highlights the importance of understanding node pool configurations for effective cluster management.

Learn how to use the Local Path Provisioner tool on AKS Edge Essentials.

Learn how to update AKS Edge Essentials clusters.

This quickstart guide provides step-by-step instructions for using Azure Resource Manager to deploy and manage AKS Hybrid and Edge clusters, facilitating efficient resource management.

The documentation now includes a Terraform quickstart for creating an AKS Automatic cluster, highlighting the use of the `azurerm_kubernetes_automatic_cluster` resource, which requires AzureRM provider version `v4.81` or later. Additionally, users can now find guidance on using the AzAPI provider for more direct control over the managed cluster API payload. The updated sections also clarify the steps for initializing Terraform, creating execution plans, and applying them to manage Azure resources effectively.

Learn how to manage node taints in AKS on Azure Local

Learn how to use the Key Manager for Kubernetes extension to rotate service account keys in Azure Kubernetes Service (AKS) Edge Essentials clusters.

Learn how to get full on-demand logs in AKS Hybrid and Edge and send them to Microsoft.

Description of deployment configuration JSON parameters in AKS Edge Essentials.

Learn how to connect to your Azure Kubernetes Service on bare metal cluster using the Azure Arc proxy and kubectl.

Learn how to bring up an AKS Edge Essentials cluster and connect it to Azure Arc.

Additional configuration options for AKS Edge Essentials.

Learn how to configure SSH keys for an AKS cluster.

Learn how to enable and use Azure role-based access control (RBAC) with Microsoft Entra ID to authorize Kubernetes API requests on AKS on Azure Local for multi-rack deployments.

Learn how to access the TPM from a Linux virtual machine.

The documentation now clarifies that when deploying an AKS cluster in regions that support availability zones, the control plane is automatically distributed across multiple zones by default, even if node pools are not configured for availability zones. This applies specifically to clusters deployed with the `Standard` tier in regions like eastus, enhancing user understanding of control plane configuration in relation to availability zones.

The documentation for monitoring Azure Kubernetes Service (AKS) control plane metrics has been updated to clarify that users can now customize the `controlplane-metrics.minimal-ingestion-profile.enabled` parameter to manage the ingestion of metrics more effectively. Additionally, the configuration for targets in the v2 schema of the ConfigMap is now separated into `cluster-metrics` and `controlplane-metrics`, allowing for distinct control over ingestion volumes. Users are also advised to ensure they have the appropriate access roles for the Azure Monitor workspace to avoid issues with metrics collection.

Learn how to deploy extension for MetalLB for Azure Arc enabled Kubernetes using the Azure portal

Requirements and supported versions for AKS Edge Essentials.

Learn how to deploy an Azure Kubernetes Service (AKS) cluster on bare metal using a Bicep template.

Learn how to encrypt etcd secrets in AKS on Azure Local.

This article introduces core concepts for storage options in AKS Hybrid and Edge, including volumes, persistent volumes, storage classes, and persistent volume claims. It details how applications can store and retrieve data, emphasizing the importance of persistent storage for workloads that require data retention across pod lifecycles.

Select issue type and solution

This article details the technical support policies, limitations, and shared responsibilities for AKS on Azure Local. It emphasizes the importance of keeping Kubernetes versions updated to maintain support eligibility.

| URL | Port | Notes |

Learn about known issues and workarounds in AKS Hybrid and Edge.

Learn how to troubleshoot and recover from infrastructure errors when MOC is unreachable during AKS on Azure Local cluster or node pool creation or deletion.

Learn how to troubleshoot MetalLB speaker pods that don't run on nodes tainted with CriticalAddonsOnly=true:NoSchedule.

Learn how to create Windows node pools in AKS Hybrid and Edge on Azure Local.

Learn how to troubleshoot and mitigate an issue that causes AKS cluster creation to fail.

This article summarizes the latest features, improvements, and important notices for AKS Hybrid and Edge on Azure Local. It highlights release-specific updates, including supported Kubernetes versions and notable bug fixes.

The document has been revised to replace references to 'cert-manager for Arc-enabled Kubernetes' with 'Certificate Management for Azure Arc'. This change clarifies the extension's purpose in supporting TLS for intracluster log communication.

Helm is intended to run on Linux nodes. If your cluster has Windows Server nodes, you must ensure that Helm pods are scheduled to run only on Linux nodes. You must also ensure that any Helm charts you install are scheduled to run on the correct nodes. The commands in this article use node selectors to make sure pods are scheduled to the correct nodes, but not all Helm charts expose a node selector. You can also use other options, such as taints, on your cluster.

This guide details the deployment of a MetalLB load balancer for Azure Arc-enabled Kubernetes clusters using Azure CLI. It covers prerequisites, installation steps, and configuration for effective load balancing across nodes.

Learn how to create Kubernetes clusters using Terraform.

Learn how to troubleshoot deleted cluster still visible in portal, shows "Not found.

Learn how to enable the Windows node pool feature in AKS on Azure Local.

Learn how to disable the Windows node pool feature on the 2509 release and earlier.

Learn how to create Arc-enabled logical networks for AKS Hybrid and Edge.

Learn about metrics and logs used to monitor Kubernetes clusters in AKS.

Learn how to deploy and configure an AKS cluster with workload identity.

The document has been updated to reflect the rebranding of 'cert-manager for Arc-enabled Kubernetes' to 'Certificate Management for Azure Arc', providing clearer guidance on migration and installation processes.

This article provides insights into the scale requirements for AKS on Azure Local, detailing limits and quotas necessary for effective deployment and management of Kubernetes clusters.

Learn details about each control plane configuration validation error.

The documentation now includes a new section for AKS Automatic custom virtual network Terraform quickstarts, allowing users to create an AKS Automatic cluster using the AzureRM provider's `azurerm_kubernetes_automatic_cluster` resource, which requires AzureRM provider version `v4.81` or later. Additionally, users can find sample code and instructions for initializing and applying Terraform configurations, as well as verifying and connecting to the created cluster.

The documentation now includes a new section on "Secure API server access for deployment pipelines," detailing how to configure network connectivity and authorization for deployment pipelines in Azure Kubernetes Service (AKS). Users can learn to set up public and private API server access, including specific instructions for firewall rules and routing, as well as how to manage pipeline identities with appropriate permissions. This enhances security and ensures that deployment pipelines can operate effectively while adhering to best practices.

Learn how to use labels in Kubernetes clusters in AKS Hybrid and Edge.

Retrieve certificate-based admin kubeconfig in AKS Hybrid and Edge.

Learn how to enable availability sets in AKS to improve the availability and distribution of your Kubernetes workloads.

This article outlines how to troubleshoot general network validation errors in AKS, providing valuable insights for users facing connectivity issues. It includes common error messages and recommended actions to resolve them.

Learn how to create Kubernetes clusters in Azure Local using REST API for the Hybrid Container Service.

Learn how to mitigate issues after deleting storage volumes.

Learn how to deploy an Azure Kubernetes Service (AKS) cluster on bare metal using an ARM template.

Supported GPU models

Learn about how to plan for IP addresses and reservation, to deploy AKS in production.

The document has been updated to reflect the rebranding of 'cert-manager for Arc-enabled Kubernetes' to 'Certificate Management for Azure Arc'. It includes new descriptions and clarifications on deployment and configuration processes, enhancing user understanding of the extension's capabilities.

Manage Azure Kubernetes Service (AKS) Arc for Azure Local with disconnected operations (preview).

Learn how to deploy an AI model on AKS Hybrid and Edge with the Kubernetes AI toolchain operator (KAITO).

The documentation now clarifies that both Application Network resources and member resources have fixed locations, subscriptions, and resource groups upon creation or joining, which cannot be changed afterward. Additionally, it specifies that moving a member to a different Application Network requires removing and rejoining it, and that Application Network resources cannot be moved to a different subscription or resource group after creation. The supported regions list for Application Networks has also been expanded to include new regions such as Japan East and North Central US.

Learn how to attach multiple network interfaces to an AKS Edge Essentials Linux virtual machine.

This document explains how to enable and query control plane metrics from AKS on Azure Local, including steps to install the Managed Prometheus extension and view metrics in Grafana. It highlights the importance of control plane metrics for monitoring the availability and performance of Kubernetes components.

Learn about system storage requirements for Azure Kubernetes Service (AKS) for Azure Local.

Learn about what's new in AKS Edge Essentials releases.

Learn how to delete Azure Kubernetes Service on bare metal cluster resources and edge machine resources from Azure in the correct order.

The documentation now includes a new section for using Terraform to create an AKS Automatic cluster with the AzureRM provider, specifically requiring version `v4.81` or later. Users can follow detailed steps to initialize Terraform, create an execution plan, and apply it to set up their cluster, along with instructions for verifying and connecting to the cluster. Additionally, there are references to an equivalent sample using the AzAPI provider for users who may prefer that option.

Learn how to deploy an OPC PLC container and use Akri to discover servers and display anomaly values.

Learn how to use GitOps with AKS Edge Essentials.

Learn how to run the quickstart script that creates an Arc-enabled AKS Edge Essentials Kubernetes cluster that can run Azure IoT Operations.

Learn how to discover and stream video from your ONVIF cameras with Akri.

This update clarifies network requirements by replacing 'cert-manager for Arc-enabled Kubernetes' with 'Certificate Management for Azure Arc', ensuring users have accurate information regarding necessary configurations.

Learn how to enable the KMS provider for AKS Edge Essentials clusters to encrypt secrets.

Applies to: AKS on Windows Server

Learn how to expose a Kubernetes service with AKS Edge Essentials.

Basic networking concepts for AKS Edge Essentials

Learn how to deploy AKS Edge Essentials on a single machine.

The documentation now clarifies that Virtual Machines node pools support the cluster autoscaler, enabling autoscaling for both same and multiple VM size node pools. Users can utilize the `--enable-cluster-autoscaler` flag during cluster creation, node pool addition, or updates, with detailed behavior descriptions for scaling actions. Additionally, it emphasizes that GPU nodes are not supported with this feature.

Plan the IP addresses needed to deploy AKS enabled by Azure Arc clusters on Azure Local (multi-rack), including node IPs, control plane endpoints, and load balancer addresses.

Learn how to troubleshoot and mitigate the issue when an AKS Hybrid and Edge cluster is stuck in 'Upgrading' state.

Learn how to troubleshoot network validation errors due to the .local domain.

Dynamically create disk persistent volumes using built-in storage class

Learn about AKS Hybrid and Edge and available deployment options.

Learn how to prepare your machines for AKS Edge Essentials clusters.

Learn how to prepare your nested virtualization environment for AKS Edge Essentials clusters.

Learn about running AKS on Azure Local in disconnected and semi-connected mode.

Learn about clusters and nodes running on AKS Edge Essentials.

The Container Storage Interface (CSI) is a standard for exposing arbitrary block and file storage systems to containerized workloads on Kubernetes. By using CSI, AKS Hybrid and Edge can write, deploy, and iterate plug-ins to expose new storage systems. CSI can also improve existing ones in Kubernetes without having to touch the core Kubernetes code and then wait for its release cycles.

Follow these steps on all nodes in your Windows Server cluster:

Learn the basic concepts of MetalLB load balancing for AKS Hybrid and Edge Kubernetes clusters.

Learn how to troubleshoot and mitigate an issue that causes AKS cluster to become unhealthy after Kubernetes upgrade

Learn how to uninstall AKS Edge Essentials.

Get certificate-based admin kubeconfig

The document has been updated to reflect the rebranding of 'cert-manager for Arc-enabled Kubernetes' to 'Certificate Management for Azure Arc'. It includes new descriptions and clarifications on egress support scenarios, improving user guidance.

This article explains how to expose a GPU to the virtual machine's Linux module in AKS Edge Essentials, detailing prerequisites and setup instructions for GPU acceleration, which is crucial for AI and ML applications.

Learn how to enable Arc gateway on AKS on Azure Local clusters to simplify network configuration requirements

Learn how to use Microsoft Entra group membership to restrict access to cluster resources using Kubernetes role-based access control (Kubernetes RBAC) in AKS.

This article explains the data collected by AKS Hybrid and Edge, including its classification and control mechanisms. It emphasizes that Microsoft does not collect sensitive information classified as Personally Identifiable Information (PII) and outlines the tiers of data exchange between Kubernetes clusters and Azure.

Learn how to run commands in the Support.AksArc PowerShell module to diagnose and remediate issues in AKS environments.

gMSA authentication isn't supported for Windows node pools on Azure Local 23H2 and 24H2

This article provides instructions on how to obtain kubelet logs in an Azure Kubernetes Service (AKS) Hybrid and Edge deployment, which is essential for troubleshooting issues. It includes steps for creating an SSH connection to the node where the logs are located.

Learn about how to get support and open a support request for AKS Edge Essentials.

Learn how to scale out your AKS Edge Essentials applications to multiple nodes.

AKS provides the following five built-in roles. They are similar to the Kubernetes built-in roles, with a few differences, such as supporting CRDs. See the full list of actions allowed by each Azure built-in role.

Learn about Azure Kubernetes Service (AKS) features, capabilities, and pricing across cloud, edge, and on-premises environments to choose the best deployment for your needs.

This document introduces security access and identity management for AKS Hybrid and Edge deployments, detailing best practices and configurations to enhance security. It emphasizes the importance of managing identities and access controls effectively in hybrid environments.

Learn about AKS Edge Essentials pricing details.

Create Kubernetes clusters by using the Azure portal.

Learn how to update disconnected AKS Edge Essentials clusters.

AKS Edge Essentials is an on-premises Kubernetes implementation of Azure Kubernetes Service (AKS), which automates running containerized applications at scale.

The documentation for the cluster autoscaler in Azure Kubernetes Service (AKS) has been updated to clarify best practices for configuring autoscaling, including the importance of using a single node pool per availability zone and setting the `--balance-similar-node-groups` parameter to maintain node distribution. Additionally, users are advised to set `ignore-daemonsets-utilization` to true for clusters with DaemonSet pods to improve scale-down eligibility and to avoid manually changing node counts in autoscaler-enabled pools. The guidance on handling clusters with over 400 nodes and using priority expanders for Spot and on-demand node pools has also been refined.

Learn about AKS Edge Essentials licensing options.

Learn how to deploy a containerized application to your Azure Kubernetes Service on bare metal cluster.

The document explains how to create Kubernetes clusters in Azure Local using Bicep, detailing the necessary configurations and steps for successful deployment.

Learn how to troubleshoot various Kubernetes issues in AKS Hybrid and Edge.

Learn how to troubleshoot the K8sVersionValidation error code.

The troubleshooting guide for AKS node readiness has been updated to clarify steps for diagnosing and resolving issues. Users are now advised to check the output of the `kubectl describe nodes` command for specific fields and to examine logs from the syslog and kubelet for errors. Additionally, the section on performance problems has been expanded to include high CPU and memory utilization, providing users with more comprehensive guidance on potential remedial actions.

[!IMPORTANT]

Learn how to monitor real-time Kubernetes object events.

Learn how to use NFS external provisioner on AKS Edge Essentials.

Learn how to use Azure CLI for cluster autoscaling.

Learn how to upgrade the Windows Server version on your node pools in AKS Hybrid and Edge.

Microsoft Software License Terms for AKS Edge Essentials.

This article provides an overview of the architecture of AKS on Azure Local, detailing core components such as control plane, nodes, and node pools, and explaining how to deploy and manage Kubernetes clusters effectively.

Learn about Azure Kubernetes Service (AKS) on bare metal, a deployment option that runs Kubernetes directly on hardware without a hypervisor layer.

Learn how to enable Microsoft Entra ID on Azure Kubernetes Service with kubelogin and authenticate Azure users with credentials or managed roles.

Learn how to restrict SSH access in AKS Hybrid and Edge on Azure Local.

This article discusses how to use Azure role-based access control (RBAC) for Kubernetes authorization, detailing the integration with Microsoft Entra ID for managing user identities and permissions in AKS clusters.

This article outlines the networking prerequisites for deploying AKS Hybrid and Edge, detailing core networking concepts necessary for VMs and applications. It emphasizes collaboration with network administrators to ensure proper setup.

The documentation for stateful workload upgrades in Azure Kubernetes Service (AKS) has been updated to provide clearer guidance on coordinating database availability during node pool rolling upgrades. Users can now follow specific upgrade patterns for PostgreSQL, Redis Cluster, and MongoDB, including controlled switchover, replica-first rolling upgrades, and secondary-first rolling upgrades, which help minimize downtime and ensure data integrity. Additionally, the article emphasizes the importance of validating replication health and application behavior throughout the upgrade process, enhancing the overall reliability of stateful application upgrades.

Describes how to deploy a containerized application to a Kubernetes cluster.

Applies to: AKS on Azure Local

Learn how to troubleshoot the "failed to either reach kube-apiserver or control plane IP of Kubernetes cluster from Arc Resource Bridge IP error" when you try to create and deploy an AKS Hybrid and Edge cluster.

Learn how to create a diagnostic setting to access Kubernetes audit logs.

Learn how to deploy container images from a private container registry using Azure Container Registry.

Learn about a known issue with disk space exhaustion on the control plane VMs due to accumulation of kube-apiserver audit logs.

Learn how to create Kubernetes clusters in Azure Local using Azure CLI.

Learn about common issues and workarounds in AKS Edge Essentials.

This update rebrands 'cert-manager for Arc-enabled Kubernetes' to 'Certificate Management for Azure Arc', providing a clearer description of its functionalities and benefits. It emphasizes the extension's role in managing TLS certificates and trust bundles in Arc-connected clusters.

Learn how to upgrade the Kubernetes version on your Azure Kubernetes Service on bare metal cluster using the Azure portal.

Learn how to use SSH to connect to Windows or Linux worker nodes in an AKS cluster.

Learn how to use Container Storage Interface (CSI) drivers to manage files in AKS.

Learn how to bring your own HTTPS proxy to provide internet connectivity for AKS on Azure Local multi-rack clusters.

Updates include the rebranding of 'cert-manager for Arc-enabled Kubernetes' to 'Certificate Management for Azure Arc', along with clarifications on its installation and configuration processes. This enhances the documentation's clarity and usability.

Hardware, network, and Azure prerequisites for deploying Azure Kubernetes Service on bare metal.

Describes how to create a cluster with multiple machines in AKS Edge Essentials.

Learn about the steps to deploy a metrics server on an AKS Edge Essentials cluster.

Learn how to validate signed container images for AKS on Azure Local deployments to ensure image integrity and prevent supply chain attacks.

Expanded the section on ingress gateway customizations, adding details about service and deployment annotations. This provides users with more comprehensive guidance on configuring ingress gateways.

The documentation now clarifies that Azure Support may review requests for increasing storage capacity, private endpoint count, and persistent data-plane throttling or push/pull bandwidth limits, with approvals granted on a case-by-case basis. Additionally, it specifies that other limits listed in the table are not adjustable unless explicitly stated. This provides users with clearer guidance on the flexibility and limitations regarding resource adjustments.

Learn how to mitigate cluster and node pool issues when a Kubernetes version reports image not ready on AKS Hybrid and Edge on Azure Local.

Learn how to troubleshoot and resolve an issue where new AKS cluster creation fails after upgrading Azure Local from version 2510 to 2511 or 2512.

Learn about AKS on Azure Local, its core infrastructure components, and the personas involved in deploying and operating it.

Learn how to configure an AKS Edge Essentials cluster with workload identity.

The documentation now clarifies that the maximum number of public IP network rules per Azure Container Registry is set at 200 and cannot be adjusted by Azure Support. This change informs users of the fixed limit, ensuring they can plan their network configurations accordingly.

Learn how to troubleshoot Entra authentication issues when using kubectl with Kubernetes RBAC.

Connect your AKS Edge Essentials clusters to Arc

This guide explains how to deploy GPU-enabled node pools in AKS Hybrid and Edge on Azure Local. It includes prerequisites, commands for creating GPU node pools, and instructions for running GPU workloads, enhancing the ability to handle compute-intensive tasks.

Learn how to diagnose common causes for failures in AKS.

Learn how to use Container Storage Interface (CSI) drivers to manage disks in AKS Hybrid and Edge.

The documentation for Azure Kubernetes Service (AKS) networking has been updated to clarify that when creating a Kubernetes `LoadBalancer` Service, Azure automatically configures the necessary network security group rules for service traffic. Additionally, the flat network model explanation now includes details on how the source IP address seen by destinations varies based on the IP address management option used. LocalDNS is now preconfigured in AKS Automatic, while in AKS Standard, it is optional and requires verification of specific prerequisites before enabling.

Known limitations and scope for the Azure Kubernetes Service on bare metal public preview.

Learn how to deploy an Azure Kubernetes Service (AKS) cluster on bare metal using the Azure portal.

Learn how to configure your machine for AKS Edge Essentials offline installation.

Learn how to create and access monitoring and logging data for AKS Hybrid and Edge.

Learn how to troubleshoot BGP connectivity issues when using MetalLB with FRR in AKS deployments.