Frequently Asked Questions

Azure VM Rightsizing & Optimization

What is AI-powered automated rightsizing for Azure VMs?

AI-powered automated rightsizing for Azure VMs is a process where Sedai's platform uses advanced AI to analyze your Azure virtual machine usage and automatically adjust VM types and sizes to minimize costs while maintaining performance and reliability. This eliminates manual effort and ensures your VMs are always optimally configured for your workloads.

Why is rightsizing important for Azure VMs?

Rightsizing is crucial because most Azure VMs are significantly underutilized—analysis shows a median CPU utilization of just 8.2%, with 72% of users below 20%. Overprovisioning leads to unnecessary cloud costs. Effective rightsizing can halve costs by doubling utilization, ensuring you only pay for the resources you actually need.

What are the main causes of overprovisioning in Azure VMs?

Common causes include developer bias towards overprovisioning for safety, bursty workloads that are hard to predict, application architectures that don't support horizontal scaling, and the complexity of choosing from over 400 Azure VM types. These factors make it difficult to select the optimal VM size manually.

How does Sedai's AI-powered optimization for Azure VMs work?

Sedai's platform continuously analyzes your Azure VM infrastructure, identifies inefficiencies, and autonomously implements optimizations. The process includes discovering your VM fleet, recommending optimal settings, validating changes with safety and timing checks, executing the changes, and tracking results for continuous improvement.

What are the key steps in Sedai's Azure VM optimization process?

The process includes: 1) Discovering your VM infrastructure and application patterns, 2) Recommending optimal VM types and configurations, 3) Validating changes with safety and timing checks, 4) Executing the changes, and 5) Learning from outcomes to further improve future optimizations.

How does Sedai ensure safety when rightsizing Azure VMs?

Sedai performs multiple safety checks before making any changes, including validating if the action can be performed safely and determining the right timing for execution. The platform tracks all changes with a full audit trail and verifies application health after each action.

What kind of cost savings can I expect from Sedai's Azure VM optimization?

Early adopters have seen Azure VM cost reductions of up to 30% or more. For example, a healthcare company identified over $250,000 in annual savings (28%) in its dev/test environments through Sedai's optimization.

How much can Sedai reduce the time required to rightsize Azure VMs?

Sedai's automated optimization can reduce the time to rightsize Azure VMs by up to 90%, streamlining what is typically a complex and time-consuming process.

Does Sedai support both agentless and agent-based deployment for Azure VM optimization?

Yes, Sedai offers both agentless and agent-based deployment options for Azure VM optimization, allowing you to choose the approach that best fits your environment and security requirements.

How does Sedai handle bursty or unpredictable workloads on Azure VMs?

Sedai's AI analyzes workload patterns, including bursty traffic, and recommends suitable VM types (such as burstable instances) to ensure cost efficiency without sacrificing performance, even when workloads are unpredictable.

What metrics does Sedai use to optimize Azure VMs?

Sedai uses a comprehensive set of metrics, including CPU and memory utilization, latency, error rates, saturation, and throughput. These 'golden signals' ensure that optimizations improve both cost efficiency and application performance.

How does Sedai's approach differ from Azure Advisor and other current solutions?

Sedai's approach is fully autonomous, uses a broader set of metrics (not just utilization), and performs safety checks before making changes. In contrast, Azure Advisor often requires manual effort, uses limited metrics, and does not validate changes for safety, making Sedai's solution more comprehensive and less labor-intensive.

How does Sedai discover and group Azure VMs for optimization?

Sedai discovers your VM infrastructure using cloud APIs, analyzes traffic patterns and VM tags to identify application boundaries, and groups VMs performing similar tasks. This enables collective optimization actions across all instances of an application.

Can Sedai provide an overview of which Azure VMs are over or under-provisioned?

Yes, Sedai provides a dashboard that allows you to scan your VM fleet at a glance, showing which applications are over-provisioned, under-provisioned, or optimized based on Sedai's findings. For example, in one environment, 61% of apps were optimized (shown as green).

What is the pricing model for Sedai's Azure VM optimization service?

Sedai offers flexible pricing based on the scale of your Azure VM deployment and usage levels. For detailed pricing information or a custom quote, you can request a demo directly from Sedai.

How can I get started with Sedai's Azure VM optimization?

You can request a demo to see how Sedai can help rightsize your Azure VMs. The platform supports quick onboarding and offers both agentless and agent-based deployment options.

Where can I find technical documentation for Sedai's Azure VM optimization?

Comprehensive technical documentation is available at docs.sedai.io/get-started, including setup guides, feature explanations, and troubleshooting resources.

What kind of support does Sedai offer for Azure VM optimization customers?

Sedai provides personalized onboarding sessions, a dedicated Customer Success Manager for enterprise customers, detailed documentation, a community Slack channel, and email/phone support to ensure a smooth adoption process.

Features & Capabilities

What are the core features of Sedai's autonomous cloud management platform?

Sedai's platform offers autonomous optimization, proactive issue resolution, full-stack cloud coverage (including Azure VMs), release intelligence, enterprise-grade governance, and multiple modes of operation (Datapilot, Copilot, Autopilot). These features help reduce costs, improve performance, and enhance reliability across cloud environments.

Does Sedai support optimization for other cloud environments besides Azure VMs?

Yes, Sedai supports optimization across AWS, Azure, GCP, and Kubernetes environments, providing a unified solution for multi-cloud and hybrid cloud operations.

What integrations does Sedai offer for monitoring and automation?

Sedai integrates with Cloudwatch, Prometheus, Datadog, Azure Monitor, GitLab, GitHub, Bitbucket, Terraform, ServiceNow, Jira, Slack, Microsoft Teams, and various runbook automation platforms, ensuring seamless workflow integration.

How does Sedai's release intelligence feature benefit Azure VM users?

Sedai's release intelligence tracks changes in cost, latency, and errors for each deployment, helping Azure VM users improve release quality, minimize risks, and ensure smoother deployments.

What modes of operation does Sedai offer for cloud optimization?

Sedai offers three modes: Datapilot (observability), Copilot (one-click optimizations), and Autopilot (fully autonomous execution), allowing organizations to choose the level of automation that fits their needs.

How does Sedai ensure compliance and security for Azure VM optimization?

Sedai is SOC 2 certified, demonstrating adherence to stringent security and compliance standards. The platform integrates with Infrastructure as Code (IaC), IT Service Management (ITSM), and compliance workflows to ensure safe and auditable changes. More details are available on Sedai's Security page.

Use Cases & Business Impact

Who can benefit from Sedai's Azure VM optimization?

Organizations running applications on Azure VMs—especially those with underutilized or overprovisioned resources—can benefit. This includes companies in healthcare, financial services, IT, travel, and more, as well as roles like platform engineering, IT/cloud ops, technology leadership, SRE, and FinOps.

What business impact can I expect from using Sedai for Azure VM optimization?

Customers can expect up to 30% or more in Azure VM cost savings, improved application performance (up to 25% better latency), and up to 90% reduction in operations effort for rightsizing. These outcomes drive operational efficiency and free up engineering resources for innovation.

Can you share a real-world example of cost savings with Sedai's Azure VM optimization?

Yes, a healthcare company identified over $250,000 in annual savings (28%) in its dev/test environments by rightsizing Azure VMs with Sedai's optimization technology.

What pain points does Sedai address for Azure VM users?

Sedai addresses pain points such as overprovisioning, manual and repetitive rightsizing tasks, complexity in VM selection, risk of performance degradation, and lack of actionable insights. The platform automates optimization, reduces costs, and ensures performance and reliability.

How does Sedai help with compliance and audit requirements for Azure VM changes?

Sedai tracks all optimization actions with a full audit trail, integrates with compliance workflows, and ensures that all changes are safe, validated, and reversible, supporting compliance and audit requirements for cloud operations.

What feedback have customers given about Sedai's Azure VM optimization?

Customers have highlighted the simplicity and efficiency of Sedai's platform, quick setup (5–15 minutes), agentless integration, and comprehensive onboarding support as key benefits. The 30-day free trial allows users to experience the platform's value risk-free.

Competition & Differentiation

How does Sedai compare to other Azure VM optimization solutions?

Sedai stands out by offering 100% autonomous optimization, proactive issue resolution, application-aware intelligence, and comprehensive safety checks. Unlike solutions like Azure Advisor, Sedai uses a broader set of metrics, automates the entire process, and ensures safe, validated changes with full auditability.

What makes Sedai's Azure VM optimization unique?

Sedai's uniqueness lies in its autonomous, AI-driven approach, use of golden signals for optimization, safety-by-design philosophy, and ability to reduce both costs and operational effort without manual intervention. The platform's flexibility (agentless/agent-based) and integration with compliance workflows further differentiate it.

What are the advantages of Sedai for different user segments?

Platform engineers benefit from reduced toil and consistent optimization; IT/cloud ops teams see lower ticket volumes and safer automation; technology leaders gain measurable ROI and cost savings; FinOps teams get actionable savings and multi-cloud visibility; SREs experience fewer incidents and less manual work.

Technical Requirements & Implementation

How long does it take to implement Sedai for Azure VM optimization?

For most use cases, Sedai's setup process takes just 5 minutes. For specific scenarios like AWS Lambda, it may take up to 15 minutes. More complex environments may require additional time, and a demo can be scheduled to discuss your setup.

Is Sedai's Azure VM optimization agentless?

Sedai supports both agentless and agent-based deployment options, allowing you to choose the best fit for your environment and security policies.

What technical documentation is available for Sedai's Azure VM optimization?

Technical documentation, including setup guides and feature explanations, is available at docs.sedai.io/get-started. Additional resources such as case studies and datasheets can be found on the resources page.

What security certifications does Sedai hold?

Sedai is SOC 2 certified, ensuring adherence to industry standards for data protection and compliance. More information is available on the Sedai Security page.

Customer Success & Case Studies

Who are some of Sedai's notable customers?

Sedai's customers include Palo Alto Networks, HP, Experian, KnowBe4, Expedia, CapitalOne Bank, GSK, and Avis. These organizations trust Sedai to optimize their cloud environments and improve operational efficiency.

What industries are represented in Sedai's case studies?

Sedai's case studies span industries such as cybersecurity, IT, financial services, healthcare, travel, car rental, retail/e-commerce, SaaS, and digital commerce, demonstrating the platform's versatility and impact across sectors.

Can you share specific success stories of customers using Sedai?

Yes. For example, KnowBe4 achieved up to 50% cost savings in production and saved $1.2 million on their AWS bill. Palo Alto Networks saved $3.5 million and reduced Kubernetes costs by 46%. Belcorp reduced AWS Lambda latency by 77%. More case studies are available on the Sedai resources page.

Sedai Logo

Introducing AI-Powered Automated Rightsizing for Azure VMs

JJ

John Jamie

Content Writer

May 7, 2024

Introducing AI-Powered Automated Rightsizing for Azure VMs

Featured

Summary

  • Azure VMs are poorly utilized. A large scale analysis of Azure virtual machines showed median CPU utilization of 8.2%. Many VMs are oversized, leading to unnecessary costs.  Doubling utilization, which is often possible, halves costs.  
  • Other current solutions like Azure Advisor often (1) require manual effort  (2) do not use the full set of golden metrics to optimize applications (e.g., using utilization metrics only and not considering latency and errors, and (3) do not perform safety checks to validate the change can be made.  
  • Sedai’s Azure VM optimization finds the lowest cost Azure VM type subject to performance and reliability requirements.  It can execute the change for the user, performing a series of safety checks to safely implement the change.
  • Early users of Sedai's optimization technology have seen reductions in cloud costs without impacting application performance.
  • Sedai offers both agentless and agent-based deployment options with pricing based on usage levels.

Introduction

In environments where applications are not suitable for microservices architectures, rightsizing and in particular vertical scaling becomes a critical strategy to achieve cost-effective operations while meeting performance requirements. This approach involves choosing the right virtual machine type based on the CPU and memory resources required. Rightsizing is a known best practices for Azure VM cost optimization but is hard to implement in practice.

The Rightsizing Problem 

Less than 20% of Azure VM capacity is used

Analysis of the most recently released Azure VM usage dataset (available from Microsoft’s Github account here) shows that Azure VM users had an an average utilization of just 8.2%, with 72% of users having an average utilization of below 20% (see distribution below). A common pattern uncovered in the dataset was the selection of a small number of powerful, but oversized VMs.

663a56a2a1b7569ce542697a_E3MdgtlTsQo1FUuyDFcUBxxwWFYakevgsFY8JRFQsA1zfkKFDv0MpQGZJadQCCScuarB0oE6PQwvbgQjblQlyj_xZpS97LmgLh6OHbLOSQpe5_O1WtHTvw4EbxY_ukucJcFd3MYq5F28xJ_AYqBHXh4-1.webp

Source: “Using Virtual Machine Size Recommendation Algorithms to Reduce Cloud Cost”, March 2023

Below is an example from a Sedai Azure customer environment of a heavily underutilized instance with just a few percent of CPU being used across a two day period:

663a56a3b3072ac6f8fc3f93_bXrpKjtwou5_tP3PK8wd96lFIWfB7ch3eUF1BD_xBGgTpNIKV9PLID0IY97F0KHZBYtwIWjhADXf0o0hIXKcthto9UpHxqdyznoNyEU4cfx40NaKBxKJS9b98WvqH6NwHI4rzzuEYEZEjDql7CQEUng-1.webp

This is a customer facing metric.  Azure and other cloud providers achieve higher rates internally due to operating shared environments (AWS reported 65% utilization a few years ago).  The pricing for shared instances reflect this with dedicated instances costing 250% or more.

Causes of Overprovisioning for Azure VMs

Developer Bias to Overprovision

Effective vertical scaling is also important as developers often default to overprovisioning Azure VM resources, opting for a simpler and quicker setup rather than conducting extensive testing across multiple instance types. This approach, while expedient, typically results in selecting VM configurations that exceed the application's actual requirements, leading to increased costs. The reluctance to engage in detailed testing stems from the time and complexity involved in evaluating each instance type's performance under different workloads. Consequently, developers lean towards a 'better safe than sorry' strategy. Although reducing the risk of underperformance thisinefficiently raises cloud costs.

Bursty Workloads

Many Virtual Machine workloads have bursty traffic patterns, especially for small databases, development environments, and low-traffic websites.  For example, in the case below of a dev/test workload CPU utilization stays around 2-4% but surges twice to the 13-15% range. 

663a56a3c93f6c4657075cf9_JGX94IRqOZtHXy8DPK3AI5DXrXknBF0YI-wz61Mkydmo-56sFiWeyIRHitf9cOCaATt-0ttgAnM8vuuctwl1QIHMYDECvlObLiqZNIwSm3zEDz8QlISR8kAOJJpYPqduy8Ycsmfemj7_Ljs5dH5Z5ww-1.webp

Given warmup periods may range from a few minutes to a few hours, horizontal scaling may not be viable.  Finding suitable burstable instance types may be the preferred approach.  In the absence of that, low average utilization will be achieved.

App Architecture Limits Horizontal Scaling

A high proportion of applications running on Azure run directly on virtual machines.  These applications have not been replatformed to a microservice architecture such as Kubernetes (including Azure Kubernetes Service (AKS)), or serverless frameworks (Azure Functions). One key reason is that many of these applications do not benefit significantly from the horizontal scaling capabilities offered by microservices architectures. They may have architectural or design constraints that make such a transition complex or suboptimal, limiting their ability to efficiently use newer computing paradigms.

Complex Set of VM Choices

Vertical scaling is also complicated by the many types of VMs available.  There are currently over 400 types of Azure Virtual Machine options offering varying Compute, Memory and other characteristics.  Below is a chart showing the density of options based on vCPU and Memory size:

663a56a35b7fa813ebfd7e35_cyojHtaJmLpTd6PVa1b5g76faZexOC7_FUA6erfooLrBdifZWRoLWNJ7aminbp8qnss_-WhQEnaLMxA3UxVW6fD7eR6IDLxKy_e2gCevxYWefsmxXWFrx5ny44VT1eS3st-emkaZ7nDR1E309_GUKlc-1.webp

Asking an engineer to make the optimal choice across potentially hundreds or thousands of services can be challenging, especially if new code updates change the service's characteristics and then require a new determination of the right instance type.

Importance of Vertical Scaling for Azure VMs

Vertical scaling is particularly advantageous for applications that require high-performance levels from single instances or have dependencies that complicate distribution across multiple servers. By optimizing the configuration of Azure VMs to align closely with actual workload requirements, organizations can ensure that their applications perform optimally without incurring unnecessary costs from overprovisioning. This method allows for more precise control over resource allocation, leading to enhanced performance and reduced expenditures.

Rightsizing Azure Virtual Machines with Sedai

Key Capabilities

Sedai’s Automated Optimization utilizes advanced AI technology to deeply comprehend Azure VM configurations and their impact on application cost and performance. This results in Azure VMs that are optimally sized and configured to meet the specific needs of applications without incurring unnecessary costs or performance issues. Key benefits include:

  • Cloud Cost Efficiency: Azure VM costs can be reduced by up to 30% or more through optimized resource allocation.
  • Performance Improvement: Enhance customer-facing services with up to 25% better latency, ensuring a smoother user experience.
  • Reduced operations effort.  Time to rightsize VMs is reduce by up to 90%.

Sedai’s Automated Optimization uses advanced AI that not only deeply understands Azure VM configurations and how they are impacting application cost and performance. This results in VMs that are optimally sized and configured to meet the specific needs of their applications without any excess cost or underperformance.

How It Works

Our AI-driven platform continuously analyzes your Azure VMs to detect inefficiencies. It then autonomously implements optimizations, adjusting resources in real-time without requiring manual intervention.

The Sedai platform operates on a simple yet effective process: Discover, Recommend, Validate, Execute, and Track:

  • Discover: Sedai first discovers your Azure VM infrastructure and application pattern, going through three steps:Identifying the app boundary by looking at traffic patterns (e.g., because they use a common load balancer, or by virtual machine tagging). A set of virtual machines doing the same task and expected to behave similarly can be termed an application. This definition means that a collective action will be able be taken on all the instances of the app.Standardizing metrics for optimization.   In a heterogeneous fleet, a service may use Node Exporter for Linux, or WMI Exporter or Windows exporter for Windows. It is important that the metrics are labeled correctly such that the system can precisely identify the metrics of a specific application.Identifying golden signals to drive optimization.  Finding the right signal to listen to can seem like finding a needle in a haystack.  Sedai will look for the best golden metrics (latency, error, saturation, and throughput of an application) so that this information can be used in algorithms and machine learning systems such that a recommendation can be generated.
  • Identifying the app boundary by looking at traffic patterns (e.g., because they use a common load balancer, or by virtual machine tagging). A set of virtual machines doing the same task and expected to behave similarly can be termed an application. This definition means that a collective action will be able be taken on all the instances of the app.
  • Standardizing metrics for optimization.   In a heterogeneous fleet, a service may use Node Exporter for Linux, or WMI Exporter or Windows exporter for Windows. It is important that the metrics are labeled correctly such that the system can precisely identify the metrics of a specific application.
  • Identifying golden signals to drive optimization.  Finding the right signal to listen to can seem like finding a needle in a haystack.  Sedai will look for the best golden metrics (latency, error, saturation, and throughput of an application) so that this information can be used in algorithms and machine learning systems such that a recommendation can be generated.
  • Recommend: then recommends optimal settings based on deep insights into service behavior and dependencies. Recommendations may be provided on a manual basis or occur automatically based on user settings.
  • Validate: After validating potential changes through multiple safety checks, a sequence of steps so that it could be performed safely on the customer environment:Safety check: If there is an action, we need to ask whether this action can be safely performed on that application without risk. If you have a green signal there, you go to the next one.Timing check: We see if it is the right time to apply the action, or is there a later preferred time to execute this particular action on this application?
  • Safety check: If there is an action, we need to ask whether this action can be safely performed on that application without risk. If you have a green signal there, you go to the next one.
  • Timing check: We see if it is the right time to apply the action, or is there a later preferred time to execute this particular action on this application?
  • Execute: Once we have a go-ahead for these validation steps, Sedai goes ahead and performs the action.
  • Learn: After performing the action, we need to figure out if the app is healthy. Updates are also tracked with a full audit trail of changes made to the infrastructure.  This step is also important because this allows us to close our learning loop and use this information for further actions.

These capabilities form part of Sedai’s overall Azure VM optimization approach which can be seen below:

663a56a38adf14844b602631_GWrWtn3m6y1jUYs-WD1jt4UN2PBp987vgVaui8SCRfyrcWIWwXvwYLuT1LpDloAFkjeavEyJfQvoQ2Ax2adLm1uWJEXgU2VoPXz-uPBx20USn1rsW7OQFWAI82JaVnGl-_Cf68BGQfTqdjOZypBWwxI-1.webp

Some of the key elements above are:

  • Access to Cloud APIs which allow Sedai to identify and discover the components of your infrastructure. Sedai’s inference engine actually utilizes this information to build a topology.  With this topology information, we deduce the application. 
  • Metrics exporter & Sedai Core.  With the information about the application, Sedai’s metric exporter takes the data from all the monitoring providers. With the information about the application and the metrics, Sedai machine learning algorithms can generate optimization and remediation opportunities.
  • Execution engine.  The recommendations are given to execution engine. The execution engine is carefully and cohesively integrated to the platform so that it can utilize cloud APIs to perform the actions on the cloud resources.

Example Azure Rightsizing Cost Savings

Early adopters have seen significant improvements in both performance and cost efficiency. For instance, a healthcare company has identified over $250k of annual savings, a 28% saving, in its dev / test environments through rightsizing using Sedai’s optimization.

663a56a38df2990afae1a16d_kbefcNpSrOOUHa2W2LYhKtPneP9O8aAeS1oGOSIKFPFPHD4hte3DkU-SUkBU1-EKHXrItd1oosSJbC7NG9AJw3tD-fLAvKpVYQ1GWtq_W7cwU6gQ2Qm8xy9NTIfKvYUwwu2j9PJ9vXyarIyWZx5WBvI-1.webp

Below is an example of the safety check process being performed during a VM resizing. In this case it took 11 steps, most completed quickly but stopping and restarting the VM taking around 30 seconds each:

673ef57dbeb90457ff894a34_663a5aa46168ec3a9cb166b2_Screenshot-202024-05-07-20at-209.45.08-E2-80-AFAM-1.webp

To gain insights on the state of your VM fleet you can scan it at a glance to see where applications are over or under provisioned as well as optimized based on Sedai’s findings.  The the example below 61% of the apps have been optimized (shown as green).

663a56a4b6a459d3940216ad_5ZJwvSXmi6O84zNUDYm03GMnA5RSap0A_NzWhZbQiilPGeG0IZWkajZvug6sqhX2-K5y1TVwNba44ZrxTiSDCWLd4NKAqEAlHazbgTtIM-ZRPaJh7Z8D6b449fz3OG3niC6R867iUNHj1fTFUq-yKzU-1.webp

Pricing and Availability

The service is available now, with flexible pricing based on the scale of your Azure VM deployment. Request a demo to see how Sedai can hello you rightsize your Azure VMs.