November 2022
Application modernization has gained new urgency in the post-pandemic era as enterprises rush to take advantage of advanced cloud technologies. Microsoft Azure PaaS delivers on-demand access to a fully managed, cloud-hosted application development platform that developers can build on and use for developing, running, maintaining, and managing applications, which gives them freedom to concentrate on application innovation rather than cloud management.
Microsoft Azure is an open and flexible cloud platform that enables organizations to quickly build, deploy, and manage applications across a global network of Microsoft-managed data centers, which supports the deployment of applications close to customers and users in addition to on-premises and hybrid options.
Microsoft Azure services like Azure App Service, Azure Spring Apps, Azure Logic Apps, Azure Functions, and Azure API Management provide customers with a fully managed application platform as a service (PaaS) for building, deploying, and managing applications of all kinds — from the simplest website to the most complex business solution.
Microsoft commissioned Forrester Consulting to conduct a Total Economic Impact™ (TEI) study and examine the potential return on investment (ROI) enterprises may realize by leveraging Azure PaaS for application modernization.1 The purpose of this study is to provide readers with a framework to evaluate the potential financial impact of Azure PaaS on their organizations.
To better understand the benefits, costs, and risks associated with this investment, Forrester interviewed five representatives with experience using Azure PaaS for application modernization. For the purposes of this study, Forrester aggregated the interviewees’ experiences and combined the results into a single composite organization that is a multinational, industry-agnostic organization managing operations and serving customers with 500 applications, the majority of which are on-premises.
Prior to adopting Azure PaaS, these interviewees’ organizations had varied development environments, and most but not all of which were on-premises. The interviewees noted several common factors that drove their organizations’ decisions to adopt Azure PaaS to host their development environments for modernizing applications. These include being part of a broader strategic initiative, the potential for cost savings, limitations with existing architectures, wanting to take advantage of cloud capabilities, the tight market for tech talent, and prior experience using the Azure PaaS platform.
The interviewees’ organizations took different approaches to deployment. Efforts to modernize and migrate applications also varied depending on the organization’s readiness in terms of framework type and technology stack, complexity, and need for refactoring. While all of the organizations were still in various stages of their application modernization journey and hadn’t achieved full benefit, the interviewees concluded that the investment in Azure PaaS was worthwhile.
Consulting Team: Caro Giordano
Quantified benefits. Three-year, risk-adjusted present value (PV) quantified benefits for the composite organization include:
The composite organization reduces the infrastructure used for application development over time. It has a multiyear migration plan, and it stages retirements after ensuring migrated applications are fully up and running in the Azure PaaS environment. This saves the composite organization more than $19.1 million over three years.
Azure PaaS does not require as many resources as on- premises or IaaS implementations on an ongoing basis. Microsoft handles virtually all server administration tasks (e.g., OS, language patching) in the cloud, which reduces the administrative burden on the composite organization so it can focus on more productive activities. This saves the composite organization $10.3 million over three years.
The Azure PaaS platform and access to related Azure DevOps services enable the composite’s developers to work much more efficiently, saving the organization $7.2 million over three years. Because Azure PaaS provides a more structured environment for modernizing applications, developers spend more time on value-added activities.
The composite organization perceives Azure PaaS as a more resilient platform than on-premises platforms, and developers leverage cloud-native patterns to ensure greater resiliency for their applications. The improvement in application uptime saves the composite organization $3.8 million in avoided revenue losses over three years.
After deploying to Azure PaaS, the composite’s developers work in an integrated DevOps environment. The composite organization increases the speed of application development to production and improvement cycles by 50%, enabling its business to serve customers better. The improved time to market saves $2.8 million over three years.
Unquantified benefits. Benefits that provide value for the composite organization but are not quantified in this study include:
The shift to the Azure PaaS platform and a DevOps approach to development transforms the composite organization’s internal IT and development teams as work moves off on-premises development environments. More automation and tasks managed by Microsoft Azure means more time for these teams to work on other, more value- added activities.
Access to Azure DevOps via the Azure PaaS platform enables developers to reuse code more efficiently.
The composite organization can easily scale up or down and only pay for what it uses, giving it the agility to experiment more freely in its development activities while avoiding costs from overprovisioning IT infrastructure.
Because Azure PaaS relieves developers of infrastructure responsibilities, the composite organization’s developers can focus more intently on application-based innovations that meet customer needs and benefit the business.
The composite organization benefits from the more visible development environment Azure PaaS provides. Logs and audit trails make compliance with coding practices easier, and the Azure PaaS platform makes it easier to roll out and enforce policies and controls.
The composite organization takes advantage of Microsoft’s Cost Management + Billing to monitor and manage cloud costs.
The composite organization attracts and retains talented developers excited to work with cloud technologies on the Azure PaaS platform.
One benefit of having Microsoft manage the platform is gaining access to the latest technology. The composite organization no longer has to worry about out-of- date development infrastructure, applying software updates, or incorporating latest features.
The composite organization takes advantage of Microsoft’s comprehensive resources, architecture best-practice guidance, and technical support to make the most of all that Azure PaaS offers.
Costs.Three-year, risk-adjusted PV costs for the composite organization include:
Microsoft offers several pricing options for Azure PaaS services, including a pay-as-you-go model where the organization only pays for what it needs and can quickly scale up usage during busy times. One-year and three- year savings plan and reserve pricing is also available at a discounted rate for organizations willing to commit to a term agreement. The composite organization commits to a three-year term and pays $1.6 million over three years.
The composite organization spends two months on the planning process and six months developing a landing zone for the Azure PaaS platform, contracting with a professional services firm for advice and assistance in developing the landing zone. The three-year, risk-adjusted PV for these costs comes to $538,000.
The efforts required to migrate and modernize applications vary widely, depending on their readiness for migration, complexity, and need for refactoring. In the scenario where 70% of applications of varying complexity are migrated to the Azure PaaS platform and modernized, the composite organization spends $12.0 million.
The composite organization’s developers take advantage of Microsoft’s Enterprise Skills Initiative (ESI) e-learning platform and Expert Days to upskill. The skills the composite organization’s developers learn benefit the organization on other projects in subsequent years. The three-year, risk-adjusted PV for training time comes to $1.3 million.
The representative interviews and financial analysis found that a composite organization experiences benefits of $43.17 million over three years versus costs of $13.15 million, adding up to a net present value (NPV) of $30.03 million and an ROI of 228%.
The objective of the framework is to identify the cost, benefit, flexibility, and risk factors that affect the investment decision. Forrester took a multistep approach to evaluate the impact that Azure PaaS used for application modernization can have on an organization.
Interviewed Microsoft stakeholders and Forrester analysts to gather data relative to Azure PaaS.
Interviewed five representatives at organizations using Azure PaaS to obtain data with respect to costs, benefits, and risks.
Designed a composite organization based on characteristics of the interviewees’ organizations.
Constructed a financial model representative of the interviews using the TEI methodology and risk-adjusted the financial model based on issues and concerns of the interviewees.
Employed four fundamental elements of TEI in modeling the investment impact: benefits, costs, flexibility, and risks. Given the increasing sophistication of ROI analyses related to IT investments, Forrester’s TEI methodology provides a complete picture of the total economic impact of purchase decisions. Please see Appendix A for additional information on the TEI methodology.
Readers should be aware of the following:
This study is commissioned by Microsoft and delivered by Forrester Consulting. It is not meant to be used as a competitive analysis.
Forrester makes no assumptions as to the potential ROI that other organizations will receive. Forrester strongly advises that readers use their own estimates within the framework provided in the study to determine the appropriateness of an investment in Azure PaaS.
Microsoft reviewed and provided feedback to Forrester, but Forrester maintains editorial control over the study and its findings and does not accept changes to the study that contradict Forrester’s findings or obscure the meaning of the study.
Microsoft provided the customer names for the interviews but did not participate in the interviews.
Role | Industry | Revenue | Region | Applications |
---|---|---|---|---|
Principal technical architect | Professional services | $1B to $5B | Primarily US | 100 |
Head of IT strategy | Insurance | $10B to $25B | Asia | 600 |
Chief technology officer | Insurance | $25B to $50B | Global | 2,500 |
VP of enterprise architecture | Technology | $1B to $5B | Global | 50 |
Service cloud manager | Transportation | $25B to $50B | Europe | N/A |
Prior to migrating to Azure PaaS, the interviewees’ organizations had varied development environments, and most but not all of which were on-premises and mainly supported Windows and Linux applications built using .NET and Java. One organization had already migrated to an IaaS solution hosted on a private cloud and another developed on a mix of on- premises, Kubernetes, virtual machines (VMs), and cloud environments.
The interviewees noted several similar factors that drove their organizations’ decisions to adopt Azure PaaS and modernize their applications, including:
Several interviewees described their organization’s quest to modernize its applications as part of a more comprehensive strategic initiative.
A principal technical architect for a professional services firm said: “The goal was to modernize our legacy systems, modernize our office footprint, and — from a finance perspective — to lower the cost of operations for our retail footprint with a large technology hardware investment in those offices as well as allow us to invest more efficiently in modern systems instead of maintaining several different legacy systems. In addition, there was a goal to create an omnichannel approach where our customers could start their experience with us as a continuum in any different channel. Being able to do that — which wasn’t really possible with distinct and disparate legacy systems — was the initiator.”
A VP of enterprise architecture for a technology firm framed their organization’s drive toward application modernization in terms of customer needs. They said: “We live in a connected world, and our industry is no different. Our customers need easier and faster connections to their vendors and suppliers. Traditional applications that connect to various systems aren’t good enough. We are embarking on a modernization strategy that provides easier connections between various applications within our applications as well as partner applications. Azure PaaS is an integral part to this effort, enabling native connectivity between the apps in ecosystems instead of the traditional custom-built integrations.”
Cost saving, including the financial benefits of shifting from capex to opex, was an important goal for several interviewees’ organizations.
The principal technical architect at the professional services firm explained: “The goal was to rewrite [applications] in the microservices architecture — purely web-based — that allows us to dramatically reduce the technical costs of all the offices. The idea that we would no longer have to have that expensive server, that expensive operating system, [and] all of the maintenance and overhead related to that. Basically, that is the final goal: to simplify the office footprint and take those savings and either invest in other modernization projects or give them back to the business.”
A chief technology officer in the insurance industry whose organization migrated from an IaaS solution hosted on a private cloud to Azure PaaS confirmed that the expected cost saving was a big part of the original calculus to make the change. They said: “From the business benefit point of view, we expected cost saving. There was a business case presented in favor of moving a part of our portfolio of applications — around 300 applications — into the public cloud itself. There was a business case we did where the most benefits were on the cost savings. Of course, there is the element of innovation capabilities, but a big focus was on that cost saving by going into the public cloud.”
Three interviewees noted that infrastructure architecture held their organizations back, mainly regarding release cycles.
The VP for enterprise architecture at the technology firm explained: “There are limitations within our existing client-server-based architecture. We release upgrades to most of our applications once a quarter. These upgrades take longer time to implement as they need to be coordinated between multiple teams across two organizations. It was a hassle. Migrating to PaaS mitigated some of these pain points as we have more control over the hosted network.”
A service cloud manager for a transportation company listed several benefits of the cloud that drove their organization’s decision to migrate and modernize its applications, including performance (e.g., reliability, stability, agility), maintainability, elasticity, scalability, and lower cost.
The speed and ease of deployment were primary drivers for an interviewee who had joined their organization’s technology operations to effect change after working for a startup that benefitted from the PaaS approach.
The head of IT strategy for a different company in the insurance industry said: “The main factor was speed. Because when I was at the startup, I knew how fast I could deploy the system, how easy it was, and the quality of the service and the flexibility and scalability. I can just rely on the [Azure] PaaS platform and reduce the amount of workload without thinking too much about handling infrastructure.”
The chief technology officer of an insurance company said upskilling requirements drove their organization to move from IaaS in a private cloud to Azure PaaS. The interviewee said: “You find a lot of Azure engineers. You don’t find engineers for the private cloud.”
After extensive research and POCs evaluating multiple vendors on features, functionality, and costs, the interviewees’ organizations chose Microsoft Azure PaaS.
Based on the interviews, Forrester constructed a TEI framework, a composite company, and an ROI analysis that illustrates the areas financially affected. The composite organization is representative of the five interviewees, and it is used to present the aggregate financial analysis in the next section. The composite organization has the following characteristics:
The composite is a $20 billion services organization serving businesses and customers worldwide. A team of 1,500 developers is responsible for developing and maintaining 500 applications performing various internal and client- facing functions. Most applications are simple or standard with a steady load of transactions, but 5% are complex and run highly variable workloads with high peak usage during certain times.
After evaluating the IaaS and PaaS offerings of different cloud providers, the composite organization signs a multiyear contract for Microsoft Azure PaaS. The organization invests several weeks into initial planning, working with Microsoft and an external service provider to develop a five-year migration plan. This plan includes an assessment of applications and the development of a landing zone for migrating applications to the cloud. The organization modernizes and migrates 15% of its applications in Year 1, an additional 25% in Year 2, and 30% in Year 3.
Ref. | Benefit | Year 1 | Year 2 | Year 3 | Total | Present Value |
---|---|---|---|---|---|---|
Atr | Application-development-related infrastructure cost savings | $0 | $6,750,000 | $18,000,000 | $24,750,000 | $19,102,179 |
Btr | Application-development-related infrastructure administration efficiencies | $1,004,063 | $3,748,500 | $8,434,125 | $13,186,688 | $10,347,401 |
Ctr | Application-development efficiencies | $0 | $2,008,125 | $7,363,125 | $9,371,250 | $7,191,632 |
Dtr | Revenue loss avoided from improved application uptime | $567,000 | $1,512,000 | $2,646,000 | $4,725,000 | $3,753,020 |
Etr | Revenue gains from faster application production | $420,000 | $1,120,000 | $1,960,000 | $3,500,000 | $2,780,015 |
Total benefits (risk-adjusted) | $1,991,063 | $15,138,625 | $38,403,250 | $55,532,938 | $43,174,247 |
The interviewees’ organizations were able to reduce the infrastructure used for application development over time. Many had multiyear migration plans and staged retirements after ensuring migrated applications were fully up and running in the Azure PaaS environment.
Forrester assumes the following about the composite organization:
Operational differences that may impact the financial benefit associated with application development-related infrastructure cost savings include:
To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $19.1 million.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | ||
---|---|---|---|---|---|---|---|
A1 | Total on-premises infrastructure cost dedicated to application development | Composite | $50,000,000 | $50,000,000 | $50,000,000 | ||
A2 | Reduction in on-premises infrastructure cost as applications are migrated to Azure PaaS | Interviews | 0% | 15% | 40% | ||
At | Application-development-related infrastructure cost savings | A1*A2 | $0 | $7,500,000 | $20,000,000 | ||
Risk adjustment | ↓10% | ||||||
Atr | Application-development-related infrastructure cost savings (risk-adjusted) | $0 | $6,750,000 | $18,000,000 | |||
Three-year total: $24,750,000 | Three-year present value: $19,102,179 | ||||||
View More
View Less
|
Interviewees said Azure PaaS does not require as many resources as on-premises or IaaS implementations on an ongoing basis. Microsoft handles virtually all server administration tasks, so organizations can focus on other activities.
Forrester assumes the following about the composite organization:
Operational differences that may impact the financial benefit associated with application- development-related infrastructure administration efficiencies include:
To account for these risks, Forrester adjusted this benefit downward by 15%, yielding a three-year, risk-adjusted total PV of $10.3 million.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | ||
---|---|---|---|---|---|---|---|
B1 | Systems administrator FTEs supporting application-development- related infrastructure | Composite | 150 | 150 | 150 | ||
B2 | Percentage of applications migrated to Azure PaaS (cumulative) | Composite | 15% | 40% | 70% | ||
B3 | Reduction in infrastructure support after migrating to Azure PaaS | Interviews | 50% | 70% | 90% | ||
B4 | Fully burdened annual compensation for a systems administrator | TEI standard | $140,000 | $140,000 | $140,000 | ||
B5 | Productivity recapture rate for salaried employees | TEI standard | 75% | 75% | 75% | ||
Bt | Application-development-related infrastructure administration efficiencies | B1*B2*B3*B4*B5 | $1,181,250 | $4,410,000 | $9,922,500 | ||
Risk adjustment | ↓15% | ||||||
Btr | Application-development-related infrastructure administration efficiencies (risk-adjusted) | $1,004,063 | $3,748,500 | $8,434,125 | |||
Three-year total: $13,186,688 | Three-year present value: $10,347,401 | ||||||
View More
View Less
|
Interviewees said the Azure PaaS platform and having access to related Azure DevOps services enabled developers to work much more efficiently.
The head of IT strategy for an insurance firm described how their organization’s development team is deploying to the cloud in a much faster way. They said: “It’s four to five times faster. For us to implement a single feature, originally it may have taken us two to three weeks. Now, it’s two to three days.” The interviewee explained that their organization is able to take advantage of microservices and APIs so that if one part of an application is broken, it doesn’t affect the entire application. They said, “We’re getting 90% benefit.”
The service cloud manager for the transportation company said: “Due to the greater reliability and availability of the [Azure] PaaS platform, developers are working faster [and] more efficiently than they were before.” This interviewee could not quantify this benefit, but they feel their organization is now twice as efficient because it has fewer incidents and less downtime. Because Azure PaaS provides a more structured environment for modernizing applications, developers spend more time on value-added activities.
The principal technical architect for the professional services firm explained: “For some of our application PaaS platforms, the teams by design are able to focus on the code and not the platform management itself. They’re not configuring and tweaking the web server, for example. They’re really focusing on the code. And I would say that would be a big [benefit]: the idea that there is less need for some of these ancillary teams like database administrators because you’re able to use and interact with the service. Maybe [it’s] in a more constrained way than you would have an on-premises deployment, but it pushes you into a direction that’s more supportable.”
The VP of enterprise architecture for the technology firm noted that resource provisioning is much simpler with Azure PaaS. They said: “It’s very easy for our engineering teams to provision new technologies for exploration purposes. This enables rapid prototyping and quicker customer feedback. The DevOps team also found Azure PaaS to be valuable to build new deployment pipelines. This drastically reduces our time to build and market solutions.”
Speaking more generally about development efficiencies, this interviewee distinguished more efficient development practices from the actual time spent developing. They said: “Development times are exactly the same, but the process is easier. [With] the traditional model where we developed with the clients or applications, managing those dependencies across the teams was messy. ... The development process is more efficient working on cloud.”
Forrester assumes the following about the composite organization:
Operational differences that may impact the financial benefit associated with application development efficiencies include:
To account for these risks, Forrester adjusted this benefit downward by 15%, yielding a three-year, risk-adjusted total PV of $7.2 million.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |||
---|---|---|---|---|---|---|---|---|
C1 | Application developer team size | Composite | 1,500 | 1,500 | 1,500 | |||
C2 | Percentage of applications migrated to Azure PaaS (cumulative) | Composite | 15% | 40% | 70% | |||
C3 | Percentage of migrated applications impacted by improved productivity (cumulative) | Composite | 0% | 30% | 55% | |||
C4 | Improvement in productivity due to DevOps automation and reuse | Interviews | 0% | 5% | 75% | |||
C5 | Fully burdened annual compensation for an application developer | TEI standard | $140,000 | $140,000 | $140,000 | |||
C6 | Productivity recapture rate for a salaried employee | TEI standard | 75% | 75% | 75% | |||
Ct | Application-development efficiencies | C1*C3*C4*C5*C6 | $0 | $2,362,500 | $8,662,500 | |||
Risk adjustment | ↓15% | |||||||
Ctr | Application-development efficiencies (risk-adjusted) | $0 | $2,008,125 | $7,363,125 | ||||
Three-year total: $9,371,250 | Three-year present value: $7,191,632 | |||||||
View More
View Less
|
The interviewees said the Azure PaaS platform is a more resilient development environment compared to on-premises. Developers leveraged cloud-native patterns to ensure greater resiliency for their applications.
Forrester assumes the following about the composite organization:
Operational differences that may impact the financial benefit associated with revenue loss avoided from improved application uptime include:
To account for these risks, Forrester adjusted this benefit downward by 20%, yielding a three-year, risk-adjusted total PV of $3.8 million.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |||
---|---|---|---|---|---|---|---|---|
D1 | Total revenue | Composite | $20,000,000,000 | $20,000,000,000 | $20,000,000,000 | |||
D2 | Percentage of revenue impacted by application downtime | Composite | 5% | 5% | 5% | |||
D3 | Percentage of downtime per year prior to Azure PaaS | Interviews | 7.5% | 7.5% | 7.5% | |||
D4 | Reduction in downtime with Azure PaaS | Composite | 90% | 90% | 90% | |||
D5 | Percentage of applications migrated to Azure PaaS (cumulative) | Composite | 15% | 40% | 70% | |||
D6 | Revenue loss avoided from improved application uptime | D1*D2*D3*D4*D5 | $10,125,000 | $27,000,000 | $47,250,000 | |||
D7 | Operating margin | Composite | 7% | 7% | 7% | |||
Dt | Revenue loss avoided from improved application uptime | D6*D7 | $708,750 | $1,890,000 | $3,307,500 | |||
Risk adjustment | ↓20% | Ad culpa | Anim ullamco | Veniam duis | ||||
Dtr | Revenue loss avoided from improved application uptime (risk-adjusted) | $567,000 | $1,512,000 | $2,646,000 | ||||
Three-year total: $4,725,000 | Three-year present value: $3,753,020 | |||||||
View More
View Less
|
Most of the interviewees’ organizations were able to increase the speed of application development to production and improvement cycles as a result of migrating to Azure PaaS, enabling their organizations to better serve customers. Although, for some, this is still a work in progress.
Forrester assumes the following about the composite organization:
Operational differences that may impact the financial benefit associated with revenue gains from faster application production cycles include:
To account for these risks, Forrester adjusted this benefit downward by 20%, yielding a three-year, risk-adjusted total PV of $2.8 million.
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |||
---|---|---|---|---|---|---|---|---|
E1 | Total revenue | Composite | $20,000,000,000 | $20,000,000,000 | $20,000,000,000 | |||
E2 | Percentage of revenue enhanced by time to market improvements | Composite | 0.5% | 0.5% | 0.5% | |||
E3 | Percentage of applications migrated to Azure PaaS (cumulative | Composite | 15% | 40% | 70% | |||
E4 | Time to market improvements with Azure PaaS | Interviews | 50% | 50% | 50% | |||
E5 | Revenue gains from faster application production | E1*E2*E3*E4 | $7,500,000 | $20,000,000 | $35,000,000 | |||
E6 | Operating margin | Composite | 7% | 7% | 7% | |||
Et | Revenue gains from faster application production | E5*E6 | $525,000 | $1,400,000 | $2,450,000 | |||
Risk adjustment | ↓20% | |||||||
Etr | Revenue gains from faster application production (risk- adjusted) | $420,000 | $1,120,000 | $1,960,000 | ||||
Three-year total: $3,500,000 | Three-year present value: $2,780,015 | |||||||
View More
View Less
|
Interviewees mentioned the following additional benefits that their organizations experienced but were not able to quantify:
Interviewees said the shift to the Azure PaaS platform and an integrated DevOps approach to development had a profound impact on their organizations’ internal IT and development teams as work moved off on-premises development environments. More automation and tasks managed by Microsoft Azure meant more time available for these teams to work on other, more value-added activities.
The VP for enterprise architecture at the technology firm said: “It’s fully automated with reporting and end-to-end visibility to our developers. It was a game-changer because the developers don’t worry much about deployments anymore. The DevOps teams help the engineers through the deployment journey including setting up monitors, etc. In the traditional deployment model, the engineers don’t have too much visibility beyond delivery. In the newer model, the developers get to see how their applications respond and behave in various situations. They can proactively identify and work on issues instead of being manually notified by the end user or a support agent.”
The principal technical architect for the professional services firm described how day-to- day work has changed. They said: “It’s been a big cultural shift. One of the things that we Instituted at about two-and-a-half or three years ago was a self-service model. They’re maintaining a platform that allows the application teams to deploy their own cloud infrastructure, their own SQL servers, their own VMs, [and] their own platform-as-a-service app services. They have shifted more to enabling technologies versus doing the work of building platforms, like monitoring platforms and cloud delivery services, and then helping enable the teams to be self- sufficient.”
This interviewee summed it up by saying: “It is a dramatic difference. Now you’re now focusing at a higher level of operations. The database team, for those that are running all on [Azure] PaaS, can be focused entirely on database performance, tuning, [and] indexing. Application teams are not worrying about the runtime version. They can use any of the runtime versions by invoking them and, then once a month, they’ll just get patched for them. You really focus your effort on automation and repeatable deployment in the best practice and far less on the day-to-day maintenance.”
Interviewees said developers needed to learn new ways of working in the PaaS environment. The chief technology officer of an insurance company said: “[Before,] we had a central team providing services, which the business applications team used. None of the business applications teams had to worry about security or infrastructure stuff. The moment we went into Azure PaaS with a full federated model as we initially did, all of the teams were suddenly on the hook for the security aspects and some infrastructure-related aspects regarding the use of database services, etc.”
Access to Azure DevOps via the PaaS platform enabled developers to reuse code more efficiently. The head of IT strategy for an insurance company explained: “With Azure DevOps, we are able to do more reuse of code [and] reuse of architecture. We are trying to see how we can avoid reinventing the wheel again and again. We improve the infrastructure and then we think about how we can reuse our existing architecture or reuse existing code.”
Reuse of code was also a key objective for the chief technology officer at another insurance firm. They said: “We want to modernize everything we bring into he public cloud [and] really reengineer it in a way to make it API-first to make sure whatever we build is only built once and can be reused. The cloud helps with that reusability.”
Interviewees liked the fact that their organizations could easily scale up or down and only pay for what they use, giving them the agility to experiment more freely in their development activities while avoiding overprovisioning costs.
Because Azure PaaS relieves developers of infrastructure responsibilities, the composite organization’s developers can focus more intently on application-based innovations that meet customer needs and benefit their business.
For the chief technology officer at the insurance company, “It’s the innovation capabilities you get through all the parts coming together, which enables you to focus on the business applications. You don’t have to worry about infrastructure topics. We still have to worry a little bit about security, although the environment helps us.”
This interviewee explained: “Digitalization eventually arrived in the insurance industry. While a lot of our applications we are building for our in-house clients, more and more there are software offerings we make to the outside world, to our clients, to our brokers, et cetera, so a lot of the concepts like multi-tenancy or API-first has become super relevant for us. And definitely, let’s also make sure we can offer it to the outside world as an investor-published API or service, for instance. That is, of course, where Azure PaaS platform helps us find the time to do this technically and securely, by providing access management in the right way.”
The VP of enterprise architecture at the technology firm also described an initiative to integrate applications to facilitate information exchange for their organization’s customers, and they credited Azure PaaS with helping to make that happen. They said: “Azure provides Power Automate, a low-code/no-code tool where you can drag and drop connectors and then easily write information into an API. I don’t have to have a developer hand-coding these connectors. I can just simply drag and drop and, with some simple configuration, share information in any format. That is very key ... It’s basically enabled the teams. If we decide to invest in a concept, we can find what works and [what] doesn’t work much faster. ... As you move to these autonomous squads, the teams can do experimentation. They can find out if something in the market works a lot faster. Instead of making two moon shots every year, you’re able to get out there with 10 or 15 or 20. It does pay off in the long term, having the ability to find out what works. If you think about how that can manifest itself in meeting business challenges and needs, what I can tell you is that’s an easily measurable outcome of our cloud journey.”
Some but not all interviewees agreed that Azure PaaS provides a more secure environment for development. While audit trails make compliance a more straightforward process, cloud-based security requires a change in mindset that some interviewees’ organizations struggled with.
The interviewees’ organizations relied on a combination of tools, including Microsoft’s Cost Management + Billing to monitor and manage cloud costs.
Interviewees said one benefit of having Microsoft manage their organization’s platform was gaining access to the latest technology, which one interviewee felt was harder to do when their company managed its environment itself.
The principal technical architect of the professional services firm said: “[We now have the] ability to take advantage of those things that are released in monthly life cycles by the cloud providers. [We] don’t have to do anything. [We] just get it, whether it be something kind of boring — like new backup capabilities or new cost reduction opportunities to new capabilities — that allow us to do things that we couldn’t do before. Of all the things [and] the biggest picture, that’s the biggest benefit. We can talk about auto-scale and other business attributes, but the idea that we get to take advantage of these enormous, probably historic, investment scales is pretty great.”
All of the interviewees felt the Azure PaaS platform had a positive impact on their organization’s ability to recruit and retain developers.
Interviewees had good things to say about Microsoft’s support services.
The VP of enterprise architecture for the technology firm said: “We get great support from Microsoft. Our account manager has been excellent. We usually get in touch with the right resources within a day to discuss any problems or new ideas we may have. In addition, we have a standing biweekly meeting to discuss and bounce ideas for new product development successes. It has tremendously helped us build products faster.”
The value of flexibility is unique to each customer. There are multiple scenarios in which a customer might implement Azure PaaS and later realize additional uses and business opportunities, including:
The interviewees anticipated future benefits of their organizations’ investments in Azure PaaS to come from innovation.
The interviewees said their organizations were still in the process of migrating applications to the cloud.
Some of the interviewees’ organizations had already deployed or were actively exploring how to operate in multiple clouds to augment their core applications running on Azure PaaS and to avoid lock-in effects.
The head of IT strategy for an insurance company mentioned that their organization is exploring options for migrating AS 400 mainframes in Azure.
The head of IT strategy for an insurance company said: “Our next step is trying to automate with [Azure] PaaS. The ability to optimize and automate most processes and reduce manual work is definitely a good way to go.”
Flexibility would also be quantified when evaluated as part of a specific project (described in more detail in Appendix A).
Ref. | Costs | Initial | Year 1 | Year 2 | Year 3 | Total | Present Value |
---|---|---|---|---|---|---|---|
Ftr | Azure PaaS costs | $0 | $249,997 | $642,040 | $1,136,352 | $2,028,389 | $1,611,639 |
Gtr | Planning and landing-zone development costs | $538,462 | $0 | $0 | $0 | $538,462 | $538,462 |
Htr | Application migration costs | $0 | $2,635,190 | $4,127,254 | $5,235,568 | $11,998,012 | $9,740,140 |
Itr | Training costs | $0 | $331,650 | $552,750 | $663,300 | $1,547,700 | $1,256,665 |
Total costs (risk-adjusted) | $538,462 | $3,216,838 | $5,322,043 | $7,035,220 | $16,112,563 | $13,146,906 |
Microsoft offers several pricing options for Azure PaaS services. One is a pay-as- you-go model where the organization only pays for what it needs and is able to quickly scale up at busy times. One-year and three-year savings plans and reserve pricing are also available at a discounted rate for organizations willing to commit to a term agreement.
Organizations can pay costs as part of a variety of licensing agreements. However, an organization might pay these costs monthly, quarterly, or annually as part of a multiyear agreement or a pay-as-you-go contract. They also might pay them in advance.
Two of the interviewees said their organization received discounted pricing from Microsoft. The chief technology officer of an insurance company said their organization’s contract was linked to consumption targets with certain consumption milestones triggering discounts. This led the organization to initially prioritize applications for migration and modernization based on its ability to reach those targets instead of basing decisions on business value. The chief technology officer said: “In hindsight, I probably would have done it slightly differently. We are still on that contract, but we threw out all the activities we did. We actually reached our consumption targets, so we are off the hook for consumption. That’s why we could make the change. Our contract is coming up for renewal pretty soon. That's where we now need to figure out what is the way forward.”
Forrester assumes the following about the composite organization:
Operational differences that may impact the costs associated with Azure PaaS services include:
To account for these risks, Forrester adjusted this cost upward by 20%, yielding a three- year, risk-adjusted total PV (discounted at 10%) of $1.6 million.
Ref | Metric | Source | Initial | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|---|
F1 | Number of applications migrated to Azure PaaS (cumulative) | Composite | 75 | 200 | 350 | ||
F2 | Percentage of high demand applications | Composite | 5% | 5% | 5% | ||
F3 | Number of high demand applications migrated to Azure PaaS (cumulative) | F1*F2 | 4 | 10 | 18 | ||
F4 | Instances required for high-demand applications | Microsoft | 16 | 40 | 72 | ||
F5 | P2v3 3-year reserve pricing per instance per year | Microsoft | $3,382 | $3,382 | $3,382 | ||
F6 | Subtotal: Azure PaaS subscription fees for high-demand applications | F4*F5 | $0 | $54,112 | $135,280 | $243,504 | |
F7 | Percentage of standard applications | Composite | 30% | 30% | 30% | ||
F8 | Number of standard applications migrated to Azure PaaS (cumulative) | F1*F7 | 23 | 60 | 105 | ||
F9 | Instances required for standard applications | Microsoft | 23 | 60 | 105 | ||
F10 | P2v3 3-year reserve pricing per instance per year | Microsoft | $3,382 | $3,382 | $3,382 | ||
F11 | Subtotal: Azure PaaS subscription fees for standard applications | F9*F10 | $77,786 | $202,920 | $355,110 | ||
F12 | Number of simple/shared applications migrated to Azure PaaS (cumulative) | F1-(F3+F8) | 48 | 130 | 227 | ||
F13 | Instances required for simple/shared applications | Microsoft | 5 | 13 | 23 | ||
F14 | P2v3 3-year reserve pricing per instance per year | Microsoft | $3,382 | $3,382 | $3,382 | ||
F15 | Subtotal: Azure PaaS subscription fees for simple/shared applications | F13*F14 | $0 | $16,910 | $43,966 | $77,786 | |
F16 | Other Azure PaaS services | (F6+F11+F15) *30% | $0 | $44,642 | $114,650 | $202,920 | |
F17 | Azure PaaS maintenance and support | (F6+F11+F15) *10% | $0 | $14,881 | $38,217 | $67,640 | |
Ft | Azure PaaS costs | F6+F11+F15+F16+F17 | $0 | $208,331 | $535,033 | $946,960 | |
Risk adjustment | ↑20% | ||||||
Ftr | Azure PaaS costs (risk-adjusted) | $0 | $249,997 | $642,040 | $1,136,352 | ||
Three-year total: $2,028,389 | Three-year present value: $1,611,639 | ||||||
View More
View Less
|
The interviewees’ organizations took different approaches to deployment, although most started with an assessment and development of a roadmap staging the migration process. Most of the organizations involved Microsoft and, at times, they used external partners in these efforts.
The principal technical architect at the professional services firm said: “One of the first steps we took was to put a good foundation in place. We had to get some of the boring stuff out of the way first: network design, naming conventions, and subscription design. We all got in a room and had a decision register and went through it all — everything from the mundane to the critically important — and we ended up putting a landing zone in place before we deployed any assets. That’s something [that], in hindsight, was probably one of our most important decisions. ... What we felt, in the beginning, was that we would have a road map in our approach to get to the cloud, which was really about migrating some workloads, making as few changes as possible, understanding how to operate into the cloud, and then starting to abstract ourselves to more and more up the stack. But we also knew that whether some services were not ready for us or we were not ready for some services, it was important for us to start with migrating workloads and getting learnings. We felt that that was key instead of simply saying, ‘We're going to figure everything out before we get started.’ We took the leap to do a lift and shift with a couple of applications. I'm not sure we made any application changes. I don’t think we made any operating system changes.”
The chief technology officer at an insurance company said their organization also assessed its application portfolio with Microsoft at the onset of deployment, but it later came to realize the process was flawed. They said: “We assessed what we called low and medium complex applications, which we said we wanted to move into the public cloud. This assessment focused on the complexity and achieving certain consumption levels in the Microsoft cloud.”
This became a problem later when the organization realized the migrated applications were not automatically aligned to business value, and cost savings were not coming through, which forced a change to the approach. The interviewee said: “We still believe we need to want to continue that journey on the public cloud for a lot of good reasons. ... We don’t just count how many applications we’ve moved into the [Azure] PaaS platform. We now really do it where the business wants to invest. This might also include large and complex applications that we wanted to move into the public cloud in the next few years anyway. We just shifted away from counting applications into having a very clear reason for bringing something into the public cloud.”
In contrast to the other interviewees, the head of IT strategy at an insurance company said their organization dove right in with minimal preparation. They said, “In the beginning, in 2018, it was only me with one single application, which is why I didn’t set up a landing zone.” The organization later hired a new CTO who directed the team to embark on a broader application modernization strategy, at which point the organization brought in Microsoft and an outside partner to do an assessment and develop a migration plan that it is currently following.
Forrester assumes the following about the composite organization:
Operational differences that may impact the costs associated with planning and landing zone development include:
To account for these risks, Forrester adjusted this cost upward by 10%, yielding a three- year, risk-adjusted total PV of $538,000.
Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|---|
G1 | Professional services to advise planning and landing zone development | Interviews | $25,000 | ||||
G2 | Planning hours | Interviews | 1,733 | ||||
G3 | Landing zone development hours | Interviews | 5,200 | ||||
G4 | Blended fully burdened hourly compensation for those involved in planning and migration | TEI standard | $67 | ||||
Gt | Planning and landing-zone development costs | G1+(G2+G3)*G4 | $489,511 | $0 | $0 | $0 | |
Risk adjustment | ↑10% | ||||||
Gtr | Planning and landing-zone development costs (risk-adjusted) | $538,462 | $0 | $0 | $0 | ||
Three-year total: $538,462 | Three-year present value: $538,462 | ||||||
View More
View Less
|
The interviewees described a wide range of efforts required to modernize and migrate applications to Azure PaaS, depending on their organization’s readiness, complexity, and need for refactoring.
The chief technology officer for the insurance company said: “It took a full year and took around 60 to 90 people overall [to migrate 30 to 50 applications]. For every application, it was only half a squad [or] half a team doing it, although some had one or two teams on it. Some were easier and were done in just three months or so. Per application, [it averaged to] one team doing it. ... We already figured out that you cannot leave the teams completely alone. We have sent to the teams those with deep Azure migration expertise who consultant or actively engage in the transformation. We have a group, one Center of Excellence for Azure, which has around 10 to 15 people. Then, for every domain, we enhanced that team with another five to six people who have domain knowledge. In addition to these expert teams, there is the expert application teams that review the applications. Per application, it’s probably an average of three to four people, depending on the complexity of the application.”
In contrast, the head of IT strategy for an insurance company said: “It was 6 months, full time, for [my organization]. I fully deployed the first app in six months, including two months for setup.”
This interviewee added that migrating applications has gotten easier and faster over time. They said: “[Before], it took around four months to do such a migration, but now it’s simple. We created a similar instance, and it would be ready within three days. [Now,] it takes only three days for us to migrate one gigantic project.”
Forrester assumes the following about the composite organization:
Operational differences that may impact the costs associated with application migration include:
To account for these risks, Forrester adjusted this cost upward by 20%, yielding a three- year, risk-adjusted total PV of $9.7 million.
Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|---|
H1 | Number of applications migrated to Azure PaaS (in a given year) | Composite | 75 | 125 | 150 | ||
H2 | Number of high demand applications migrated to Azure PaaS (in a given year) | F3 | 4 | 6 | 8 | ||
H3 | Average hours spent per migration for high demand applications | Interviews | 4,160 | 4,160 | 4,160 | ||
H4 | Subtotal: Hours spent to migrate complex applications | H2*H3 | 16,640 | 24,960 | 33,280 | ||
H5 | Number of standard applications migrated to Azure PaaS (in a given year) | F8 | 23 | 37 | 45 | ||
H6 | Average hours spent per migration for standard applications | Interviews | 520 | 520 | 520 | ||
H7 | Subtotal: Hours spent to migrate standard applications | H5*H6 | 11,960 | 19,240 | 23,400 | ||
H8 | Number of simple applications migrated to Azure PaaS (in a given year) | F12 | 48 | 82 | 97 | ||
H9 | Average hours spent per migration for simple applications | Interviews | 87 | 87 | 87 | ||
H10 | Subtotal: Hours spent to migrate simple applications | H8*H9 | 4,176 | 7,134 | 8,439 | ||
H11 | Fully burdened hourly compensation for an application developer | TEI standard | $67 | $67 | $67 | ||
Ht | Application migration costs | (H4+H7*H10) | $2,195,992 | $3,439,378 | $4,362,973 | ||
Risk adjustment | ↑20% | ||||||
Htr | Application migration costs (risk-adjusted) | $0 | $2,635,190 | $4,127,254 | $5,235,568 | ||
Three-year total: $11,998,012 | Three-year present value: $9,740,140 | ||||||
View More
View Less
|
Interviewees said their organizations’ developers took advantage of Microsoft’s ESI e-learning platform and Expert Days to upskill. Interviewees said the upskilling of the developer community will benefit their organizations on other projects in the coming years.
The cloud services manager for the transportation company said: “The ramp-up took time to train the developers and convince them of the benefits of using PaaS versus IaaS. The ESI e-learning platform helps our employees discover and deepen their knowledge of the various [Azure] PaaS services.”
The principal technical architect for the professional services firm noted the effort required for upskilling, particularly at the beginning of the application migration and modernization initiative. They said: “The effort to upskill and train and prepare is an extra-large effort. The world is different in the public cloud, and one of the things that that had probably limited us in the beginning couple of years of our journey was people.”
The chief technology officer at an insurance company said upskilling developers remains a challenge for their organization. They said: “There’s a lot of upskilling required on how to build stuff in a public cloud environment rather than on-prem and private cloud that is not to be underestimated.... There are training offerings from Microsoft, certificates, and such, which we pushed heavily. We pay a flat fee to access Microsoft’s Enterprise Skills Initiative, so we have free offerings for our employees to get certified. This was bundled into the offering, for a flat fee, open to all the employees, so everyone could do as many certificates and [as much] learning and class training as they wanted. We used gamification, who gets more certificates, and that sort of stuff. It was important and good.”
This interviewee then explained that their organization created an internal Center of Excellence for Azure PaaS to help with upskilling. They said: “The certificate gives you a little bit of theoretical know-how and the context and the big picture. What we really figured out is having a central team — the Center of Excellence people who have done this before — who know it inside and out and have the expertise we need to upskill our people.”
Forrester assumes the following about the composite organization:
Operational differences that may impact the cost associated with training include:
To account for these risks, Forrester adjusted this cost upward by 10%, yielding a three- year, risk-adjusted total PV of $1.3 million
Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|---|
I1 | Number of developers trained per year | Composite | 225 | 375 | 450 | ||
I2 | Average hours spent training related to application modernization | Composite | 20 | 20 | 20 | ||
I3 | Fully burdened hourly compensation for an application developer | TEI standard | $67 | $67 | $67 | ||
It | Training costs | I1*I2*I3 | $301,500 | $502,500 | $603,000 | ||
Risk adjustment | ↑10% | ||||||
Itr | Training costs (risk-adjusted) | $0 | $331,650 | $552,750 | $663,300 | ||
Three-year total: $1,547,700 | Three-year present value: $1,256,665 | ||||||
View More
View Less
|
These risk-adjusted ROI, NPV, and payback period values are determined by applying risk-adjustment factors to the unadjusted results in each Benefit and Cost section.
Initial | Year 1 | Year 2 | Year 3 | Total | Present Value | |
---|---|---|---|---|---|---|
Total costs | ($538,462) | ($3,216,838) | ($5,322,043) | ($7,035,220) | ($16,112,563) | ($13,146,906) |
Total benefits | $0 | $1,991,063 | $15,138,625 | $38,403,250 | $55,532,938 | $43,174,247 |
Net benefits | ($538,462) | ($1,225,775) | $9,816,582 | $31,368,030 | $39,420,375 | $30,027,341 |
ROI | 228% | |||||
Payback | 15 months | |||||
View More
View Less
|
The financial results calculated in the Benefits and Costs sections can be used to determine the ROI, NPV, and payback period for the composite organization’s investment. Forrester assumes a yearly discount rate of 10% for this analysis.
Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists vendors in communicating the value proposition of their products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of IT initiatives to both senior management and other key business stakeholders.
Benefitsrepresent the value delivered to the business by the product. The TEI methodology places equal weight on the measure of benefits and the measure of costs, allowing for a full examination of the effect of the technology on the entire organization.
Costsconsider all expenses necessary to deliver the proposed value, or benefits, of the product. The cost category within TEI captures incremental costs over the existing environment for ongoing costs associated with the solution.
Flexibilityrepresents the strategic value that can be obtained for some future additional investment building on top of the initial investment already made. Having the ability to capture that benefit has a PV that can be estimated.
Risksmeasure the uncertainty of benefit and cost estimates given: 1) the likelihood that estimates will meet original projections and 2) the likelihood that estimates will be tracked over time. TEI risk factors are based on “triangular distribution.”
The initial investment column contains costs incurred at “time 0” or at the beginning of Year 1 that are not discounted. All other cash flows are discounted using the discount rate at the end of the year. PV calculations are calculated for each total cost and benefit estimate. NPV calculations in the summary tables are the sum of the initial investment and the discounted cash flows in each year. Sums and present value calculations of the Total Benefits, Total Costs, and Cash Flow tables may not exactly add up, as some rounding may occur.
“Forrester’s Application Modernization And Migration Services Buyer’s Guide, 2022”, Forrester Research, Inc., August 5, 2022
“New Tech: Infrastructure As Code, Q1 2022,” Forrester Research, Inc., February 14, 2022
“Monoliths Benefit From Both Containers And Microservices,” Forrester Research, Inc., October 29, 2021
“Now Tech: Application Modernization And Migration Services, Q1 2021”, Forrester Research, Inc., March 9, 2021
1 Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists vendors in communicating the value proposition of their products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of IT initiatives to both senior management and other key business stakeholders.
Cookie Preferences
Accept Cookies
A cookie is a small text file that a website saves on your computer or mobile device when you visit the site. It enables the website to remember your actions (data inputs, website navigation), so you don’t have to re-enter data when you come back to the site or browse from one page to another.
Behavioral information collected by our web analytics vendor is used to analyze data pertaining to visitor trends, plan website enhancements, and measure overall website effectiveness. We may also use cookies or web beacons to help us offer you products, programs, or services that may be of interest to you and to deliver relevant advertising. We may use third-party advertising companies to help tailor website content to users or to serve ads on our behalf. These companies may also employ cookies and web beacons to measure advertising effectiveness.
Please accept cookies and the collection of behavioral information to receive full functionality and enhance your experience. If you decline cookies, some features of the website may not function normally.
Please see our
Privacy Policy for more information.