Picture this. Let’s say you’re working in the IT division of an enterprise that has decided to embrace a cloud-first strategy to digitally transform its operations to meet its growth demands.
Now, let’s say the IT leadership team that’s leading the effort has decided to use the opportunity to address some lingering IT-specific issues related to delivery speed, developer productivity, standardization, and technology governance.
In addition, you’ve been tasked with implementing a platform to deliver on those IT-specific objectives. Great!
This is all very exciting, but where to start?
You join your tech friends at your favorite bar that night to celebrate your lucky draw and share the good news. Your friends are all super excited when they hear the news and raise their bottles in a toast.
Now, it starts to get interesting.
As it turns out, one of your friends has just returned from a conference where platform engineering and something called “IDP” was all the rage. He swears this is the answer to your challenge and encourages you to consider building an IDP.
“Really?”, you ask. What the heck is an IDP anyway?
First thing in the morning, you set out to answer that question and to determine how it would help you achieve the objectives you’ve been assigned. Most importantly, you want to establish how quickly you could build an IDP to impress your IT executives.
After starting your search, you realize that the platform engineering and IDP rage your friend spoke about was, in fact, a real thing.
It had even made it to the widely respected Gartner® Hype Cycle and Market Guide reports. The Gartner® “Innovation Insight for Internal Developer Portals” report asserts that “By 2025, 75% of organizations with platform teams will provide self-service developer portals to improve developer experience and accelerate product innovation.”
Interesting.
Another thing you notice when researching is that there doesn’t seem to be much of a consensus regarding what the “P” in IDP means. Does it mean “platform,” as in “Internal Developer Platform?” Or does it mean “portal,” as in “Internal Developer Portal?”
The best answer you find is a clarification attempt offered by Manjunath Bhat, Research VP, Software Engineering Practice at Gartner®. In his 2022 report, “A Software Engineering Leader’s Guide to Improving Developer Experience”, he stated that “Internal developer portals serve as the interface through which developers can discover and access internal developer platform capabilities.”
That’s a great place to start.
But the next question you ask yourself is, “what are the internal developer platform capabilities he speaks of?”
Upon further research, you discover that the broad consensus answer to that question seems to revolve around the concept of “platform orchestration”. Specifically, capabilities that integrate multiple technologies and tools to automate and standardize repeatable processes – without impeding developers’ ability to innovate freely. Examples of such processes are CI/CD tooling and infrastructure provisioning.
Aha!
You’re about to create something that could be truly impactful for your company’s success in accelerating and standardizing its digital application deliveries.
“But, how to refer to the platform?”, you ponder.
You decide to reach out to one of your highly respected mentors for some wisdom. She happens to have vast experience leading R&D organizations and consulting at several large enterprises. After listening to your exciting challenge, she points out how most of the enterprises she had worked with dealt with challenges similar to what you are trying to address.
You exit the discussion by buying into the perspective that developer platform capabilities are a subset of the overall solution that a Platform Engineer enables and that the full value of the solution cannot be realized without the portal.
You conclude it best to consider the IDP as an internal developer portal – given that’s how users access and experience the full value of the solution.
“Life indeed can be truly beautiful”, you mutter to yourself, with a smile.
Now, you have a good idea of what your buddy was referring to as an IDP and have also ascertained through your research that platform engineering is the practice of enabling those capabilities. Naturally, you wonder why he claimed you could build it yourself, so you call to learn more.
He points you in the direction of a platform called Backstage.io – an open-source framework for building developer portals that was created at Spotify. Apparently, this was a big part of the rage at the conference he just returned from.
You figure it would be a great place for you to start building your own IDP, so you jump on the lead right away. Your research quickly reveals that it offers the following essential internal developer portal capabilities – out of the box and through its free and paid marketplace plug-ins:
That’s good, but you wonder where all the other capabilities you were expecting are based on the IDP research you just completed, especially those internal developer platform features.
At this point, it occurs to you that the “build your own IDP” mission your buddy had suggested may not be such a slam-dunk after all.
You embark on a gap analysis exercise to identify some of the other key IDP capabilities that are missing in Backstage. Features that you consider “must haves” in order to achieve the business impact you were aiming at. The high-level list you come up with includes:
Development Portal
Development Platform
Phew! You just realized that building your own IDP does provide you with some level of flexibility, but it begins to dawn on you how quickly this could become a slippery slope.
You ask yourself the obvious question:
“Do I really need to build my own IDP?”
Great question!
Now that you have gathered enough data and realize how much you may be risking your job by blindly acting on building your own IDP, you make the wise decision to explore and consider other alternatives.
You start by evaluating the factors that you would have to contend with if you were to embark on the journey of building your own IDP internally.
You feel even more certain, after completing this evaluation process that you need to explore the “buy” option further.
So, you set out on a discovery process.
One of the first articles you come up with when you begin the research into IDP providers is a report produced by Gartner titled “Innovation Insight for Internal Developer Portals”, authored by Manjunath Bhat and Mark O’Neill.
As it says:
“Product teams often struggle due to disparate tools and disjointed workflows as they
accelerate digital transformation. Software engineering leaders leading platform
teams must establish internal, self-service developer portals to enable consistency
and scale cloud, agile and DevOps initiatives.” See image below.
The article lists Calibo as one of the commercial IDP platforms that should be considered as an alternative to Backstage.io. This piques your interest, and you hop onto the Calibo website to check them out.
Your deep dive into Calibo reveals that their platform already supports the majority of the IDP capabilities you’ve itemized, including the required developer portal and platform orchestration capabilities with 150+ integrations to top-tier technologies.
You also discover that the Calibo platform supports additional capabilities that you hadn’t previously considered – a Data Fabric Studio that empowers data teams to unlock the power of data through intelligent data stack orchestration and automation.
The platform also includes embedded product release orchestration capabilities for product/project release managers to centralize the management and reporting of their agile teams and projects.
“Great!” You exclaim to yourself, acknowledging that this research is turning out to be one of the best moves you’ve made since you started this journey.
But wait! You have one more question:
What if you want the flexibility to implement and extend the capabilities of the platform to address some unique requirements within the business?
Upon further investigation, you discover that Calibo’s platform supports an API strategy that enables both the development of UI widgets and tech stack integration.
You exhale and mutter a silent “Awesome, this will work!” to yourself.
You decide to take the next natural step to request a demo from the website and take the evaluation to the next level.
Good move. You won’t be disappointed.
Want to know more about Calibo? Talk to us.
Are you asking this exact question? You’re not alone! Many IT leaders are on a quest to improve efficiency and spark innovation in their software development and data engineering processes. You may wonder why it’s a good idea to combine an Internal Developer Portal and a Data Fabric Studio – what’s the benefit? What IT…
One thing I love about working in tech is that the landscape is constantly changing. Like the weeping angels in Dr Who – every time you turn back and look – the tech landscape has moved slightly. Unlike the weeping angels, however – this progress is for the betterment of all. (And slightly less murderous).…
Enterprises are feeling increasing pressure to integrate Artificial Intelligence (AI) into their operations. This urgency is pushing leadership teams to adjust their investment strategies to keep up. Recent advancements in Generative AI (GenAI) are further increasing this pressure, as these technologies promise to enhance productivity and efficiency across the organization. For example, Gartner™ expects GenAI…
Calibo enables developers to create UIs and APIs in minutes and deploy them to multiple platforms, including EC2, Kubernetes, or OpenShift. In this blog, we will go through all the steps to create a React web app and a chatbot widget, along with an API using Spring Boot that integrates with the OpenAI API…
One platform, whether you’re in data or digital.
Find out more about our end-to-end enterprise solution.