Welcome!

Big Data Journal Authors: Andreas Grabner, Pat Romanski, Elizabeth White, Liz McMillan, Gerry Grealish

Related Topics: Cloud Expo, Java, SOA & WOA, Virtualization, Big Data Journal, SDN Journal

Cloud Expo: Article

Harness APIs to Deliver Competitive Applications in the ‘Cloud of Clouds’

Re‐evaluate your service delivery cycle to see how APIs, cloud, and DevOps can help

Based on Andi Mann's presentation at Cloud Expo 2013 Silicon Valley

IT organizations face a growing demand for faster innovation and new applications to support emerging opportunities in social, mobile, growth markets, Big Data analytics, mergers and acquisitions, strategic partnerships, and more. This is great news because it shows that IT continues to be a key stakeholder in delivering business service innovation. However, it also means that IT must deliver new innovation despite flat budgets, while maintaining existing services that grow more complex every day.

The 'Cloud of Clouds'
This is where cloud computing can help to deliver business outcomes, especially if you look beyond just one or two cloud providers, to the almost limitless variety of interconnected and intermediated cloud services - what I call the 'cloud of clouds'. This is true especially for foundational capabilities - like compute infrastructure, data storage, content delivery, or financial management; and cloud-native services like social media, mobile interfaces, or Big Data analytics. Indeed, it makes little sense today to waste time and resources to rewrite existing code every time you need one of these foundational or cloud-native services. By leveraging the cloud of clouds, developers can instead focus on writing new and unique application code that delivers the competitive advantage the business needs.

APIs in the Cloud of Clouds
This is what a range of innovative startups and services already do. For example:

  • A mashup of the data from cyclists' GPS devices with the Google Maps API has given us the explosively popular cycling tracker, Strava, a new way to track your progress, compete with friends and strangers, follow pros, and manage your own personal records.
  • New York State's Metropolitan Transit Authority (MTA) opened up its APIs to developers in a hackathon-style contest called App Quest, enabling developers to build new mobile apps to help enhance the transit experience of MTA's 8.5 million daily riders.
  • Connecting and mining the cloud newsfeeds of AP, Reuters, AFP, and many others new services around the world via their open APIs and other data feeds, allowed NewsMap to deliver one of my favorite news applications, a dynamic graphical worldwide news 'heat map.'

The key to rapid development of new applications is finding services that fill foundational needs; accessing these services efficiently and safely; and building innovative capabilities on top of them.

Identifying Opportunities in the Cloud of Clouds
Initially, you must identify cloud services that can help you speed your time to value. This means you need to know where your gaps are and where your core competencies are. Project and Portfolio Management (PPM) is a mature discipline with new relevance in the cloud of clouds. PPM solutions like CA Clarity PPM allow you to compare your available internal applications and code with best practices in the external cloud; and to detect and analyze your current cloud service usage to find the 'known good services' that are already delivering value. Using PPM tools that account for cost, risk, performance, uniqueness, criticality, compliance, quality, and more, you can quickly see, for example:

  • Where you have unique and competitive core competencies internally
  • Which existing internal capabilities you should lean on for new development
  • What existing capabilities you should move to the cloud of clouds
  • Where you should double-down on external cloud services you already use
  • What additional services you should source from the cloud of clouds

A formal portfolio analysis allows you to narrow your search and find the best services in the cloud of clouds, beyond the 'usual suspects' (like Amazon Web Services, Google App/Compute Engine, Force.com, or Akamai). Look also at new cloud marketplaces like AppDirect or CloudCommons, at emerging cloud service brokers, and of course at your existing internal IT services.

You can then focus on accessing those services for commodity, mundane, or routine services, and connecting them to your unique code development to deliver competitive new applications. Key elements here include:

  • Integration and interoperability: Making external compute, cloud, and applications look like internal code to your developers is often an integration challenge
  • Security and compliance: Opening up to public or outsourced private cloud will introduce some repeat challenges in moving data and workloads
  • Governance and management: Defining and enforcing policies for how your enterprise consumes interacts with cloud services

Accessing APIs in the Cloud of Clouds
Inevitably, access to these cloud services will be via APIs, so you will need to manage and secure API access. An integrated API security and management solution like CA Layer 7 Gateway accelerates application ROI by addressing a range of API needs - like security, performance, scalability, flexibility, and extensibility. This approach to leveraging APIs helps you to:

  • Connect partners and divisions with each other and with external cloud services
  • Provide secure integration to multiple platforms including mobile and back-end systems
  • Enable internal and external developers to collaborate on code seamlessly

This last point is particularly important. Two-way integration extracts even more value out of your existing capabilities by exposing your existing code to external developers and systems. They can then leverage your strengths and build entirely new services around your core capabilities.

This approach to leveraging the cloud of clouds via existing APIs to deliver new competitive applications will enable multiple business goals - from reach and revenue to agility and access. You can build applications that can reach your customers wherever they are. You can accelerate the pace and quality of new disruptive innovation, improving IT efficiency through reuse and agility. You can enable new applications to fuel the fire of employee mobility, or simply deliver new applications to support new products and services that drive new revenue.

Accelerating Development with a DevOps Approach
However, merely accessing cloud services via open APIs does not ensure rapid application delivery. The final part of this approach is to speed the application development lifecycle, integrating APIs from the cloud of clouds with new approaches to the software development lifecycle (SDLC). By adopting a DevOps approach to the SLDC, you can bring the application portfolio forward to meet market challenges with collaboration and efficiency from design to deployment.

A holistic devops approach to application delivery is a topic for an entirely different post, but the following capabilities will certainly help you on your way:

  • Collaborative Product Planning: Business leaders, development engineers, and system administrators working together to improve collaboration and reduce delays
  • Infrastructure Abstraction and Automation: To automate change, configuration, and provisioning and save time on mundane infrastructure activities
  • Service Virtualization: Virtualizing the entire environment for development, test, and QA so every developer and tester can have every resource they need, all the time
  • Continuous Delivery: Automated code drop (and rollback) to enable rapid iteration that delivers new capabilities in hours, not weeks (or months) to production
  • End‐to‐End Operational Monitoring: Enabling DevOps professionals to detect, diagnose, and resolve problems faster by accelerating problem tracking, identification, and fix

This all fits together into a reiterative closed-loop application delivery lifecycle. Shared portfolio gaps and application requirements feed an agile development process including accelerated test and quality assurance, released rapidly and integrated continuously into production, with real-time operations monitoring to mine performance and capacity data, feeding requirements back into portfolio analysis, ready for the next iteration of the application development.

There is no doubt that a DevOps approach to application delivery helps to deliver better code into production, faster and cheaper. For example, independent research has shown that organizations with a DevOps approach to application delivery have:

  • Improved quality of our deployed applications by 22%
  • Reduced time-to-market for software/services by 20%
  • Reduction spend on development and operations by 18%
  • And increased frequency of software/services deployments by 17%

Getting Started
Where can you start on this transformative journey to delivering new, competitive applications by harnessing APIs and the cloud of clouds? Some of my recommendations would include:

  • Re‐evaluate your service delivery cycle to see how APIs, cloud, and DevOps can help
  • Evaluate how APIs to cloud and internal services can support new innovation
  • Evaluate new processes to connect business, development, and operations teams
  • Evaluate new technologies to support a devops approach to application delivery
  • Improve education, communications, collaboration, and cross‐skilling in both dev and ops
  • Try cloud and API development in a small part of your org, a new project, or skunkworks
  • Leverage cloud APIs in a critical new application that you need to deliver yesterday

Once you see how you can harness APIs to deliver competitive applications in the "cloud of clouds," you will see how this approach will help you support your business partners in their quest for more rapid innovation, delivered through new competitive applications, to support critical new business opportunities.

More Stories By Andi Mann

Andi Mann is vice president of Strategic Solutions at CA Technologies. With more than 20 years’ experience across four continents, he has deep expertise of enterprise software on cloud, mainframe, midrange, server and desktop systems. He has worked within IT departments for governments and corporations, from small businesses to global multi-nationals; with several large enterprise software vendors; and as a leading industry analyst advising enterprises, governments, and IT vendors – from startups to the worlds’ largest companies. Andi is a co-author of the popular handbook, ‘Visible Ops – Private Cloud’; he blogs at ‘Andi Mann – Übergeek’ (http://pleasediscuss.com/andimann), and tweets as @AndiMann.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Cloud Expo Breaking News
MapDB is an Apache-licensed open source database specifically designed for Java developers. The library uses the standard Java Collections API, making it totally natural for Java developers to use and adopt, while scaling database size from GBs to TBs. MapDB is very fast and supports an agile approach to data, allowing developers to construct flexible schemas to exactly match application needs and tune performance, durability and caching for specific requirements.
APIs came about to help companies create and manage their digital ecosystem, enabling them not only to reach more customers through more devices, but also create a large supporting ecosystem of developers and partners. While Facebook, Twitter and Netflix were the early adopters of APIs, large enterprises have been quick to embrace the concept of APIs and have been leveraging APIs as a connective tissue that powers all interactions between their customers, partners and employees. As enterprises embrace APIs, some very specific Enterprise API Adoption patterns and best practices have started emerging. In his session at 14th Cloud Expo, Sachin Agarwal, VP of Product Marketing and Strategy at SOA Software, will talk about the most common enterprise API patterns and will discuss how enterprises can successfully launch an API program.
The social media expansion has shown just how people are eager to share their experiences with the rest of the world. Cloud technology is the perfect platform to satisfy this need given its great flexibility and readiness. At Cynny, we aim to revolutionize how people share and organize their digital life through a brand new cloud service, starting from infrastructure to the users’ interface. A revolution that began from inventing and designing our very own infrastructure: we have created the first server network powered solely by ARM CPU. The microservers have “organism-like” features, differentiating them from any of the current technologies. Benefits include low consumption of energy, making Cynny the ecologically friendly alternative for storage as well as cheaper infrastructure, lower running costs, etc.
Next-Gen Cloud. Whatever you call it, there’s a higher calling for cloud computing that requires providers to change their spots and move from a commodity mindset to a premium one. Businesses can no longer maintain the status quo that today’s service providers offer. Yes, the continuity, speed, mobility, data access and connectivity are staples of the cloud and always will be. But cloud providers that plan to not only exist tomorrow – but to lead – know that security must be the top priority for the cloud and are delivering it now. In his session at 14th Cloud Expo, Kurt Hagerman, Chief Information Security Officer at FireHost, will detail why and how you can have both infrastructure performance and enterprise-grade security – and what tomorrow's cloud provider will look like.
Today, developers and business units are leading the charge to cloud computing. The primary driver: faster access to computing resources by using the cloud's automated infrastructure provisioning. However, fast access to infrastructure exposes the next friction point: creating, delivering, and operating applications much faster. In his session at 14th Cloud Expo, Bernard Golden, VP of Strategy at ActiveState, will discuss why solving the next friction point is critical for true cloud computing success and how developers and business units can leverage service catalogs, frameworks, and DevOps to achieve the true goal of IT: delivering increased business value through applications.
Web conferencing in a public cloud has the same risks as any other cloud service. If you have ever had concerns over the types of data being shared in your employees’ web conferences, such as IP, financials or customer data, then it’s time to look at web conferencing in a private cloud. In her session at 14th Cloud Expo, Courtney Behrens, Senior Marketing Manager at Brother International, will discuss how issues that had previously been out of your control, like performance, advanced administration and compliance, can now be put back behind your firewall.
More and more enterprises today are doing business by opening up their data and applications through APIs. Though forward-thinking and strategic, exposing APIs also increases the surface area for potential attack by hackers. To benefit from APIs while staying secure, enterprises and security architects need to continue to develop a deep understanding about API security and how it differs from traditional web application security or mobile application security. In his session at 14th Cloud Expo, Sachin Agarwal, VP of Product Marketing and Strategy at SOA Software, will walk you through the various aspects of how an API could be potentially exploited. He will discuss the necessary best practices to secure your data and enterprise applications while continue continuing to support your business’s digital initiatives.
The revolution that happened in the server universe over the past 15 years has resulted in an eco-system that is more open, more democratically innovative and produced better results in technically challenging dimensions like scale. The underpinnings of the revolution were common hardware, standards based APIs (ex. POSIX) and a strict adherence to layering and isolation between applications, daemons and kernel drivers/modules which allowed multiple types of development happen in parallel without hindering others. Put simply, today's server model is built on a consistent x86 platform with few surprises in its core components. A kernel abstracts away the platform, so that applications and daemons are decoupled from the hardware. In contrast, networking equipment is still stuck in the mainframe era. Today, networking equipment is a single appliance, including hardware, OS, applications and user interface come as a monolithic entity from a single vendor. Switching between different vendor'...
Cloud backup and recovery services are critical to safeguarding an organization’s data and ensuring business continuity when technical failures and outages occur. With so many choices, how do you find the right provider for your specific needs? In his session at 14th Cloud Expo, Daniel Jacobson, Technology Manager at BUMI, will outline the key factors including backup configurations, proactive monitoring, data restoration, disaster recovery drills, security, compliance and data center resources. Aside from the technical considerations, the secret sauce in identifying the best vendor is the level of focus, expertise and specialization of their engineering team and support group, and how they monitor your day-to-day backups, provide recommendations, and guide you through restores when necessary.
Cloud scalability and performance should be at the heart of every successful Internet venture. The infrastructure needs to be resilient, flexible, and fast – it’s best not to get caught thinking about architecture until the middle of an emergency, when it's too late. In his interactive, no-holds-barred session at 14th Cloud Expo, Phil Jackson, Development Community Advocate for SoftLayer, will dive into how to design and build-out the right cloud infrastructure.
You use an agile process; your goal is to make your organization more agile. What about your data infrastructure? The truth is, today’s databases are anything but agile – they are effectively static repositories that are cumbersome to work with, difficult to change, and cannot keep pace with application demands. Performance suffers as a result, and it takes far longer than it should to deliver on new features and capabilities needed to make your organization competitive. As your application and business needs change, data repositories and structures get outmoded rapidly, resulting in increased work for application developers and slow performance for end users. Further, as data sizes grow into the Big Data realm, this problem is exacerbated and becomes even more difficult to address. A seemingly simple schema change can take hours (or more) to perform, and as requirements evolve the disconnect between existing data structures and actual needs diverge.
SYS-CON Events announced today that SherWeb, a long-time leading provider of cloud services and Microsoft's 2013 World Hosting Partner of the Year, will exhibit at SYS-CON's 14th International Cloud Expo®, which will take place on June 10–12, 2014, at the Javits Center in New York City, New York. A worldwide hosted services leader ranking in the prestigious North American Deloitte Technology Fast 500TM, and Microsoft's 2013 World Hosting Partner of the Year, SherWeb provides competitive cloud solutions to businesses and partners around the world. Founded in 1998, SherWeb is a privately owned company headquartered in Quebec, Canada. Its service portfolio includes Microsoft Exchange, SharePoint, Lync, Dynamics CRM and more.
The world of cloud and application development is not just for the hardened developer these days. In their session at 14th Cloud Expo, Phil Jackson, Development Community Advocate for SoftLayer, and Harold Hannon, Sr. Software Architect at SoftLayer, will pull back the curtain of the architecture of a fun demo application purpose-built for the cloud. They will focus on demonstrating how they leveraged compute, storage, messaging, and other cloud elements hosted at SoftLayer to lower the effort and difficulty of putting together a useful application. This will be an active demonstration and review of simple command-line tools and resources, so don’t be afraid if you are not a seasoned developer.
SYS-CON Events announced today that BUMI, a premium managed service provider specializing in data backup and recovery, will exhibit at SYS-CON's 14th International Cloud Expo®, which will take place on June 10–12, 2014, at the Javits Center in New York City, New York. Manhattan-based BUMI (Backup My Info!) is a premium managed service provider specializing in data backup and recovery. Founded in 2002, the company’s Here, There and Everywhere data backup and recovery solutions are utilized by more than 500 businesses. BUMI clients include professional service organizations such as banking, financial, insurance, accounting, hedge funds and law firms. The company is known for its relentless passion for customer service and support, and has won numerous awards, including Customer Service Provider of the Year and 10 Best Companies to Work For.
Chief Security Officers (CSO), CIOs and IT Directors are all concerned with providing a secure environment from which their business can innovate and customers can safely consume without the fear of Distributed Denial of Service attacks. To be successful in today's hyper-connected world, the enterprise needs to leverage the capabilities of the web and be ready to innovate without fear of DDoS attacks, concerns about application security and other threats. Organizations face great risk from increasingly frequent and sophisticated attempts to render web properties unavailable, and steal intellectual property or personally identifiable information. Layered security best practices extend security beyond the data center, delivering DDoS protection and maintaining site performance in the face of fast-changing threats.