Welcome!

@DXWorldExpo Authors: Elizabeth White, Zakia Bouachraoui, Liz McMillan, Pat Romanski, Carmen Gonzalez

Related Topics: @DXWorldExpo, Java IoT, Microservices Expo, Containers Expo Blog, @CloudExpo, SDN Journal

@DXWorldExpo: Article

Big Data Analytics Without Complications and Expenses

Cloud technology can make data analytics available to a whole new set of customers and applications

Cloud computing attention is often paid to moving compute requirements from the enterprise data center to public clouds. While the technology enables a number of innovative solutions around mobile and social environments, analytics is often seen as an in-house solution that requires highly specialized skills.

Cloud providers have upped their game in data analytics. No longer are they just providing you with an environment, managing the underlying machines, they are now managing underlying systems - systems specific to your needs like Big Data. This fits well with mid-sized companies that are hungry for analytic solutions to enable them to compete with large enterprise competitors.

Recently, I sat down with Jonathan Pickard of Analyzer 1. Jonathan has worked on both the business side and IT side to create game changing business intelligence solutions, for some of the largest enterprises. Focusing on rapid delivery, the cloud has been a game changer for Analyzer 1. As cloud BI solutions have begun to mature, Jonathan said, “we can now safely and effectively deliver to our clients at a pace never seen before.” I put together some questions for him:

Should an organization create big data systems themselves or use the cloud?
It depends. Let's consider a database your company will use for big data analytics and ask these questions. Do you have a data security plan established in case of a machine outage, building fire or network attack? Have a plan to update all the layers of you system, that's fast and non-disruptive; including hardware updates, network updates, OS updates, and database updates. Do you know the best practices associate with configuring your specific machine and database? Do you have multiple people that can be fully committed to the management the database and fix any unforeseen issues? This is just the tip of the iceberg for managing one component of your analytic system, not including associated management and planning issues.

How can the cloud help a company with Big Data analytics?
Well again let's look at a database, in this case an analytical database, Amazon Redshift. Redshift is a technology disruptor, for several reasons: analytic processing power, ease of management, and price ~ $1000 per TB per year. For people that are used to working in a larger company, they may be shocked at this price point. This is not only the price for the database per terabyte, we're including the management of the underlying systems: facility, redundancy, maintenance, upgrades, and security features. Plus, like other systems in Amazons Web Services, it offers an easy management system that can be up and running within minutes. Typically, I demo the setup of a complete analytical system in less than 2 hours using AWS that includes the setup of a secure environment setup, ETL, analytical database, and analytical application.

What kind of organization is the cloud for?
An all-in cloud strategy is not for everyone, if you are a very large company and want to make BI, and analytics a core competency, you may want to consider developing in house. However, this includes paying for the best people in the industry, as well as all the infrastructure costs that go into running such system. While it may seem like in the long run, you may save money, you still have to dedicate your time, resources and staff to managing such infrastructure instead of putting those resources towards projects that differentiate your business. Speed is another issue. Already have systems locally associated with big data? Then you may need to move those systems into the cloud as well; else you could face bandwidth or even speed of light issues. Finally, though many cloud providers are approved to hold most data including military and financial, law to have personal oversight of the machines holding your data may restrict you.

What are benefits of practicing analytics on the cloud vs on-premise?
For most, the cloud offers big data practitioners a less expensive and faster way to get into the big data game. But what did uncle Ben say, "with great power comes great responsibility" and the same holds true with data in the cloud. Cloud provider have made it so easy to get data in the cloud, utilize it, and secure it, but some don't also spend the small amount of time to ensure the latter. So if you are doing a proof of concept with a cloud provider use dummy data or ensure that you know what security protocols are appropriate for your situation and always use them.

Analytics is becoming the core differentiator for business success. The cloud, specifically AWS, allows companies of all sizes to take advantage of this analytic power. At the AWS re:Invent event in Las Vegas this week, the interest in Amazon’s Redshift offering has grown significantly considering the product was released just a year ago. Similar products from large enterprise software vendors are sparse and not ready for prime time yet. If mid-sized companies want to leverage analytics, cloud based solutions should definitely be on the short list. For larger companies, there may be some workloads that fit this model.

More Stories By Larry Carvalho

Larry Carvalho runs Robust Cloud LLC, an advisory services company helping various ecosystem players develop a strategy to take advantage of cloud computing. As the 2010-12 Instructor of Cloud Expo's popular Cloud Computing Bootcamp, he has already led the bootcamp in New York, Silicon Valley, and Prague, receiving strong positive feedback from attendees about the value gained at these events. Carvalho has facilitated all-day sessions at customer locations to set a clear roadmap and gain consensus among attendees on strategy and product direction. He has participated in multiple discussion panels focused on cloud computing trends at information technology events, and he has delivered all-day cloud computing training to customers in conjunction with CloudCamps. To date, his role has taken him to clients in three continents.

DXWorldEXPO Digital Transformation Stories
The platform combines the strengths of Singtel's extensive, intelligent network capabilities with Microsoft's cloud expertise to create a unique solution that sets new standards for IoT applications," said Mr Diomedes Kastanis, Head of IoT at Singtel. "Our solution provides speed, transparency and flexibility, paving the way for a more pervasive use of IoT to accelerate enterprises' digitalisation efforts. AI-powered intelligent connectivity over Microsoft Azure will be the fastest connected pat...
There are many examples of disruption in consumer space – Uber disrupting the cab industry, Airbnb disrupting the hospitality industry and so on; but have you wondered who is disrupting support and operations? AISERA helps make businesses and customers successful by offering consumer-like user experience for support and operations. We have built the world’s first AI-driven IT / HR / Cloud / Customer Support and Operations solution.
Codete accelerates their clients growth through technological expertise and experience. Codite team works with organizations to meet the challenges that digitalization presents. Their clients include digital start-ups as well as established enterprises in the IT industry. To stay competitive in a highly innovative IT industry, strong R&D departments and bold spin-off initiatives is a must. Codete Data Science and Software Architects teams help corporate clients to stay up to date with the mod...
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
In his general session at 21st Cloud Expo, Greg Dumas, Calligo’s Vice President and G.M. of US operations, discussed the new Global Data Protection Regulation and how Calligo can help business stay compliant in digitally globalized world. Greg Dumas is Calligo's Vice President and G.M. of US operations. Calligo is an established service provider that provides an innovative platform for trusted cloud solutions. Calligo’s customers are typically most concerned about GDPR compliance, application p...
Druva is the global leader in Cloud Data Protection and Management, delivering the industry's first data management-as-a-service solution that aggregates data from endpoints, servers and cloud applications and leverages the public cloud to offer a single pane of glass to enable data protection, governance and intelligence-dramatically increasing the availability and visibility of business critical information, while reducing the risk, cost and complexity of managing and protecting it. Druva's...
BMC has unmatched experience in IT management, supporting 92 of the Forbes Global 100, and earning recognition as an ITSM Gartner Magic Quadrant Leader for five years running. Our solutions offer speed, agility, and efficiency to tackle business challenges in the areas of service management, automation, operations, and the mainframe.
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
DSR is a supplier of project management, consultancy services and IT solutions that increase effectiveness of a company's operations in the production sector. The company combines in-depth knowledge of international companies with expert knowledge utilising IT tools that support manufacturing and distribution processes. DSR ensures optimization and integration of internal processes which is necessary for companies to grow rapidly. The rapid growth is possible thanks, to specialized services an...
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...