Welcome!

@DXWorldExpo Authors: Pat Romanski, Kevin Benedict, Liz McMillan, Jason Bloomberg, Yeshim Deniz

Related Topics: @DXWorldExpo, Java IoT, Microservices Expo, Containers Expo Blog, @CloudExpo, SDN Journal

@DXWorldExpo: Article

Big Data Analytics Without Complications and Expenses

Cloud technology can make data analytics available to a whole new set of customers and applications

Cloud computing attention is often paid to moving compute requirements from the enterprise data center to public clouds. While the technology enables a number of innovative solutions around mobile and social environments, analytics is often seen as an in-house solution that requires highly specialized skills.

Cloud providers have upped their game in data analytics. No longer are they just providing you with an environment, managing the underlying machines, they are now managing underlying systems - systems specific to your needs like Big Data. This fits well with mid-sized companies that are hungry for analytic solutions to enable them to compete with large enterprise competitors.

Recently, I sat down with Jonathan Pickard of Analyzer 1. Jonathan has worked on both the business side and IT side to create game changing business intelligence solutions, for some of the largest enterprises. Focusing on rapid delivery, the cloud has been a game changer for Analyzer 1. As cloud BI solutions have begun to mature, Jonathan said, “we can now safely and effectively deliver to our clients at a pace never seen before.” I put together some questions for him:

Should an organization create big data systems themselves or use the cloud?
It depends. Let's consider a database your company will use for big data analytics and ask these questions. Do you have a data security plan established in case of a machine outage, building fire or network attack? Have a plan to update all the layers of you system, that's fast and non-disruptive; including hardware updates, network updates, OS updates, and database updates. Do you know the best practices associate with configuring your specific machine and database? Do you have multiple people that can be fully committed to the management the database and fix any unforeseen issues? This is just the tip of the iceberg for managing one component of your analytic system, not including associated management and planning issues.

How can the cloud help a company with Big Data analytics?
Well again let's look at a database, in this case an analytical database, Amazon Redshift. Redshift is a technology disruptor, for several reasons: analytic processing power, ease of management, and price ~ $1000 per TB per year. For people that are used to working in a larger company, they may be shocked at this price point. This is not only the price for the database per terabyte, we're including the management of the underlying systems: facility, redundancy, maintenance, upgrades, and security features. Plus, like other systems in Amazons Web Services, it offers an easy management system that can be up and running within minutes. Typically, I demo the setup of a complete analytical system in less than 2 hours using AWS that includes the setup of a secure environment setup, ETL, analytical database, and analytical application.

What kind of organization is the cloud for?
An all-in cloud strategy is not for everyone, if you are a very large company and want to make BI, and analytics a core competency, you may want to consider developing in house. However, this includes paying for the best people in the industry, as well as all the infrastructure costs that go into running such system. While it may seem like in the long run, you may save money, you still have to dedicate your time, resources and staff to managing such infrastructure instead of putting those resources towards projects that differentiate your business. Speed is another issue. Already have systems locally associated with big data? Then you may need to move those systems into the cloud as well; else you could face bandwidth or even speed of light issues. Finally, though many cloud providers are approved to hold most data including military and financial, law to have personal oversight of the machines holding your data may restrict you.

What are benefits of practicing analytics on the cloud vs on-premise?
For most, the cloud offers big data practitioners a less expensive and faster way to get into the big data game. But what did uncle Ben say, "with great power comes great responsibility" and the same holds true with data in the cloud. Cloud provider have made it so easy to get data in the cloud, utilize it, and secure it, but some don't also spend the small amount of time to ensure the latter. So if you are doing a proof of concept with a cloud provider use dummy data or ensure that you know what security protocols are appropriate for your situation and always use them.

Analytics is becoming the core differentiator for business success. The cloud, specifically AWS, allows companies of all sizes to take advantage of this analytic power. At the AWS re:Invent event in Las Vegas this week, the interest in Amazon’s Redshift offering has grown significantly considering the product was released just a year ago. Similar products from large enterprise software vendors are sparse and not ready for prime time yet. If mid-sized companies want to leverage analytics, cloud based solutions should definitely be on the short list. For larger companies, there may be some workloads that fit this model.

More Stories By Larry Carvalho

Larry Carvalho runs Robust Cloud LLC, an advisory services company helping various ecosystem players develop a strategy to take advantage of cloud computing. As the 2010-12 Instructor of Cloud Expo's popular Cloud Computing Bootcamp, he has already led the bootcamp in New York, Silicon Valley, and Prague, receiving strong positive feedback from attendees about the value gained at these events. Carvalho has facilitated all-day sessions at customer locations to set a clear roadmap and gain consensus among attendees on strategy and product direction. He has participated in multiple discussion panels focused on cloud computing trends at information technology events, and he has delivered all-day cloud computing training to customers in conjunction with CloudCamps. To date, his role has taken him to clients in three continents.

@BigDataExpo Stories
Digital transformation is about embracing digital technologies into a company's culture to better connect with its customers, automate processes, create better tools, enter new markets, etc. Such a transformation requires continuous orchestration across teams and an environment based on open collaboration and daily experiments. In his session at 21st Cloud Expo, Alex Casalboni, Technical (Cloud) Evangelist at Cloud Academy, explored and discussed the most urgent unsolved challenges to achieve f...
Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, discussed some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he covered some of the best practices for structured team migration an...
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone inn...
Sanjeev Sharma Joins June 5-7, 2018 @DevOpsSummit at @Cloud Expo New York Faculty. Sanjeev Sharma is an internationally known DevOps and Cloud Transformation thought leader, technology executive, and author. Sanjeev's industry experience includes tenures as CTO, Technical Sales leader, and Cloud Architect leader. As an IBM Distinguished Engineer, Sanjeev is recognized at the highest levels of IBM's core of technical leaders.
Digital Transformation (DX) is not a "one-size-fits all" strategy. Each organization needs to develop its own unique, long-term DX plan. It must do so by realizing that we now live in a data-driven age, and that technologies such as Cloud Computing, Big Data, the IoT, Cognitive Computing, and Blockchain are only tools. In her general session at 21st Cloud Expo, Rebecca Wanta explained how the strategy must focus on DX and include a commitment from top management to create great IT jobs, monitor ...
The 22nd International Cloud Expo | 1st DXWorld Expo has announced that its Call for Papers is open. Cloud Expo | DXWorld Expo, to be held June 5-7, 2018, at the Javits Center in New York, NY, brings together Cloud Computing, Digital Transformation, Big Data, Internet of Things, DevOps, Machine Learning and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding busin...
"Digital transformation - what we knew about it in the past has been redefined. Automation is going to play such a huge role in that because the culture, the technology, and the business operations are being shifted now," stated Brian Boeggeman, VP of Alliances & Partnerships at Ayehu, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Continuous Delivery makes it possible to exploit findings of cognitive psychology and neuroscience to increase the productivity and happiness of our teams. In his session at 22nd Cloud Expo | DXWorld Expo, Daniel Jones, CTO of EngineerBetter, will answer: How can we improve willpower and decrease technical debt? Is the present bias real? How can we turn it to our advantage? Can you increase a team’s effective IQ? How do DevOps & Product Teams increase empathy, and what impact does empath...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
In his general session at 21st Cloud Expo, Greg Dumas, Calligo’s Vice President and G.M. of US operations, discussed the new Global Data Protection Regulation and how Calligo can help business stay compliant in digitally globalized world. Greg Dumas is Calligo's Vice President and G.M. of US operations. Calligo is an established service provider that provides an innovative platform for trusted cloud solutions. Calligo’s customers are typically most concerned about GDPR compliance, application p...
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that's no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, explored how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He expla...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
DevOps promotes continuous improvement through a culture of collaboration. But in real terms, how do you: Integrate activities across diverse teams and services? Make objective decisions with system-wide visibility? Use feedback loops to enable learning and improvement? With technology insights and real-world examples, in his general session at @DevOpsSummit, at 21st Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, explored how leading organizations use data-driven DevOps to close th...
"Evatronix provides design services to companies that need to integrate the IoT technology in their products but they don't necessarily have the expertise, knowledge and design team to do so," explained Adam Morawiec, VP of Business Development at Evatronix, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, led attendees through the exciting evolution of the cloud. He looked at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering m...
No hype cycles or predictions of a gazillion things here. IoT is here. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, an Associate Partner of Analytics, IoT & Cybersecurity at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He also discussed the evaluation of communication standards and IoT messaging protocols, data...
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, discussed how they built...