Welcome!

@DXWorldExpo Authors: Liz McMillan, Yeshim Deniz, Pat Romanski, Jason Bloomberg, Zakia Bouachraoui

Related Topics: @DXWorldExpo, Java IoT, Microservices Expo, Containers Expo Blog, @CloudExpo, SDN Journal

@DXWorldExpo: Article

Big Data Analytics Without Complications and Expenses

Cloud technology can make data analytics available to a whole new set of customers and applications

Cloud computing attention is often paid to moving compute requirements from the enterprise data center to public clouds. While the technology enables a number of innovative solutions around mobile and social environments, analytics is often seen as an in-house solution that requires highly specialized skills.

Cloud providers have upped their game in data analytics. No longer are they just providing you with an environment, managing the underlying machines, they are now managing underlying systems - systems specific to your needs like Big Data. This fits well with mid-sized companies that are hungry for analytic solutions to enable them to compete with large enterprise competitors.

Recently, I sat down with Jonathan Pickard of Analyzer 1. Jonathan has worked on both the business side and IT side to create game changing business intelligence solutions, for some of the largest enterprises. Focusing on rapid delivery, the cloud has been a game changer for Analyzer 1. As cloud BI solutions have begun to mature, Jonathan said, “we can now safely and effectively deliver to our clients at a pace never seen before.” I put together some questions for him:

Should an organization create big data systems themselves or use the cloud?
It depends. Let's consider a database your company will use for big data analytics and ask these questions. Do you have a data security plan established in case of a machine outage, building fire or network attack? Have a plan to update all the layers of you system, that's fast and non-disruptive; including hardware updates, network updates, OS updates, and database updates. Do you know the best practices associate with configuring your specific machine and database? Do you have multiple people that can be fully committed to the management the database and fix any unforeseen issues? This is just the tip of the iceberg for managing one component of your analytic system, not including associated management and planning issues.

How can the cloud help a company with Big Data analytics?
Well again let's look at a database, in this case an analytical database, Amazon Redshift. Redshift is a technology disruptor, for several reasons: analytic processing power, ease of management, and price ~ $1000 per TB per year. For people that are used to working in a larger company, they may be shocked at this price point. This is not only the price for the database per terabyte, we're including the management of the underlying systems: facility, redundancy, maintenance, upgrades, and security features. Plus, like other systems in Amazons Web Services, it offers an easy management system that can be up and running within minutes. Typically, I demo the setup of a complete analytical system in less than 2 hours using AWS that includes the setup of a secure environment setup, ETL, analytical database, and analytical application.

What kind of organization is the cloud for?
An all-in cloud strategy is not for everyone, if you are a very large company and want to make BI, and analytics a core competency, you may want to consider developing in house. However, this includes paying for the best people in the industry, as well as all the infrastructure costs that go into running such system. While it may seem like in the long run, you may save money, you still have to dedicate your time, resources and staff to managing such infrastructure instead of putting those resources towards projects that differentiate your business. Speed is another issue. Already have systems locally associated with big data? Then you may need to move those systems into the cloud as well; else you could face bandwidth or even speed of light issues. Finally, though many cloud providers are approved to hold most data including military and financial, law to have personal oversight of the machines holding your data may restrict you.

What are benefits of practicing analytics on the cloud vs on-premise?
For most, the cloud offers big data practitioners a less expensive and faster way to get into the big data game. But what did uncle Ben say, "with great power comes great responsibility" and the same holds true with data in the cloud. Cloud provider have made it so easy to get data in the cloud, utilize it, and secure it, but some don't also spend the small amount of time to ensure the latter. So if you are doing a proof of concept with a cloud provider use dummy data or ensure that you know what security protocols are appropriate for your situation and always use them.

Analytics is becoming the core differentiator for business success. The cloud, specifically AWS, allows companies of all sizes to take advantage of this analytic power. At the AWS re:Invent event in Las Vegas this week, the interest in Amazon’s Redshift offering has grown significantly considering the product was released just a year ago. Similar products from large enterprise software vendors are sparse and not ready for prime time yet. If mid-sized companies want to leverage analytics, cloud based solutions should definitely be on the short list. For larger companies, there may be some workloads that fit this model.

More Stories By Larry Carvalho

Larry Carvalho runs Robust Cloud LLC, an advisory services company helping various ecosystem players develop a strategy to take advantage of cloud computing. As the 2010-12 Instructor of Cloud Expo's popular Cloud Computing Bootcamp, he has already led the bootcamp in New York, Silicon Valley, and Prague, receiving strong positive feedback from attendees about the value gained at these events. Carvalho has facilitated all-day sessions at customer locations to set a clear roadmap and gain consensus among attendees on strategy and product direction. He has participated in multiple discussion panels focused on cloud computing trends at information technology events, and he has delivered all-day cloud computing training to customers in conjunction with CloudCamps. To date, his role has taken him to clients in three continents.

DXWorldEXPO Digital Transformation Stories
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
DXWorldEXPO LLC announced today that Nutanix has been named "Platinum Sponsor" of CloudEXPO | DevOpsSUMMIT | DXWorldEXPO New York, which will take place November 12-13, 2018 in New York City. Nutanix makes infrastructure invisible, elevating IT to focus on the applications and services that power their business. The Nutanix Enterprise Cloud Platform blends web-scale engineering and consumer-grade design to natively converge server, storage, virtualization and networking into a resilient, softwar...
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next...
CloudEXPO New York 2018, colocated with DevOpsSUMMIT and DXWorldEXPO New York 2018 will be held November 12-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI and Machine Learning to one location.
CloudEXPO | DevOpsSUMMIT | DXWorldEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
ICC is a computer systems integrator and server manufacturing company focused on developing products and product appliances to meet a wide range of computational needs for many industries. Their solutions provide benefits across many environments, such as datacenter deployment, HPC, workstations, storage networks and standalone server installations. ICC has been in business for over 23 years and their phenomenal range of clients include multinational corporations, universities, and small busines...
Headquartered in Plainsboro, NJ, Synametrics Technologies has provided IT professionals and computer systems developers since 1997. Based on the success of their initial product offerings (WinSQL and DeltaCopy), the company continues to create and hone innovative products that help its customers get more from their computer applications, databases and infrastructure. To date, over one million users around the world have chosen Synametrics solutions to help power their accelerated business or per...
All in Mobile is a place where we continually maximize their impact by fostering understanding, empathy, insights, creativity and joy. They believe that a truly useful and desirable mobile app doesn't need the brightest idea or the most advanced technology. A great product begins with understanding people. It's easy to think that customers will love your app, but can you justify it? They make sure your final app is something that users truly want and need. The only way to do this is by ...