Welcome!

@BigDataExpo Authors: Elizabeth White, Liz McMillan, Scott Allen, Pat Romanski, Harry Trott

Blog Feed Post

CTOvision Analytics Reporting for 2012: The year of the enterprise tool suite for analytics

By

SocialNetworkAnalysis_GraphThis special report provides insights from a our reporting over the last 12 months, including summaries of our Weekly Analytical Tools Newsletter. Be sure to sign up for this report by visiting http://ctovision.com/newsletter-subscriptions/

As a writing team we have close ties to the analytical missions of the national security space (our publisher, Bob Gourley, was an operational intelligence officer and analyst in the USN in his first career, and most of our other writers also have national security policy or technology experience).  So we were very happy to see more open reporting on the analytical mission needs of the national security sector in reports like the one provided by the Intelligence and National Security Alliance  on “Expectations of Intelligence from the Intelligence Community in the Information Age

This paper should be of high interest to anyone in the intelligence community or in policy-making positions in the national security community. It is a quick read that I highly recommend you dive into it yourself. Till you do, here is the bottom line of the paper: The nation still needs the intelligence community to learn what our enemies don’t want us to know. Although this requires lots of traditional intelligence capabilities, increasingly it also requires new methods of making sense of what is already known and knowable.

The paper is an important reminder that analytical tools, like all capabilities, must be mission focused and must be useable by human beings. The greatest systems are built so that they take advantage of what computers do best and what humans do best. This approach is why we have been so excited to watch the accomplishments of Thetus in 2012.  Reporting we did highlighting Thetus includes a quickstart tutorial at “Thetus Savanna: Powerful but easy to learn analytic tools

We also provided a fast and easy way for you to spend 40 minutes with one of America’s greatest data scientists by watching an embedded YoutTube clip of Jeff Hammerbacher providing his insights into real world analysis over data.  We participate in many Big Data events and listen to lots of speakers and found this YoutTube presentation was better than any of the in-person sessions we made it to in 2012.  Please make time and watch it, you will be glad you did.

We also reported on developments at Dow Jones regarding their analytical platform. They have moved their major services (including Factiva) to MarkLogic and NoSQL.  This got our attention. We are all on the lookout for use cases for how others are succeeding in solving their mission needs, and the Dow Jones approach is one worth more study, especially if you are in an information analysis/creation/dissemination business or a government agency with demanding information needs.

Analysts and modelers play critically important roles in helping organization make sense of their information and helping them make the right decisions. The people are the most important element in this system and this has pushed us as a tech blog to write more about human issues. One of our more popular pieces in 2012 was a reprint of a Dan Bouk piece first published at AmericanScience titled “Embracing and Communicating Uncertainty: Model Enabled Analysis and a Modeler’s Hippocratic Oath”.

In it, Dan provided context relevant to model based analysis in multiple domains. He also provides a review of the “Modeler’s Hippocratic Oath” that resonated with us. This oath:
~ I will remember that I didn’t make the world, and it doesn’t satisfy my equations.
~ Though I will use models boldly to estimate value, I will not be overly impressed by mathematics.
~ I will never sacrifice reality for elegance without explaining why I have done so.
~ Nor will I give the people who use my model false comfort about its accuracy. Instead, I will make explicit its assumptions and oversights.
~ I understand that my work may have enormous effects on society and the economy, many of them beyond my comprehension.

We provided insights on a firm with a comprehensive and beautiful vision for enhanced analysis called RecordedFuture. Our reporting included a two part series on their user network conference (see here and here).

We also introduced our readers to a new startup called RapGenius. We believe this startup will cause dramatic positive change in the world of enterprise IT. For more see: Rap Genius: Coming to your enterprise

We reported on many other aspects of analysis and analytical tools through 2012, reviewing capabilities from firms like Datameer, Splunk, Kapow, MarkLogic, Cloudera, Thetus, SitScape, RecordedFuture, and RapGenius.

What does our reporting in 2012 signal for analytical tools in 2013?  We believe this will be the area of the most activity in the enterprise. We will keep and eye on and track developments in all other areas of it, of course, but all indications are that 2013 will be the year of analytical tools. We can also say these tools will increasingly be focused on users, enabling and empowering individuals in ways they never were empowered before. Enterprise CTOs will still need to configure and connect and maintain, but increasingly the users will be able to make more of their own decisions on the data they use and the queries they run and how results are displayed and shared.

Please join us as we track these topics in 2013. Sign up for our Weekly Analytical Tools Newsletter at http://ctovision.com/newsletter-subscriptions/

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley writes on enterprise IT. He is a founder and partner at Cognitio Corp and publsher of CTOvision.com

@BigDataExpo Stories
Creating replica copies to tolerate a certain number of failures is easy, but very expensive at cloud-scale. Conventional RAID has lower overhead, but it is limited in the number of failures it can tolerate. And the management is like herding cats (overseeing capacity, rebuilds, migrations, and degraded performance). Download Slide Deck: ▸ Here In his general session at 18th Cloud Expo, Scott Cleland, Senior Director of Product Marketing for the HGST Cloud Infrastructure Business Unit, discusse...
Unless your company can spend a lot of money on new technology, re-engineering your environment and hiring a comprehensive cybersecurity team, you will most likely move to the cloud or seek external service partnerships. In his session at 18th Cloud Expo, Darren Guccione, CEO of Keeper Security, revealed what you need to know when it comes to encryption in the cloud.
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, discussed how research has demonstrated the value of Machine Learning in delivering next generation analytics to imp...
The cloud promises new levels of agility and cost-savings for Big Data, data warehousing and analytics. But it’s challenging to understand all the options – from IaaS and PaaS to newer services like HaaS (Hadoop as a Service) and BDaaS (Big Data as a Service). In her session at @BigDataExpo at @ThingsExpo, Hannah Smalltree, a director at Cazena, provided an educational overview of emerging “as-a-service” options for Big Data in the cloud. This is critical background for IT and data profession...
It's easy to assume that your app will run on a fast and reliable network. The reality for your app's users, though, is often a slow, unreliable network with spotty coverage. What happens when the network doesn't work, or when the device is in airplane mode? You get unhappy, frustrated users. An offline-first app is an app that works, without error, when there is no network connection. In his session at 18th Cloud Expo, Bradley Holt, a Developer Advocate with IBM Cloud Data Services, discussed...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, wh...
Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...
As organizations shift towards IT-as-a-service models, the need for managing and protecting data residing across physical, virtual, and now cloud environments grows with it. Commvault can ensure protection, access and E-Discovery of your data – whether in a private cloud, a Service Provider delivered public cloud, or a hybrid cloud environment – across the heterogeneous enterprise. In his general session at 18th Cloud Expo, Randy De Meno, Chief Technologist - Windows Products and Microsoft Part...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life sett...
What does it look like when you have access to cloud infrastructure and platform under the same roof? Let’s talk about the different layers of Technology as a Service: who cares, what runs where, and how does it all fit together. In his session at 18th Cloud Expo, Phil Jackson, Lead Technology Evangelist at SoftLayer, an IBM company, spoke about the picture being painted by IBM Cloud and how the tools being crafted can help fill the gaps in your IT infrastructure.
Cloud Expo, Inc. has announced today that Andi Mann returns to 'DevOps at Cloud Expo 2016' as Conference Chair The @DevOpsSummit at Cloud Expo will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. "DevOps is set to be one of the most profound disruptions to hit IT in decades," said Andi Mann. "It is a natural extension of cloud computing, and I have seen both firsthand and in independent research the fantastic results DevOps delivers. So I am excited t...
"We work in the area of Big Data analytics and Big Data analytics is a very crowded space - you have Hadoop, ETL, warehousing, visualization and there's a lot of effort trying to get these tools to talk to each other," explained Mukund Deshpande, head of the Analytics practice at Accelerite, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
University of Colorado Athletics has selected FORTRUST, Colorado’s only Tier III Gold certified data center, as their official data center and colocation services provider, FORTRUST announced today. A nationally recognized and prominent collegiate athletics program, CU provides a high quality and comprehensive student-athlete experience. The program sponsors 17 varsity teams and in their history, the Colorado Buffaloes have collected an impressive 28 national championships. Maintaining uptime...
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effi...
The idea of comparing data in motion (at the sensor level) to data at rest (in a Big Data server warehouse) with predictive analytics in the cloud is very appealing to the industrial IoT sector. The problem Big Data vendors have, however, is access to that data in motion at the sensor location. In his session at @ThingsExpo, Scott Allen, CMO of FreeWave, discussed how as IoT is increasingly adopted by industrial markets, there is going to be an increased demand for sensor data from the outermos...
The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
Presidio has received the 2015 EMC Partner Services Quality Award from EMC Corporation for achieving outstanding service excellence and customer satisfaction as measured by the EMC Partner Services Quality (PSQ) program. Presidio was also honored as the 2015 EMC Americas Marketing Excellence Partner of the Year and 2015 Mid-Market East Partner of the Year. The EMC PSQ program is a project-specific survey program designed for partners with Service Partner designations to solicit customer feedbac...
"Avere Systems is a hybrid cloud solution provider. We have customers that want to use cloud storage and we have customers that want to take advantage of cloud compute," explained Rebecca Thompson, VP of Marketing at Avere Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
The IoT is changing the way enterprises conduct business. In his session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, discussed how businesses can gain an edge over competitors by empowering consumers to take control through IoT. He cited examples such as a Washington, D.C.-based sports club that leveraged IoT and the cloud to develop a comprehensive booking system. He also highlighted how IoT can revitalize and restore outdated business models, making them profitable ...
There are several IoTs: the Industrial Internet, Consumer Wearables, Wearables and Healthcare, Supply Chains, and the movement toward Smart Grids, Cities, Regions, and Nations. There are competing communications standards every step of the way, a bewildering array of sensors and devices, and an entire world of competing data analytics platforms. To some this appears to be chaos. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, Bradley Holt, Developer Advocate a...