Welcome!

Big Data Journal Authors: Elizabeth White, Charles Rich, Jnan Dash, Yeshim Deniz, Liz McMillan

Blog Feed Post

CTOvision Analytics Reporting for 2012: The year of the enterprise tool suite for analytics

By

SocialNetworkAnalysis_GraphThis special report provides insights from a our reporting over the last 12 months, including summaries of our Weekly Analytical Tools Newsletter. Be sure to sign up for this report by visiting http://ctovision.com/newsletter-subscriptions/

As a writing team we have close ties to the analytical missions of the national security space (our publisher, Bob Gourley, was an operational intelligence officer and analyst in the USN in his first career, and most of our other writers also have national security policy or technology experience).  So we were very happy to see more open reporting on the analytical mission needs of the national security sector in reports like the one provided by the Intelligence and National Security Alliance  on “Expectations of Intelligence from the Intelligence Community in the Information Age

This paper should be of high interest to anyone in the intelligence community or in policy-making positions in the national security community. It is a quick read that I highly recommend you dive into it yourself. Till you do, here is the bottom line of the paper: The nation still needs the intelligence community to learn what our enemies don’t want us to know. Although this requires lots of traditional intelligence capabilities, increasingly it also requires new methods of making sense of what is already known and knowable.

The paper is an important reminder that analytical tools, like all capabilities, must be mission focused and must be useable by human beings. The greatest systems are built so that they take advantage of what computers do best and what humans do best. This approach is why we have been so excited to watch the accomplishments of Thetus in 2012.  Reporting we did highlighting Thetus includes a quickstart tutorial at “Thetus Savanna: Powerful but easy to learn analytic tools

We also provided a fast and easy way for you to spend 40 minutes with one of America’s greatest data scientists by watching an embedded YoutTube clip of Jeff Hammerbacher providing his insights into real world analysis over data.  We participate in many Big Data events and listen to lots of speakers and found this YoutTube presentation was better than any of the in-person sessions we made it to in 2012.  Please make time and watch it, you will be glad you did.

We also reported on developments at Dow Jones regarding their analytical platform. They have moved their major services (including Factiva) to MarkLogic and NoSQL.  This got our attention. We are all on the lookout for use cases for how others are succeeding in solving their mission needs, and the Dow Jones approach is one worth more study, especially if you are in an information analysis/creation/dissemination business or a government agency with demanding information needs.

Analysts and modelers play critically important roles in helping organization make sense of their information and helping them make the right decisions. The people are the most important element in this system and this has pushed us as a tech blog to write more about human issues. One of our more popular pieces in 2012 was a reprint of a Dan Bouk piece first published at AmericanScience titled “Embracing and Communicating Uncertainty: Model Enabled Analysis and a Modeler’s Hippocratic Oath”.

In it, Dan provided context relevant to model based analysis in multiple domains. He also provides a review of the “Modeler’s Hippocratic Oath” that resonated with us. This oath:
~ I will remember that I didn’t make the world, and it doesn’t satisfy my equations.
~ Though I will use models boldly to estimate value, I will not be overly impressed by mathematics.
~ I will never sacrifice reality for elegance without explaining why I have done so.
~ Nor will I give the people who use my model false comfort about its accuracy. Instead, I will make explicit its assumptions and oversights.
~ I understand that my work may have enormous effects on society and the economy, many of them beyond my comprehension.

We provided insights on a firm with a comprehensive and beautiful vision for enhanced analysis called RecordedFuture. Our reporting included a two part series on their user network conference (see here and here).

We also introduced our readers to a new startup called RapGenius. We believe this startup will cause dramatic positive change in the world of enterprise IT. For more see: Rap Genius: Coming to your enterprise

We reported on many other aspects of analysis and analytical tools through 2012, reviewing capabilities from firms like Datameer, Splunk, Kapow, MarkLogic, Cloudera, Thetus, SitScape, RecordedFuture, and RapGenius.

What does our reporting in 2012 signal for analytical tools in 2013?  We believe this will be the area of the most activity in the enterprise. We will keep and eye on and track developments in all other areas of it, of course, but all indications are that 2013 will be the year of analytical tools. We can also say these tools will increasingly be focused on users, enabling and empowering individuals in ways they never were empowered before. Enterprise CTOs will still need to configure and connect and maintain, but increasingly the users will be able to make more of their own decisions on the data they use and the queries they run and how results are displayed and shared.

Please join us as we track these topics in 2013. Sign up for our Weekly Analytical Tools Newsletter at http://ctovision.com/newsletter-subscriptions/

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley, former CTO of the Defense Intelligence Agency (DIA), is Founder and CTO of Crucial Point LLC, a technology research and advisory firm providing fact based technology reviews in support of venture capital, private equity and emerging technology firms. He has extensive industry experience in intelligence and security and was awarded an intelligence community meritorious achievement award by AFCEA in 2008, and has also been recognized as an Infoworld Top 25 CTO and as one of the most fascinating communicators in Government IT by GovFresh.

@BigDataExpo Stories
“We help people build clusters, in the classical sense of the cluster. We help people put a full stack on top of every single one of those machines. We do the full bare metal install," explained Greg Bruno, Vice President of Engineering and co-founder of StackIQ, in this SYS-CON.tv interview at 15th Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The major cloud platforms defy a simple, side-by-side analysis. Each of the major IaaS public-cloud platforms offers their own unique strengths and functionality. Options for on-site private cloud are diverse as well, and must be designed and deployed while taking existing legacy architecture and infrastructure into account. Then the reality is that most enterprises are embarking on a hybrid cloud strategy and programs. In this Power Panel at 15th Cloud Expo (http://www.CloudComputingExpo.com...
"BSQUARE is in the business of selling software solutions for smart connected devices. It's obvious that IoT has moved from being a technology to being a fundamental part of business, and in the last 18 months people have said let's figure out how to do it and let's put some focus on it, " explained Dave Wagstaff, VP & Chief Architect, at BSQUARE Corporation, in this SYS-CON.tv interview at @ThingsExpo, held Nov 4-6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that Windstream, a leading provider of advanced network and cloud communications, has been named “Silver Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9–11, 2015, at the Javits Center in New York, NY. Windstream (Nasdaq: WIN), a FORTUNE 500 and S&P 500 company, is a leading provider of advanced network communications, including cloud computing and managed services, to businesses nationwide. The company also offers broadband, p...

ARMONK, N.Y., Nov. 20, 2014 /PRNewswire/ --  IBM (NYSE: IBM) today announced that it is bringing a greater level of control, security and flexibility to cloud-based application development and delivery with a single-tenant version of Bluemix, IBM's

DevOps Summit 2015 New York, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that it is now accepting Keynote Proposals. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete...
"People are a lot more knowledgeable about APIs now. There are two types of people who work with APIs - IT people who want to use APIs for something internal and the product managers who want to do something outside APIs for people to connect to them," explained Roberto Medrano, Executive Vice President at SOA Software, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
“We are a managed services company. We have taken the key aspects of the cloud and the purposed data center and merged the two together and launched the Purposed Cloud about 18–24 months ago," explained Chetan Patwardhan, CEO of Stratogent, in this SYS-CON.tv interview at 15th Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The Internet of Things is a misnomer. That implies that everything is on the Internet, and that simply should not be - especially for things that are blurring the line between medical devices that stimulate like a pacemaker and quantified self-sensors like a pedometer or pulse tracker. The mesh of things that we manage must be segmented into zones of trust for sensing data, transmitting data, receiving command and control administrative changes, and peer-to-peer mesh messaging. In his session a...
"At our booth we are showing how to provide trust in the Internet of Things. Trust is where everything starts to become secure and trustworthy. Now with the scaling of the Internet of Things it becomes an interesting question – I've heard numbers from 200 billion devices next year up to a trillion in the next 10 to 15 years," explained Johannes Lintzen, Vice President of Sales at Utimaco, in this SYS-CON.tv interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in San...
As enterprises engage with Big Data technologies to develop applications needed to meet operational demands, new computation fabrics are continually being introduced. To leverage these new innovations, organizations are sacrificing market opportunities to gain expertise in learning new systems. In his session at Big Data Expo, Supreet Oberoi, Vice President of Field Engineering at Concurrent, Inc., discussed how to leverage existing infrastructure and investments and future-proof them against e...
"Desktop as a Service is emerging as a very big trend. One of the big influencers of this – for Esri – is that we have a large user base that uses virtualization and they are looking at Desktop as a Service right now," explained John Meza, Product Engineer at Esri, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that Gridstore™, the leader in hyper-converged infrastructure purpose-built to optimize Microsoft workloads, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Gridstore™ is the leader in hyper-converged infrastructure purpose-built for Microsoft workloads and designed to accelerate applications in virtualized environments. Gridstore’s hyper-converged infrastructure is the ...
We certainly live in interesting technological times. And no more interesting than the current competing IoT standards for connectivity. Various standards bodies, approaches, and ecosystems are vying for mindshare and positioning for a competitive edge. It is clear that when the dust settles, we will have new protocols, evolved protocols, that will change the way we interact with devices and infrastructure. We will also have evolved web protocols, like HTTP/2, that will be changing the very core...
SYS-CON Events announced today that Creative Business Solutions will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Creative Business Solutions is the top stocking authorized HP Renew Distributor in the U.S. Based out of Long Island, NY, Creative Business Solutions offers a one-stop shop for a diverse range of products including Proliant, Blade and Industry Standard Servers, Networking, Server Options and...
You use an agile process; your goal is to make your organization more agile. But what about your data infrastructure? The truth is, today's databases are anything but agile - they are effectively static repositories that are cumbersome to work with, difficult to change, and cannot keep pace with application demands. Performance suffers as a result, and it takes far longer than it should to deliver new features and capabilities needed to make your organization competitive. As your application an...
An effective way of thinking in Big Data is composed of a methodical framework for dealing with the predicted shortage of 50-60% of the qualified Big Data resources in the U.S. This holistic model comprises the scientific and engineering steps that are involved in accelerating Big Data solutions: problem, diagnosis, facts, analysis, hypothesis, solution, prototype and implementation. In his session at Big Data Expo®, Tony Shan focused on the concept, importance, and considerations for each of t...
The 3rd International Internet of @ThingsExpo, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that its Call for Papers is now open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect at GE, and Ibrahim Gokcen, who leads GE's advanced IoT analytics, focused on the Internet of Things / Industrial Internet and how to make it operational for business end-users. Learn about the challenges posed by machine and sensor data and how to marry it with enterprise data. They also discussed the tips and tricks to provide the Industrial Internet as an end-user consumable service using Big Data Analytics and Industrial C...
As the Internet of Things unfolds, mobile and wearable devices are blurring the line between physical and digital, integrating ever more closely with our interests, our routines, our daily lives. Contextual computing and smart, sensor-equipped spaces bring the potential to walk through a world that recognizes us and responds accordingly. We become continuous transmitters and receivers of data. In his session at @ThingsExpo, Andrew Bolwell, Director of Innovation for HP's Printing and Personal S...