Welcome!

@BigDataExpo Authors: Pat Romanski, William Schmarzo, Matthew McKenna, Liz McMillan, Ed Featherston

Blog Feed Post

CTOvision Analytics Reporting for 2012: The year of the enterprise tool suite for analytics

By

SocialNetworkAnalysis_GraphThis special report provides insights from a our reporting over the last 12 months, including summaries of our Weekly Analytical Tools Newsletter. Be sure to sign up for this report by visiting http://ctovision.com/newsletter-subscriptions/

As a writing team we have close ties to the analytical missions of the national security space (our publisher, Bob Gourley, was an operational intelligence officer and analyst in the USN in his first career, and most of our other writers also have national security policy or technology experience).  So we were very happy to see more open reporting on the analytical mission needs of the national security sector in reports like the one provided by the Intelligence and National Security Alliance  on “Expectations of Intelligence from the Intelligence Community in the Information Age

This paper should be of high interest to anyone in the intelligence community or in policy-making positions in the national security community. It is a quick read that I highly recommend you dive into it yourself. Till you do, here is the bottom line of the paper: The nation still needs the intelligence community to learn what our enemies don’t want us to know. Although this requires lots of traditional intelligence capabilities, increasingly it also requires new methods of making sense of what is already known and knowable.

The paper is an important reminder that analytical tools, like all capabilities, must be mission focused and must be useable by human beings. The greatest systems are built so that they take advantage of what computers do best and what humans do best. This approach is why we have been so excited to watch the accomplishments of Thetus in 2012.  Reporting we did highlighting Thetus includes a quickstart tutorial at “Thetus Savanna: Powerful but easy to learn analytic tools

We also provided a fast and easy way for you to spend 40 minutes with one of America’s greatest data scientists by watching an embedded YoutTube clip of Jeff Hammerbacher providing his insights into real world analysis over data.  We participate in many Big Data events and listen to lots of speakers and found this YoutTube presentation was better than any of the in-person sessions we made it to in 2012.  Please make time and watch it, you will be glad you did.

We also reported on developments at Dow Jones regarding their analytical platform. They have moved their major services (including Factiva) to MarkLogic and NoSQL.  This got our attention. We are all on the lookout for use cases for how others are succeeding in solving their mission needs, and the Dow Jones approach is one worth more study, especially if you are in an information analysis/creation/dissemination business or a government agency with demanding information needs.

Analysts and modelers play critically important roles in helping organization make sense of their information and helping them make the right decisions. The people are the most important element in this system and this has pushed us as a tech blog to write more about human issues. One of our more popular pieces in 2012 was a reprint of a Dan Bouk piece first published at AmericanScience titled “Embracing and Communicating Uncertainty: Model Enabled Analysis and a Modeler’s Hippocratic Oath”.

In it, Dan provided context relevant to model based analysis in multiple domains. He also provides a review of the “Modeler’s Hippocratic Oath” that resonated with us. This oath:
~ I will remember that I didn’t make the world, and it doesn’t satisfy my equations.
~ Though I will use models boldly to estimate value, I will not be overly impressed by mathematics.
~ I will never sacrifice reality for elegance without explaining why I have done so.
~ Nor will I give the people who use my model false comfort about its accuracy. Instead, I will make explicit its assumptions and oversights.
~ I understand that my work may have enormous effects on society and the economy, many of them beyond my comprehension.

We provided insights on a firm with a comprehensive and beautiful vision for enhanced analysis called RecordedFuture. Our reporting included a two part series on their user network conference (see here and here).

We also introduced our readers to a new startup called RapGenius. We believe this startup will cause dramatic positive change in the world of enterprise IT. For more see: Rap Genius: Coming to your enterprise

We reported on many other aspects of analysis and analytical tools through 2012, reviewing capabilities from firms like Datameer, Splunk, Kapow, MarkLogic, Cloudera, Thetus, SitScape, RecordedFuture, and RapGenius.

What does our reporting in 2012 signal for analytical tools in 2013?  We believe this will be the area of the most activity in the enterprise. We will keep and eye on and track developments in all other areas of it, of course, but all indications are that 2013 will be the year of analytical tools. We can also say these tools will increasingly be focused on users, enabling and empowering individuals in ways they never were empowered before. Enterprise CTOs will still need to configure and connect and maintain, but increasingly the users will be able to make more of their own decisions on the data they use and the queries they run and how results are displayed and shared.

Please join us as we track these topics in 2013. Sign up for our Weekly Analytical Tools Newsletter at http://ctovision.com/newsletter-subscriptions/

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley writes on enterprise IT. He is a founder and partner at Cognitio Corp and publsher of CTOvision.com

@BigDataExpo Stories
Manufacturers are embracing the Industrial Internet the same way consumers are leveraging Fitbits – to improve overall health and wellness. Both can provide consistent measurement, visibility, and suggest performance improvements customized to help reach goals. Fitbit users can view real-time data and make adjustments to increase their activity. In his session at @ThingsExpo, Mark Bernardo Professional Services Leader, Americas, at GE Digital, discussed how leveraging the Industrial Internet a...
IoT generates lots of temporal data. But how do you unlock its value? You need to discover patterns that are repeatable in vast quantities of data, understand their meaning, and implement scalable monitoring across multiple data streams in order to monetize the discoveries and insights. Motif discovery and deep learning platforms are emerging to visualize sensor data, to search for patterns and to build application that can monitor real time streams efficiently. In his session at @ThingsExpo, ...
Choosing the right cloud for your workloads is a balancing act that can cost your organization time, money and aggravation - unless you get it right the first time. Economics, speed, performance, accessibility, administrative needs and security all play a vital role in dictating your approach to the cloud. Without knowing the right questions to ask, you could wind up paying for capacity you'll never need or underestimating the resources required to run your applications.
Ovum, a leading technology analyst firm, has published an in-depth report, Ovum Decision Matrix: Selecting a DevOps Release Management Solution, 2016–17. The report focuses on the automation aspects of DevOps, Release Management and compares solutions from the leading vendors.
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
UpGuard has become a member of the Center for Internet Security (CIS), and will continue to help businesses expand visibility into their cyber risk by providing hardening benchmarks to all customers. By incorporating these benchmarks, UpGuard's CSTAR solution builds on its lead in providing the most complete assessment of both internal and external cyber risk. CIS benchmarks are a widely accepted set of hardening guidelines that have been publicly available for years. Numerous solutions exist t...
Up until last year, enterprises that were looking into cloud services usually undertook a long-term pilot with one of the large cloud providers, running test and dev workloads in the cloud. With cloud’s transition to mainstream adoption in 2015, and with enterprises migrating more and more workloads into the cloud and in between public and private environments, the single-provider approach must be revisited. In his session at 18th Cloud Expo, Yoav Mor, multi-cloud solution evangelist at Cloudy...
Extreme Computing is the ability to leverage highly performant infrastructure and software to accelerate Big Data, machine learning, HPC, and Enterprise applications. High IOPS Storage, low-latency networks, in-memory databases, GPUs and other parallel accelerators are being used to achieve faster results and help businesses make better decisions. In his session at 18th Cloud Expo, Michael O'Neill, Strategic Business Development at NVIDIA, focused on some of the unique ways extreme computing is...
Qosmos has announced new milestones in the detection of encrypted traffic and in protocol signature coverage. Qosmos latest software can accurately classify traffic encrypted with SSL/TLS (e.g., Google, Facebook, WhatsApp), P2P traffic (e.g., BitTorrent, MuTorrent, Vuze), and Skype, while preserving the privacy of communication content. These new classification techniques mean that traffic optimization, policy enforcement, and user experience are largely unaffected by encryption. In respect wit...
The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
Security, data privacy, reliability, and regulatory compliance are critical factors when evaluating whether to move business applications from in-house, client-hosted environments to a cloud platform. Quality assurance plays a vital role in ensuring that the appropriate level of risk assessment, verification, and validation takes place to ensure business continuity during the migration to a new cloud platform.
Aspose.Total for .NET is the most complete package of all file format APIs for .NET as offered by Aspose. It empowers developers to create, edit, render, print and convert between a wide range of popular document formats within any .NET, C#, ASP.NET and VB.NET applications. Aspose compiles all .NET APIs on a daily basis to ensure that it contains the most up to date versions of each of Aspose .NET APIs. If a new .NET API or a new version of existing APIs is released during the subscription peri...
There will be new vendors providing applications, middleware, and connected devices to support the thriving IoT ecosystem. This essentially means that electronic device manufacturers will also be in the software business. Many will be new to building embedded software or robust software. This creates an increased importance on software quality, particularly within the Industrial Internet of Things where business-critical applications are becoming dependent on products controlled by software. Qua...
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
"We host and fully manage cloud data services, whether we store, the data, move the data, or run analytics on the data," stated Kamal Shannak, Senior Development Manager, Cloud Data Services, IBM, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
DevOps at Cloud Expo – being held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Am...
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, discussed how research has demonstrated the value of Machine Learning in delivering next generation analytics to imp...
With the proliferation of both SQL and NoSQL databases, organizations can now target specific fit-for-purpose database tools for their different application needs regarding scalability, ease of use, ACID support, etc. Platform as a Service offerings make this even easier now, enabling developers to roll out their own database infrastructure in minutes with minimal management overhead. However, this same amount of flexibility also comes with the challenges of picking the right tool, on the right ...
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...