|By Bob Gourley||
|August 12, 2014 09:53 PM EDT||
Editor’s note: On Wednesday 30 July 2014 analysts, executives and technologists gathered at our Analyst Forum, an event established by a partnership between AnalystOne and the United States Geospatial Intelligence Foundation (USGIF) to help share lessons learned across multiple sectors of the economy, including finance, healthcare, law enforcement, emergency response, scientific research, ecommerce, IT, intelligence, and the military.
We had analysts at the event capturing content that we will summarize here over the next few weeks. And we are surveying 280 people who engaged with us to ensure we are capturing the most important results of the event as well as gaps this community believes we should be collectively tackling to improve the state of analysis. All of this will be shaping our reporting here.
In the post below Katie Kennedy provides a high level overview of the event. Stand by for more details.
30 July Analyst Forum: The First Report/Summary
Analytics 2014: Insights for Mission impact began with opening remarks from Keith Masback, Chief Executive Officer, United States Geospatial Intelligence Foundation (USGIF). Keith welcomed all and helped bring focus to some of the opportunities the event could help the community achieve. Keith has been an analyst and a leader of analysts and is now a key champion of mission focused capabilities including those supporting the analytical community. He brings knowledge of technology and methodology and critical important missions to this topic. His key message in introducing the event was the criticality of the thoughts that would be exchanged today.
Bob Gourley welcomed attendees. Early on he underscored the gratitude the event organizers had for the sponsors. These firms sponsored the event because of their respect for the mission and understanding of the importance of this effort to the community and they are very much appreciated. Sponsors of the event are: Leidos, BAE Systems, Carahsoft, Cloudera, Digital Reasoning, Digital Globe, IBM and ICG.
Gourley also provided a heartfelt thanks to all attendees for coming, and spent time giving attendees a feel for who else is in the room. Attendees came from the finance sector, media outlets, ecommerce companies, retail companies, the heathcare sector, the scientific research community, law enforcement, plus multiple government agencies including DHS, DoD (Army, Navy, Air Force, Marines ), NRO, DIA, NGA, NIH, NCI, DoT, Treasury, State, VA, HHS, and many others. Commercial firms present included multiple participants from systems integrators with analytical capabilities, high tech analytical tool companies like Recorded Future,WayIn, Pentaho, Optensity and Hexis Cyber. Bob also took time to single out the company Cognitio, since that is the parent firm that sponsors CTOvision.com and AnalystOne.com and employs Bob.
Speakers at the event are all interesting with great backgrounds in analysis. Speakers included: Tom Lash, Jeff Jonas, Ilkay Altintas, Dave Warner, David Bray, Kirk Borne, Phil Bourne, Bob Grossman, John Harer, Kelly McCue, David Roberts, Abe Usher, Bill Wall, Carmen Medina, Ed Mornston, Mark Ashwell, William Nolte, Matt Devost, Adam Elkus, Ned Moran, Erin Simpson, Dave Gauthier, Bob Jimenez, Jason Thomas, and Scott Sorensen,
Tom Lash of Leidos, a key community thought leader on topics of analytics provided a welcome and an introduction to Jeff Jonas, our first morning discussant. Jeff is widely known in the analytical community for his ability to generate thoughts of direct and impactful relevance to helping people get their missions done. He is also highly regarded as a creator of both concepts and technology that add real value to organizations. Jonas has directed the design and development of multiple innovative systems, including solutions which have countered fraud in the gaming industry (See Jeff’s bio here).
Jonas prepared visuals that paired incredibly well with the messages in his presentation. It was a great help to expanding our thoughts to get Jeff’s perspectives on topics like detection of asteroids and then further turning observations into predictions of asteroid route and event predictions of future observable events like asteroid collisions. This important topic was used to underscore the importance of context when doing analysis. This theme of context was critically important to Jeff’s presentation and was also a recurring theme hit upon many other times throughout the day.
Jeff’s approach is to seek not just a little data, but as much data as possible. And of course to seek and leverage context. There needs to be more data to make better predictions, as well as filling in the gaps where there is not enough data. Jonas used the example of twins. If you have two people who look identical in every way and every feature determines them as one entity, how can you distinguish them? Therein lies the fact that two identical things cannot occupy the same space at the same time. To distinguish the two, there has to be data that supports the case that they are indeed two separate people. The more data gathered, the easier it would be to distinguish the twins and find they are two separate and distinct individuals.
By the way, Jeff received thunderous applause. It was great having him interacting with us all throughout the day to help underscore the lessons he left us with.
Bob introduced the next speaker, Dr. Ilkay Altintas, the Director for the Center of Excellence in Workflows for Data Science at the San Diego Supercomputer Center (SDSC), UCSD. Altintas addressed the question of “why data science workflows?” She answered, “workflows contain a lot of small steps that become programmable and reproducible scalability.” A project the SDSC has been successfully working on is entitled “WIFIRE”, a scalable data-driven monitoring, dynamic prediction and resilience cyberinfrastructure for predicting and monitoring wildfires. Wildfires are difficult to predict, therefore WIFIRE supports an integrated process that analyzes wildfires, incorporating observations with real-time data.
Bob asked Dr. Altintas to discuss “The Scientific Method.” Here is the idea we pondered: almost all of us grew up learning “The Scientific Method”. The scientific method of observation, hypothesis, prediction, experimenting is still critically important. But because of new technologies available to researchers and the incredible amount of data available, it is no longer the only workflow available to construct workable models of the world or to advance science and understanding. Dr. Altintas provided context on this topic that underscored the importance of considering workflows in analytical processes at any sector.
Bob then introduced Dr, Dave Warner, M.D., Ph.D., Medical Neuroscientist and the Director of Medical Intelligence at MindTel. Dr. Warner opened with “Computers are rocks that do math and they should worship us”. His idea that “dots are stupid” led to his highly innovative creation of hyper dimensional dots, where an observer can see thousands of different information on the dot, while taking advantage of abstract information. The dots are geolocated allowing the viewer of the dot to hover over an area and instantly have access to densely populated information on the area observed. Creating the models of information preserves relationships and transformation. Each 3-dimensional dot instantly presented multiple facets of data collected in a way that was easily understood by the vast majority of people.
After a short morning break for direct networking, everyone was ushered back into the hall where the next speaker was poised and ready to address the audience. Dr. David A. Bray, Chief Information Officer, FCC, prompted the question of “how to tackle the changing world?” Points he drove home through example after example were that analysts needed enhanced context to ensure optimal assessments. Among the many considerations he helped us think through were the fact that we all need to recognize that you can’t just build higher walls for Internet security. Computers need to alert humans when a threat arises. The FCC is making an application that will send pings during a crisis, constantly updating individuals while simultaneously sending feedback to responders. Innovation is needed more than ever; can public service change quickly enough? It is a technology as well as a people issue. The future includes algorithms working alongside public service workers: when will having software make an unbiased recommendation better than a human? Humans are biased, so maybe algorithms are better for decision-making in some cases. In all cases, context is important.
The next segment included Cross-Sector Analytical Lessons Learned. The moderator was Dr. Kirk Borne, Data Scientist and Professor, George Mason University. Other segment participants included Dr. Philip E. Bourne, Associate Director for Data Science, National Institutes of Health; Dr. Robert Grossman, Director, Center for Data Intensive Science, University of Chicago; and Partner, Open Data Group; and Dr. John Harer, Professor of Mathematics and Computer Science, Duke University. Each individual had their own unique lessons they had learned. First was Dr. Borne, he addressed his lesson with the idea that no matter what field you are in, you can talk with people in other fields when you are speaking the trans-disciplinary language of data science. Second was Dr. Bourne, reasoning that answers to big data problems can come from anywhere either cofounded in a journal, a pandemic modeling article, or a 15 year old who was published in a leading journal. Third was Dr. Grossman, addressing that all men can see tactics, but who can see strategy? Tools are understood, but strategy is not as thought-through. Lastly, Dr. Harer prompted that successful collaborations have understandings of shared work, learning others’ languages and fields, and working with someone who needs you and who wants you to need them. Each panelist emphasized that there were many lessons learned and many more to come.
The next panel was law enforcement, with moderator: Dr. Colleen “Kelly” McCue, Senior Director, Social Science & Quantitative Methods, DigitalGlobe Analytics. The panelists were David J. Roberts, Senior Program Manager, IACP Technology Center, International Association of Chiefs of Police; Abe Usher, Chief Technology Officer, HumanGeo; and Bill Wall, Vice President, Praescient Analytics. Each individual on this panel presented around a central theme that positively correlated better law enforcement and increased data usage. Usher presented on the lessons learned from the London Olympics. He said that as law enforcers, there should be proper identification of observation space and the creation of simple systems for recognizing normal and abnormal behavior. If there is a baseline, then it would be simple to find the abnormal. Next Wall addressed the London riots of 2011, relative to geospatial technology. Wall addressed that there should be geospatial data to build a database of individuals and incidents. Geospatial aspects of big data give us special capabilities to contextualize events. For the London riots, using the geospatial technology, law enforcers were able to find the rioters prior to their insurrection. Next, McCue presented on the Northern Virginia shooting incident that was solved using geospatial predictive analytics providing the high probability target areas that led to the suspect’s arrest. Lastly, Roberts brought to the audiences’ attention the immense impact the poor economy has had on the police workforce. Optimizing resources is extremely important and information-sharing capabilities are essential. Research has emerged looking at crime analysis data to identify systemic problems. Having data can create a mosaic, where many pixels create an image that can be used to solve crimes. The increased gathering of data has led to significant breakthroughs in solving crime.
After a lunch reception and exhibits, the next panel eagerly anticipated the audience’s return to their seats. The next panel was the Education of the Analyst, with Carmen Medina, Specialist Leader, Deloitte Consulting; Ed Mornston, Director, Human Development Directorate, National Geospatial-Intelligence Agency; and Dr. William Nolte, Program Director, Intelligence Center of Academic Excellence, University of Maryland School of Public Policy, and Mr. Mark Ashwell, internationally known developer of analytical strategies who has served as director of intelligence at the Royal Air Force and other UK MoD positions. Medina addressed cognitive diversity and the future of intelligence work, meaning that not all thinkers are the same and there are inherent cognitive differences. She shared the formula calculating what you know as reality – observation error – bias = what you know. Mornston followed with the idea of creating a culture of learning where there is a thirst for innovation, while addressing challenges from declining resources. He urged that agility is key and needs must be anticipated. Nolte pointed out that there are now technically illiterate students and technologists with little worldliness. Analysts must think analytically, not tactically. The 21st century intelligence will be about information, not secrets, like the 20th century. Ashwell stated that the main issue is the challenge of using open source and classified information; analysts must be able to use both to not fall behind. Analysts are not prepared for using big data, we must move from the word to visualization.
In the question and answer session, Dr. Ilkay Altinas asked about the new age of data around individuals and the need for individuals to have data analysis skills and requested panelist thoughts on that topic. This powerful question generated great discussion and is a topic we will continue to help think and write about.
The following panel addressed the analytics of cyber conflict with moderator Matt Devost, President & CEO, FusionX and panelists Adam Elkus, Senior Analyst at Analyst One, Strategic Planner and Ph.D. Student, Computational Social Science, George Mason University; and Ned Moran, Professor, Analyst, Cyber Practitioner. Elkus started the discussion with the notion that cyber conflict takes place in a human made environment and within natural laws. It is a tangled mess of man and machines. What you intend a machine to do is not what it actually does. A lot of cyber issues come down to adaptation and speed. Moran stated that cyber threat intelligence means having better informed defensive decisions. There is a need to get ahead of the attacker through analysis. Moran addressed how we defend against attackers. The landscape is changing, but still the defenders are the ones always responding to the attackers. Moran said that “humans always make mistakes and attackers take advantage”. Cyber conflict is a defenders game and will be for a while.
The final panel was Lessons From and for the National Security Community, with moderator: Dr. Erin M. Simpson, Chief Executive Officer, Caerus Associates and panelists Dave Gauthier, Activity Based Intelligence Portfolio Lead, Analysis Directorate, National Geospatial-Intelligence Agency; Bob Jimenez, Chief Technology Officer, National Reconnaissance Office; and Jason Thomas, Manager of Innovation for the Government, Thomson Reuters. This panel addressed the challenges with data in national security. A few challenges include how data correlates, how to engage an NRO user, and how to recruit people to solve problems. Thomas said that “we have to adapt to what we think is coming, which is not a lateral movement”. In some cases we store more data than necessary and in others, we can’t get our hands on data we need.
The final speaker was Scott Sorensen, Chief Technology Officer, Ancestry.com. His presentation started with a fantastic way to grab the attention of everyone in the room. We all know Ancestry.com and the overview and insights of the technological approaches there (and impact on solutions for customers) really riveted everyone’s attention. “At Ancestry.com, we tell stories from data; we fill in the gaps of family history. With the use of AncestryDNA, we have collected sampled from 500,000 people and found over 10,000,000 fourth cousin matches. We provide context to family history by working with government agencies and churches.” Handwriting recognition locates words on a handwritten document, extracts the words and makes the documents easier to place in family trees. The exciting stories lead directly to very relevant conclusions for any organization seeking to enhance analysis, in any sector. We will provide details on these lessons in coming posts, Scott has agreed to share his graphics with us and they flow directly to those lessons, so stand by for more. The short version, however, is this: How you organize you analytical efforts, including the people working them and even where they sit, is of critical importance. Getting groups to work together is a challenge especially with scientists and software engineers.
The event ended on a high note, and everyone, excited from the day’s events, filed into the adjacent room to mingle and discuss the information learned. The end of day networking allowed for attendees to more deeply connect and interact with each other and speakers.
We will be publishing more on this event and its conclusions will drive our lessons learned throughout the year. To stay in touch with us and to continue to interact with the community, sign up for the AnalystOne report and other newsletters here. Also follow us on Twitter at @AnalystReport.
We would like to conclude this overview with a huge thank you to the team at USGIF who worked tirelessly to ensure this event would come off without a hitch. Their attention to detail and focus on getting the right things done went above and beyond the call of duty
The Internet of Things is tied together with a thin strand that is known as time. Coincidentally, at the core of nearly all data analytics is a timestamp. When working with time series data there are a few core principles that everyone should consider, especially across datasets where time is the common boundary. In his session at Internet of @ThingsExpo, Jim Scott, Director of Enterprise Strategy & Architecture at MapR Technologies, discussed single-value, geo-spatial, and log time series dat...
Jan. 30, 2015 04:45 AM EST Reads: 3,109
Cultural, regulatory, environmental, political and economic (CREPE) conditions over the past decade are creating cross-industry solution spaces that require processes and technologies from both the Internet of Things (IoT), and Data Management and Analytics (DMA). These solution spaces are evolving into Sensor Analytics Ecosystems (SAE) that represent significant new opportunities for organizations of all types. Public Utilities throughout the world, providing electricity, natural gas and water,...
Jan. 30, 2015 04:30 AM EST Reads: 3,143
The 3rd International Internet of @ThingsExpo, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that its Call for Papers is now open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
Jan. 30, 2015 03:30 AM EST Reads: 3,088
SYS-CON Media announced that Splunk, a provider of the leading software platform for real-time Operational Intelligence, has launched an ad campaign on Big Data Journal. Splunk software and cloud services enable organizations to search, monitor, analyze and visualize machine-generated big data coming from websites, applications, servers, networks, sensors and mobile devices. The ads focus on delivering ROI - how improved uptime delivered $6M in annual ROI, improving customer operations by minin...
Jan. 30, 2015 03:30 AM EST Reads: 3,812
The true value of the Internet of Things (IoT) lies not just in the data, but through the services that protect the data, perform the analysis and present findings in a usable way. With many IoT elements rooted in traditional IT components, Big Data and IoT isn’t just a play for enterprise. In fact, the IoT presents SMBs with the prospect of launching entirely new activities and exploring innovative areas. CompTIA research identifies several areas where IoT is expected to have the greatest impac...
Jan. 30, 2015 03:00 AM EST Reads: 1,859
There is no doubt that Big Data is here and getting bigger every day. Building a Big Data infrastructure today is no easy task. There are an enormous number of choices for database engines and technologies. To make things even more challenging, requirements are getting more sophisticated, and the standard paradigm of supporting historical analytics queries is often just one facet of what is needed. As Big Data growth continues, organizations are demanding real-time access to data, allowing immed...
Jan. 30, 2015 03:00 AM EST Reads: 3,424
The Internet of Things will greatly expand the opportunities for data collection and new business models driven off of that data. In her session at @ThingsExpo, Esmeralda Swartz, CMO of MetraTech, discussed how for this to be effective you not only need to have infrastructure and operational models capable of utilizing this new phenomenon, but increasingly service providers will need to convince a skeptical public to participate. Get ready to show them the money!
Jan. 30, 2015 02:30 AM EST Reads: 3,003
In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect at GE, and Ibrahim Gokcen, who leads GE's advanced IoT analytics, focused on the Internet of Things / Industrial Internet and how to make it operational for business end-users. Learn about the challenges posed by machine and sensor data and how to marry it with enterprise data. They also discussed the tips and tricks to provide the Industrial Internet as an end-user consumable service using Big Data Analytics and Industrial C...
Jan. 30, 2015 01:00 AM EST Reads: 2,902
How do APIs and IoT relate? The answer is not as simple as merely adding an API on top of a dumb device, but rather about understanding the architectural patterns for implementing an IoT fabric. There are typically two or three trends: Exposing the device to a management framework Exposing that management framework to a business centric logic Exposing that business layer and data to end users. This last trend is the IoT stack, which involves a new shift in the separation of what stuff happe...
Jan. 30, 2015 12:30 AM EST Reads: 3,045
The 4th International DevOps Summit, co-located with16th International Cloud Expo – being held June 9-11, 2015, at the Javits Center in New York City, NY – announces that its Call for Papers is now open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's large...
Jan. 29, 2015 10:00 PM EST Reads: 3,685
The adoption of the Internet Of Things (IoT) is growing and its growth is synonymous with the growth of cloud. As per predictions from IDC: IoT and the Cloud: Within the next five years, more than 90% of all IoT data will be hosted on service provider platforms as cloud computing reduces the complexity of supporting IoT "Data Blending." This means that any organization that wanted to transform themselves using IoT has to automatically embrace the cloud too, especially the public cloud. This b...
Jan. 29, 2015 06:15 PM EST Reads: 399
The Internet of Things (IoT) is rapidly in the process of breaking from its heretofore relatively obscure enterprise applications (such as plant floor control and supply chain management) and going mainstream into the consumer space. More and more creative folks are interconnecting everyday products such as household items, mobile devices, appliances and cars, and unleashing new and imaginative scenarios. We are seeing a lot of excitement around applications in home automation, personal fitness,...
Jan. 29, 2015 06:00 PM EST Reads: 3,043
Dale Kim is the Director of Industry Solutions at MapR. His background includes a variety of technical and management roles at information technology companies. While his experience includes work with relational databases, much of his career pertains to non-relational data in the areas of search, content management, and NoSQL, and includes senior roles in technical marketing, sales engineering, and support engineering. Dale holds an MBA from Santa Clara University, and a BA in Computer Science f...
Jan. 29, 2015 06:00 PM EST Reads: 3,289
“We help people build clusters, in the classical sense of the cluster. We help people put a full stack on top of every single one of those machines. We do the full bare metal install," explained Greg Bruno, Vice President of Engineering and co-founder of StackIQ, in this SYS-CON.tv interview at 15th Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Jan. 29, 2015 02:45 PM EST Reads: 2,496
"People are a lot more knowledgeable about APIs now. There are two types of people who work with APIs - IT people who want to use APIs for something internal and the product managers who want to do something outside APIs for people to connect to them," explained Roberto Medrano, Executive Vice President at SOA Software, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Jan. 29, 2015 02:30 PM EST Reads: 2,632
In this demo at 15th Cloud Expo, John Meza, Product Engineer at Esri, showed how Esri products hook into Hadoop cluster to allow you to do spatial analysis on the spatial data within your cluster, and he demonstrated rendering from a data center with ArcGIS Pro, a new product that has a brand new rendering engine.
Jan. 29, 2015 02:30 PM EST Reads: 1,706
Performance is the intersection of power, agility, control, and choice. If you value performance, and more specifically consistent performance, you need to look beyond simple virtualized compute. Many factors need to be considered to create a truly performant environment. In his General Session at 15th Cloud Expo, Harold Hannon, Sr. Software Architect at SoftLayer, discussed how to take advantage of a multitude of compute options and platform features to make cloud the cornerstone of your onlin...
Jan. 29, 2015 02:15 PM EST Reads: 3,197
Hardware will never be more valuable than on the day it hits your loading dock. Each day new servers are not deployed to production the business is losing money. While Moore's Law is typically cited to explain the exponential density growth of chips, a critical consequence of this is rapid depreciation of servers. The hardware for clustered systems (e.g., Hadoop, OpenStack) tends to be significant capital expenses. In his session at Big Data Expo, Mason Katz, CTO and co-founder of StackIQ, disc...
Jan. 29, 2015 02:00 PM EST Reads: 3,205
Software Defined Storage provides many benefits for customers including agility, flexibility, faster adoption of new technology and cost effectiveness. However, for IT organizations it can be challenging and complex to build your Enterprise Grade Storage from software. In his session at Cloud Expo, Paul Turner, CMO at Cloudian, looked at the new Original Design Manufacturer (ODM) market and how it is changing the storage world. Now Software Defined Storage companies can build Enterprise grade ...
Jan. 29, 2015 02:00 PM EST Reads: 2,337
Since 2008 and for the first time in history, more than half of humans live in urban areas, urging cities to become “smart.” Today, cities can leverage the wide availability of smartphones combined with new technologies such as Beacons or NFC to connect their urban furniture and environment to create citizen-first services that improve transportation, way-finding and information delivery. In her session at @ThingsExpo, Laetitia Gazel-Anthoine, CEO of Connecthings, will focus on successful use c...
Jan. 29, 2015 01:30 PM EST Reads: 2,049