Click here to close now.


@BigDataExpo Authors: Dana Gardner, AppDynamics Blog, Esmeralda Swartz, Carmen Gonzalez, Liz McMillan

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Linux Containers, @BigDataExpo, SDN Journal

@CloudExpo: Article

The New Face of Procurement

Business success increasingly hinges on supply chain innovation and procurement advantages

The next BriefingsDirect thought-leader panel discussion focuses on the future of business and how companies can benefit from the new insight and analysis that transparent business networks and processes allow.

The power of data-driven business networks and the analytics derived from them are increasing, but how do enterprises best leverage that intelligence as they seek new services, products and efficiency? How do automation and intelligence enter the picture for better matching buyers and sellers?

BriefingsDirect had an opportunity to learn first-hand at the recent 2014 Ariba LIVE Conference in Las Vegas. To learn more about how business -- led by procurement -- is changing and evolving, and how to best exploit this new wave of innovation, we sat down with Rachel Spasser, Senior Vice President and Chief Marketing Officer at Ariba, an SAP company, and Andrew Bartolini, Chief Research Officer at Ardent Partners in Boston. The discussion is moderated by me, Dana Gardner, Principal Analyst at Interarbor Solutions.

Here are some excerpts:

Gardner: How is procurement maturing, and how do you see it expanding in terms of its strategic implications for any business?

Bartolini: Over the past 15 years, we really have experienced a procurement revolution, although at times it feels a little bit more evolutionary in nature.

In 2006, the average procurement organization, from our research, managed about 30 percent of their total spend. A mere seven-and-a-half years later, that number has doubled. So the average procurement organization is now influencing a majority of their total enterprise spend. The best in class, the leaders in the field, are now managing between 85-95 percent of total spend.


So procurement has risen in stature. There is now a chief procurement officer (CPO) or a single point of contact within a procurement operation at about 85 percent of organizations.

Procurement has stepped out of the back office and into the front ranks, and continues to gain in stature. As it gains in influence, it continues to guide organizations in making smart decisions within the organization and identifying the right business partners outside the organization.

Gardner: So procurement is really expanding, that it's growing up in a sense, not just a static business transaction, but something that is dynamic, living, and growing. Are more and more people getting involved with some of these newer technologies?

Spasser: If you think about the history of procurement, it really was a back-office function that was primarily focused on cost savings in a very tactical way for most companies. As we’ve seen that function evolve over the past 10 years, it has become much more strategic in nature, and it has an impact on much more than just cost savings for an enterprise.


There have been a lot of technological advances that have given the procurement professionals the ability to move from manual processes and manual tasks to automating those and therefore focusing on higher-order opportunities to deliver value to the company.

More getting involved

More people are getting involved. For the first couple of years, there were a lot of people sitting on the sidelines, watching what was happening and trying to understand how that could impact their businesses.

Today, people are embracing networks and embracing the opportunities that networks bring, such as e-invoicing. Today, something like 70 percent of companies are using e-invoicing in some capacity. That's a huge improvement and growth over even just a few years ago.

Gardner: We’ve seen the role and impact of social and community, of community vetting of processes, and people looking to their peers for trust and feedback. We know that’s impacted a lot of things. Is this playing a role in procurement as well? Is there a social factor here?

Spasser: There are plenty of opportunities in a couple of areas. First of all, from a risk-management perspective, having more information -- information that's both qualitative and quantitative -- is only going to help procurement organizations make better decisions.

When you look at the social and business networks, the community intelligence, and the data and the insights that live within that network, all of a sudden you’re providing infinitely more information and making the procurement executives smarter, enabling them to make better business decisions, and changing the nature of their game.

Instead of having to respond reactively to changes within the macro environment or within their supply chain, you now have the ability to arm them with information that can make them proactive in their decision making, and proactive in their approach to finding new suppliers, managing existing suppliers, and that really does change the game.

Fertile time

Gardner: It strikes me that the transparency and the ability to qualify and quantify have given us some really new and interesting services such as Dynamic Discounting, like the ability to create AribaPay, and also learn about innovation in the field. We have heard about MSC, where they’re pushing their ability to deliver inventory right into their customer's environment. So, it’s a very fertile time for business procurement processes.

Any thoughts about where the next level of analysis or insight will come?

Spasser: Absolutely. Just going back to your comments on Dynamic Discounting and AribaPay, when you look at procurement, both Andrew and I have talked about it becoming a more strategic function.

When procurement starts impacting the cash flow and the working-capital management of companies through opportunities like Dynamic Discounting or AribaPay, all of a sudden, it enters a completely different realm in terms of its importance and in terms of the amount of respect and inclusion that it gets sitting at the executive table within companies.

If you arm people with information, they have the ability to make better business decisions.

When you talk about what’s next, there are lots of different directions in which procurement can go with the information that they’re given. We talked about risk management, but as companies are coming up with corporate-responsibility mandates, whether that’s sustainability or green or fair labor practices, they can be negatively impacted if they don't truly understand every tier within their supply chain.

And we see this with companies like the Gap or Lululemon in the consumer packaged goods (CPG) and retail space, where these companies have really suffered severe brand damage as a result of having issues within tiers 2, 3, 4 and beyond in their supply chain. That’s one example, but it's a powerful example of how, if you arm people with information, they have the ability to make better business decisions.

Whether that’s a business decision related to offering a discount or whether that’s a business decision about choosing to do business with a supplier or not, based on what you know about them or their second and third tier suppliers, all of this is really important and it's changing the nature of procurement.

Gardner: You brought up governance, risk, and compliance (GRC). I had a very interesting discussion here at Ariba LIVE about InfoNet, using that in association with the data from Ariba Network, and reducing that risk by being able to predict using advanced algorithms and very complex and powerful analytics platforms to see into the future and predict when risks are unacceptable.

Andrew, you’re saying that procurement taps this intelligence, and things like InfoNet have predictive abilities. What is the market telling you, and how far are we into this? Have we just scratched the surface of analytics or are we into the third inning?

Early in the game

Bartolini: With the maturation of the procurement function, we’re still in the early part of the ballgame. If you look at the leading procurement organizations today, the characteristics of these best-in-class organizations are process, discipline, an ability to execute, and driving efficiencies and effectiveness.

What's now prized within the larger enterprise and within procurement itself is the ability to be agile and to drive innovation. This has effectively pulled procurement further into the spotlight, as it really does serve as a process hub within the organization and it really does serve as the prime relationship point for third-party suppliers.

The good news in all of this is that the technology that was introduced also around the time that we started thinking about the procurement revolution has finally started to catch up to the actual user needs, from a usability standpoint, from an integration standpoint, from a time-to-value standpoint.

We’re seeing organizations now move from the initial adoption, where they are just trying to get activity through their systems, to becoming more effective in their usage of these systems and technology.

The skills that reside within the average procurement organization are not where they need to be to be thought of as world class or operational excellence.

When you look at the challenges that a CPO faces, a lot of that is driven by the talent that resides within the organization. Sometimes that's doing more with less. It’s very hard for CPOs to get a new job requisition, even in very large companies, it's a challenge to get that investment in procurement.

Also, the skills that reside within the average procurement organization are not where they need to be to be thought of as world class or operational excellence.

Enter technology and automation. When you look at the reams of data that sourcing and procurement activity generate, the skills of the average procurement organization to go in and analyze and find the right trends, whether that’s pricing trends or identifying key risks, is still not where it needs to be. So, it’s early stages there.

But with things like InfoNet and business networks you’re starting to see the co-location of transactional information, communication that supports those transactions, and then an ability to analyze and make decisions based upon that, all within one central location. That's a very powerful asset for procurement.

Gardner: And not only in one location, but in a cloud environment, where information from an entire industry can be brought together with the proper anonymization, security, and privacy in place -- but then the insights can be global or scaled down to individual organizations.

Opening up

Bartolini: This is an area where enterprises are finally opening up. I worked in this industry 15 years ago, and everything was very proprietary -- our requirements on certain products or items or how much we were spending.

The Internet has really opened it up. Information is at everyone's fingertips. Organizations are starting to understand that there is value that can be created by sharing information in an industry, and particularly with trading partners.

From our research, we’re seeing that organizations can invest in a business network today and get a payback within a year, just based simply on transactional efficiencies.

Where this gets more interesting is when you start to introduce other social aspects. When you start to introduce third-party specialists, who can offer services that add value to all of the participants in a network, it becomes a very interesting place to be. That’s why there's such interest and excitement around business networks.

Leveraging specific skills will be more important, whether that's through contingent workforce or through hiring to very specific skills.

Gardner: It strikes me too that procurement is expanding its importance to companies. When we think about some of the labor issues that many are forecasting with the workforce of the future, it’s going to be difficult to get a highly skilled full-time employee. Or you might want to have them for a shorter period of time. So procurement becomes a facet of hiring. It becomes a labor-acquisition process as well, and then, of course, it goes to more services than just products or merchandise alone.

Rachel, the question is how strategic do companies view this? Andrew says that we need to get more competency and sophistication in procurement. Do companies appreciate that this is really more and more a part of their core assets strategy and a core competency?

Spasser: Definitely. Even this morning, I was speaking with a number of CPOs who talked about human resources as a key factor in whether they’re going to be able to get to the next business level.

I would agree wholeheartedly with Andrew that the skill set is going to be different than it has been in the past. Leveraging specific skills will be more important, whether that's through contingent workforce or through hiring to very specific skill sets.

One of the interesting things that we’re seeing is that, in a lot of companies, the procurement function becomes a rotation within the executive ranks, as they’re bringing people up and training them to be in higher levels of management. We see many of our customers taking people who really don't have a traditional procurement background and cycling them through the procurement function.

In fact, SAP is doing that itself. Marcell Vollmer, who has been a great advocate of Ariba, is not a procurement guy by trade, but has really made a huge impact on SAP procurement because he brings a different skill set. He brings that analytic background, and he brings that general business and relationship management savvy.

Complex services


When you look at the types of spend that companies are trying to attack today, you’re looking at complex services and you’re looking at a contingent workforce. Those take on a life of their own, because they are very, very different than buying a physical good.

We live in a service economy, and as that continues to evolve, it’s going to become more and more important to procurement and to companies as a whole.

Gardner: Andrew, thinking a little bit toward the future, we’ve talked about procurement now having a heightened role and a larger profile because of the analytics that are being brought to bear: The wider purview across services, and the impact with human resources, rather than just goods and materials and facilities.

As we get to more of a digital economy, a networked economy, like we’ve seen in consumer behavior, what do you see for companies when it comes to this notion of a shared supply chain -- that we’re all interdependent parts of a supply chain, and that we need to be thinking about it differently? Where is the shift in thinking that needs to come, and where does your crystal ball show you we’ll be in five years?

The consumer today really expects better, newer, and more innovative products in a rapid fashion and at a cheaper cost.

Bartolini: The consumer today really expects better, newer, and more innovative products in a rapid fashion and at cheaper cost. That's the world of procurement.

If you’re a procurement professional and your supply base looks much like it did 10 years ago, there are problems on the horizon. If your supply chain and your supply base looks like it does today come 10 years from now, there’s going to be questions as to the viability of your company.

The speed of business is most visible in areas like consumer electronics. You see the leaders in smartphones in one cycle are out of business five years later. This is happening in other supply markets. It’s not as visible, and maybe it's not as fast, but it is happening!

Organizations understand that the window of opportunity to generate a premium on their products and services has collapsed, and they’re increasingly relying on their supply chains to support capitalizing on those opportunities. That really creates a shift from net-sum negotiations to win-win negotiations. That creates a shift from managing contracts and service-level agreements (SLAs), to managing business outcomes. That really changes the view of a supplier from an order taker to one that’s a key collaborator.

Gardner: Rachel, thinking about organizations wanting to do this better, maybe they listen to this podcast or read this and they think, “I see procurement as more of a core competency, having a greater impact on our company. If we need to move at the speed of business going forward, we need to get better at this.” How do you start? Any ideas about resources, methodologies, and workshops? How do you get a new procurement competency process going in your organization?

Spasser: One of the greatest ways to learn is to learn from your peers. Conferences like Ariba LIVE really provide that opportunity, because you get the best of the best, and they’re sharing their true stories. And it's not just success. They’re sharing their pitfalls too, and they are sharing how they navigated through those to achieve the business outcomes that they sought.

Talk to peers

There are lots of books to read and experts to talk to, but I think that the best way to learn is to talk to peers who have been through the same process and who have candid feedback and candid advice to share.

Gardner: Perhaps identifying leaders and influencers in your field and following them on blogs or Twitter or other community-based and social-based interactions?

Spasser: Absolutely. There are plenty of communities, whether they’re on LinkedIn or whether they’re proprietary, like Ariba Exchange, and these discussions are happening everyday. I would encourage people to seek those out, participate in them, go to events, and really learn from those who are leading the way, because if they are not going to be on the train quickly, they are going to find themselves left way behind at the station.

You may also be interested in:

More Stories By Dana Gardner

At Interarbor Solutions, we create the analysis and in-depth podcasts on enterprise software and cloud trends that help fuel the social media revolution. As a veteran IT analyst, Dana Gardner moderates discussions and interviews get to the meat of the hottest technology topics. We define and forecast the business productivity effects of enterprise infrastructure, SOA and cloud advances. Our social media vehicles become conversational platforms, powerfully distributed via the BriefingsDirect Network of online media partners like ZDNet and As founder and principal analyst at Interarbor Solutions, Dana Gardner created BriefingsDirect to give online readers and listeners in-depth and direct access to the brightest thought leaders on IT. Our twice-monthly BriefingsDirect Analyst Insights Edition podcasts examine the latest IT news with a panel of analysts and guests. Our sponsored discussions provide a unique, deep-dive focus on specific industry problems and the latest solutions. This podcast equivalent of an analyst briefing session -- made available as a podcast/transcript/blog to any interested viewer and search engine seeker -- breaks the mold on closed knowledge. These informational podcasts jump-start conversational evangelism, drive traffic to lead generation campaigns, and produce strong SEO returns. Interarbor Solutions provides fresh and creative thinking on IT, SOA, cloud and social media strategies based on the power of thoughtful content, made freely and easily available to proactive seekers of insights and information. As a result, marketers and branding professionals can communicate inexpensively with self-qualifiying readers/listeners in discreet market segments. BriefingsDirect podcasts hosted by Dana Gardner: Full turnkey planning, moderatiing, producing, hosting, and distribution via blogs and IT media partners of essential IT knowledge and understanding.

@BigDataExpo Stories
SYS-CON Events announced today that Super Micro Computer, Inc., a global leader in high-performance, high-efficiency server, storage technology and green computing, will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Supermicro (NASDAQ: SMCI), the leading innovator in high-performance, high-efficiency server technology is a premier provider of advanced server Building Block Solutions® for Data ...
SYS-CON Events announced today the Containers & Microservices Bootcamp, being held November 3-4, 2015, in conjunction with 17th Cloud Expo, @ThingsExpo, and @DevOpsSummit at the Santa Clara Convention Center in Santa Clara, CA. This is your chance to get started with the latest technology in the industry. Combined with real-world scenarios and use cases, the Containers and Microservices Bootcamp, led by Janakiram MSV, a Microsoft Regional Director, will include presentations as well as hands-on...
As more intelligent IoT applications shift into gear, they’re merging into the ever-increasing traffic flow of the Internet. It won’t be long before we experience bottlenecks, as IoT traffic peaks during rush hours. Organizations that are unprepared will find themselves by the side of the road unable to cross back into the fast lane. As billions of new devices begin to communicate and exchange data – will your infrastructure be scalable enough to handle this new interconnected world?
SYS-CON Events announced today that Dyn, the worldwide leader in Internet Performance, will exhibit at SYS-CON's 17th International Cloud Expo®, which will take place on November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Dyn is a cloud-based Internet Performance company. Dyn helps companies monitor, control, and optimize online infrastructure for an exceptional end-user experience. Through a world-class network and unrivaled, objective intelligence into Internet condit...
SYS-CON Events announced today that Sandy Carter, IBM General Manager Cloud Ecosystem and Developers, and a Social Business Evangelist, will keynote at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
The Internet of Things (IoT) is growing rapidly by extending current technologies, products and networks. By 2020, Cisco estimates there will be 50 billion connected devices. Gartner has forecast revenues of over $300 billion, just to IoT suppliers. Now is the time to figure out how you’ll make money – not just create innovative products. With hundreds of new products and companies jumping into the IoT fray every month, there’s no shortage of innovation. Despite this, McKinsey/VisionMobile data...
The IoT market is on track to hit $7.1 trillion in 2020. The reality is that only a handful of companies are ready for this massive demand. There are a lot of barriers, paint points, traps, and hidden roadblocks. How can we deal with these issues and challenges? The paradigm has changed. Old-style ad-hoc trial-and-error ways will certainly lead you to the dead end. What is mandatory is an overarching and adaptive approach to effectively handle the rapid changes and exponential growth.
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading in...
There will be 20 billion IoT devices connected to the Internet soon. What if we could control these devices with our voice, mind, or gestures? What if we could teach these devices how to talk to each other? What if these devices could learn how to interact with us (and each other) to make our lives better? What if Jarvis was real? How can I gain these super powers? In his session at 17th Cloud Expo, Chris Matthieu, co-founder and CTO of Octoblu, will show you!
The IoT is upon us, but today’s databases, built on 30-year-old math, require multiple platforms to create a single solution. Data demands of the IoT require Big Data systems that can handle ingest, transactions and analytics concurrently adapting to varied situations as they occur, with speed at scale. In his session at @ThingsExpo, Chad Jones, chief strategy officer at Deep Information Sciences, will look differently at IoT data so enterprises can fully leverage their IoT potential. He’ll sha...
The enterprise is being consumerized, and the consumer is being enterprised. Moore's Law does not matter anymore, the future belongs to business virtualization powered by invisible service architecture, powered by hyperscale and hyperconvergence, and facilitated by vertical streaming and horizontal scaling and consolidation. Both buyers and sellers want instant results, and from paperwork to paperless to mindless is the ultimate goal for any seamless transaction. The sweetest sweet spot in innov...
Today air travel is a minefield of delays, hassles and customer disappointment. Airlines struggle to revitalize the experience. GE and M2Mi will demonstrate practical examples of how IoT solutions are helping airlines bring back personalization, reduce trip time and improve reliability. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Dr. Sarah Cooper, M2Mi's VP Business Development and Engineering, will explore the IoT cloud-based platform technologies driv...
The Internet of Everything is re-shaping technology trends–moving away from “request/response” architecture to an “always-on” Streaming Web where data is in constant motion and secure, reliable communication is an absolute necessity. As more and more THINGS go online, the challenges that developers will need to address will only increase exponentially. In his session at @ThingsExpo, Todd Greene, Founder & CEO of PubNub, will explore the current state of IoT connectivity and review key trends an...
SYS-CON Events announced today that DataClear Inc. will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. The DataClear ‘BlackBox’ is the only solution that moves your PC, browsing and data out of the United States and away from prying (and spying) eyes. Its solution automatically builds you a clean, on-demand, virus free, new virtual cloud based PC outside of the United States, and wipes it clean...
SYS-CON Events announced today that Machkey International Company will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Machkey provides advanced connectivity solutions for just about everyone. Businesses or individuals, Machkey is dedicated to provide high-quality and cost-effective products to meet all your needs.
Nowadays, a large number of sensors and devices are connected to the network. Leading-edge IoT technologies integrate various types of sensor data to create a new value for several business decision scenarios. The transparent cloud is a model of a new IoT emergence service platform. Many service providers store and access various types of sensor data in order to create and find out new business values by integrating such data.
Too often with compelling new technologies market participants become overly enamored with that attractiveness of the technology and neglect underlying business drivers. This tendency, what some call the “newest shiny object syndrome,” is understandable given that virtually all of us are heavily engaged in technology. But it is also mistaken. Without concrete business cases driving its deployment, IoT, like many other technologies before it, will fade into obscurity.
There are so many tools and techniques for data analytics that even for a data scientist the choices, possible systems, and even the types of data can be daunting. In his session at @ThingsExpo, Chris Harrold, Global CTO for Big Data Solutions for EMC Corporation, will show how to perform a simple, but meaningful analysis of social sentiment data using freely available tools that take only minutes to download and install. Participants will get the download information, scripts, and complete en...
Achim Weiss is Chief Executive Officer and co-founder of ProfitBricks. In 1995, he broke off his studies to co-found the web hosting company "Schlund+Partner." The company "Schlund+Partner" later became the 1&1 web hosting product line. From 1995 to 2008, he was the technical director for several important projects: the largest web hosting platform in the world, the second largest DSL platform, a video on-demand delivery network, the largest eMail backend in Europe, and a universal billing syste...
Cloud computing delivers on-demand resources that provide businesses with flexibility and cost-savings. The challenge in moving workloads to the cloud has been the cost and complexity of ensuring the initial and ongoing security and regulatory (PCI, HIPAA, FFIEC) compliance across private and public clouds. Manual security compliance is slow, prone to human error, and represents over 50% of the cost of managing cloud applications. Determining how to automate cloud security compliance is critical...

Tweets by @BigDataExpo

@BigDataExpo Blogs
This week, the team assembled in NYC for @Cloud Expo 2015 and @ThingsExpo 2015. For the past four years, this has been a must-attend event for MetraTech. We were happy to once again join industry visionaries, colleagues, customers and even competitors to share and explore the ways in which the Internet of Things (IoT) will impact our industry. Over the course of the show, we discussed the types of challenges we will collectively need to solve to capitalize on the opportunity IoT presents.
Heat maps offer a unique way to represent data sets in a variety of settings. A common example you see most mornings is through weather reports on the news showing the movement and predictions of pressure and precipitation, intensifying across bold color schemes. Another familiar example is voting representation in specific areas of the country during election times (think red state vs. blue state). Retail stores utilize heat maps to enable managers and executives to better understand the functionality of their space, as well as the habits and preferences of the people entering the store.
Dasher Technologies is helping to usher in the democratization of big data value to more players in less time with analytics in a cloud services model
Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of at least three separate application components: the software embedded in the device, the backend big-data service, and the mobile application for the end user's controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/target - this makes the integration of these separate pipelines and the coordination of software upd...
“Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications and services) that can be rapidly provisioned and released with minimal management.” While this definition is broadly accepted and has, in fact, been my adopted standard for years, it only describes technical aspects of cloud computing. The amalgamation of technologies used to deliver cloud services is not even half the story. Above all else, the successful employment requires a tight linkage to the econ...
Today air travel is a minefield of delays, hassles and customer disappointment. Airlines struggle to revitalize the experience. GE and M2Mi will demonstrate practical examples of how IoT solutions are helping airlines bring back personalization, reduce trip time and improve reliability. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Dr. Sarah Cooper, M2Mi's VP Business Development and Engineering, will explore the IoT cloud-based platform technologies driving this change including privacy controls, data transparency and integration of real time context w...
DevOps Summit at Cloud Expo 2014 Silicon Valley was a terrific event for us. The Qubell booth was crowded on all three days. We ran demos every 30 minutes with folks lining up to get a seat and usually standing around. It was great to meet and talk to over 500 people! My keynote was well received and so was Stan's joint presentation with RingCentral on Devops for BigData. I also participated in two Power Panels – ‘Women in Technology’ and ‘Why DevOps Is Even More Important than You Think,’ both featuring brilliant colleagues and moderators and it was a blast to be a part of.
All we need to do is have our teams self-organize, and behold! Emergent design and/or architecture springs up out of the nothingness! If only it were that easy, right? I follow in the footsteps of so many people who have long wondered at the meanings of such simple words, as though they were dogma from on high. Emerge? Self-organizing? Profound, to be sure. But what do we really make of this sentence?
The potential of big data is only limited by the creative thinking of your business stakeholders, and that may be the most important concept in the “thinking like a data scientist” process. The “thinking like a data scientist” process guides the business stakeholders into envisioning how big data can optimize their key business processes, create a more compelling customer engagement and uncover new monetization opportunities. But neither the business stakeholders, nor the data scientists, can likely do that envisioning entirely by themselves.
Today’s modern day industrial revolution is being shaped by ubiquitous connectivity, machine to machine (M2M) communications, the Internet of Things (IoT), open APIs leading to a surge in new applications and services, partnerships and eventual marketplaces. IoT has the potential to transform industry and society much like advances in steam technology, transportation, mass production and communications ushered in the industrial revolution in the 18th and 19th centuries.
Disaster recovery (DR) has traditionally been a major challenge for IT departments. Even with the advent of server virtualization and other technologies that have simplified DR implementation and some aspects of on-going management, it is still a complex and (often extremely) costly undertaking. For those applications that do not require high availability, but are still mission- and business-critical, the decision as to which [applications] to spend money on for true disaster recovery can be a struggle.
SCOPE is an acronym for Structured Computations Optimized for Parallel Execution, a declarative language for working with large-scale data. It is still under development at Microsoft. If you know SQL then working with SCOPE will be quite easy as SCOPE builds on SQL. The execution environment is different from that RDBMS oriented data. Data is still modeled as rows. Every row has typed columns and eveyr rowset has a well-defined schema. There is a SCOPe compiler that comes up with optimized execution plan and a runtime execution plan.
If you’re running Big Data applications, you’re going to want to look at some kind of distributed processing system. Hadoop is one of the best-known clustering systems, but how are you going to process all your data in a reasonable time frame? MapReduce has become a standard, perhaps the standard, for distributed file systems. While it’s a great system already, it’s really geared toward batch use, with jobs needing to queue for later output. This can severely hamper your flexibility. What if you want to explore some of your data? If it’s going to take all night, forget about it.
Too many multinational corporations delete little, if any, data even though at its creation, more than 70 percent of this data is useless for business, regulatory or legal reasons.[1] The problem is hoarding, and what businesses need is their own “Hoarders” reality show about people whose lives are driven by their stuff[2] (corporations are legally people, after all). The goal of such an intervention (and this article)? Turning hoarders into collectors.
Today’s connected world is moving from devices towards things, what this means is that by using increasingly low cost sensors embedded in devices we can create many new use cases. These span across use cases in cities, vehicles, home, offices, factories, retail environments, worksites, health, logistics, and health. These use cases rely on ubiquitous connectivity and generate massive amounts of data at scale. These technologies enable new business opportunities, ways to optimize and automate, along with new ways to engage with users.

About @BigDataExpo
Big Data focuses on how to use your own enterprise data – processed in the Cloud – most effectively to drive value for your business.