Welcome!

@DXWorldExpo Authors: Pat Romanski, Ed Featherston, Elizabeth White, Liz McMillan, Jason Bloomberg

Related Topics: @DXWorldExpo, Microservices Expo, Linux Containers

@DXWorldExpo: Blog Post

NoSQL Databases and Large Web Applications By @MapR | @CloudExpo [#BigData]

What You Need to Know

NoSQL Databases to Support Large Web Applications

NoSQL databases are powerful tools for supporting big data applications, maximizing scalability, performance, and availability. Their unique features and easy implementation render them well-equipped to meet a variety of enterprise needs in a range of use cases.

NoSQL is a database technology that was developed to address critical issues today such as a huge increase in data volume, a high frequency of data access, and support for varying data formats. Relational database management systems (RDBMS), on the other hand, were not designed to face these challenges on a huge scale - nor were they built to take advantage of inexpensive commodity storage and processing power. NoSQL databases are increasingly viewed as the most suitable option for modern, high-demand applications.

NoSQL originated as an endeavor to build a database for modern applications that can scale rapidly. Popularized in 2009, NoSQL has seen dramatic growth in just a handful of years. All NoSQL databases were designed to increase the scaling, performance, and availability of large-scale applications, especially web applications. Pursuant to this goal, many RDBMS features have been left out, and instead, certain features were added to better support large data sets. One important component of NoSQL databases is the "sharding" of data. This feature helps the scale-out architecture of NoSQL technology to support a huge number of records - a problem area for the traditional relational model. By using thousands of servers in a clustered environment, NoSQL-based applications can support millions of users on terabytes of data with rapid response time.

NoSQL databases come in several forms:

  • Key-value store: This is the simplest NoSQL database. It stores each item with a lookup attribute (known as a "key") and associated value.
  • Wide-column stores: Also known as "column family stores," this type of NoSQL database can be described as a multi-dimensional sorted map which is persistent, distributed, and sparse. More simply, they have a data model that most closely resembles tables in an RDBMS.
  • Document database: This type of database consists of a key with an associated complex data structure. This complex data structure is known as a "document," which can itself hold key-value pairs, nested documents, or even key-array pairs.
  • Graph database: This is typically used to store data represented in the form of a graph, such as social connections.

So what are some suitable use cases for NoSQL? Here are a few situations that call for the powerful features of NoSQL databases:

  • Rapidly growing data sets: If your data continues to grow rapidly like in an Internet of Things environment, then you want a horizontal scaling architecture so you can simply add more servers to accommodate that growth. Horizontal scaling in a distributed environment is always a challenge for traditional database management systems.
  • Scalable BI and analytical applications: The volume and velocity of data is growing rapidly in many enterprises, and RDBMSs are under-equipped to handle analytical applications treating large volumes of data. A lot of time is wasted in loading, unloading, and querying warehouses in support of analytics. By moving some analytics tasks to a NoSQL database, you can free up your high end warehouses for time-sensitive, business-critical analytics.
  • Real-time analytics applications: Real-time analytics applications - including stock market analysis, fraud detection, and risk analysis - are often critical to manage. Data is typically collected from different sources and then analyzed in real time. NoSQL databases, especially when used with Apache Hadoop, are well-suited to support such operations.
  • Simple lookup-based database applications: Many business applications require only basic data storage and retrieval - so they do not want to take on the overhead or size of traditional RDBMSs. NoSQL databases avoid the unnecessary overhead in these simple applications.

For a simple yet highly capable tool to support large-scale web applications, NoSQL databases are your best bet. With their powerful capabilities, they can meet the needs of a variety of applications. MapR-DB, the wide-column NoSQL database that leverages the popular Apache HBase API, is a technology that can handle many different use cases while providing enterprise-grade reliability, extreme scalability, and high performance.

More Stories By Dale Kim

Dale is Director of Industry Solutions at MapR. His technical and managerial experience includes work with relational databases, as well as non-relational data in the areas of search, content management, and NoSQL. Dale holds an MBA from Santa Clara University, and a BA in Computer Science from the UC Berkeley.

@BigDataExpo Stories
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, discussed some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he covered some of the best practices for structured team migration an...
Product connectivity goes hand and hand these days with increased use of personal data. New IoT devices are becoming more personalized than ever before. In his session at 22nd Cloud Expo | DXWorld Expo, Nicolas Fierro, CEO of MIMIR Blockchain Solutions, will discuss how in order to protect your data and privacy, IoT applications need to embrace Blockchain technology for a new level of product security never before seen - or needed.
Blockchain is a shared, secure record of exchange that establishes trust, accountability and transparency across business networks. Supported by the Linux Foundation's open source, open-standards based Hyperledger Project, Blockchain has the potential to improve regulatory compliance, reduce cost as well as advance trade. Are you curious about how Blockchain is built for business? In her session at 21st Cloud Expo, René Bostic, Technical VP of the IBM Cloud Unit in North America, discussed the b...
In his general session at 21st Cloud Expo, Greg Dumas, Calligo’s Vice President and G.M. of US operations, discussed the new Global Data Protection Regulation and how Calligo can help business stay compliant in digitally globalized world. Greg Dumas is Calligo's Vice President and G.M. of US operations. Calligo is an established service provider that provides an innovative platform for trusted cloud solutions. Calligo’s customers are typically most concerned about GDPR compliance, application p...
Imagine if you will, a retail floor so densely packed with sensors that they can pick up the movements of insects scurrying across a store aisle. Or a component of a piece of factory equipment so well-instrumented that its digital twin provides resolution down to the micrometer.
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settle...
The cloud era has reached the stage where it is no longer a question of whether a company should migrate, but when. Enterprises have embraced the outsourcing of where their various applications are stored and who manages them, saving significant investment along the way. Plus, the cloud has become a defining competitive edge. Companies that fail to successfully adapt risk failure. The media, of course, continues to extol the virtues of the cloud, including how easy it is to get there. Migrating...
No hype cycles or predictions of a gazillion things here. IoT is here. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, an Associate Partner of Analytics, IoT & Cybersecurity at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He also discussed the evaluation of communication standards and IoT messaging protocols, data...
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
Sanjeev Sharma Joins June 5-7, 2018 @DevOpsSummit at @Cloud Expo New York Faculty. Sanjeev Sharma is an internationally known DevOps and Cloud Transformation thought leader, technology executive, and author. Sanjeev's industry experience includes tenures as CTO, Technical Sales leader, and Cloud Architect leader. As an IBM Distinguished Engineer, Sanjeev is recognized at the highest levels of IBM's core of technical leaders.
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busine...
It’s conference season and, as you might expect, Jason and I have been on the road covering a bunch of them. It’s always great to see what the disruptive players in the market are doing — and this year did not disappoint. But there is one thing that repeatedly happens that just gets under my skin: transformation-washing. As Jason explained in a Forbes article over a year ago, ‘washing’ is when a vendor (or pundit) applies a buzzword loosely in an overt attempt to attach themselves to its buzz. ...
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that's no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, explored how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He expla...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.