Welcome!

Big Data Journal Authors: Liz McMillan, Pat Romanski, Roger Strukhoff, Jason Thompson, Elizabeth White

Blog Feed Post

Energy Department Announces New SunShot Projects to Harness the Power of Big Data

By

US-Department-of-Energy-logoEditor’s note: The following announcement from the Department of Energy provides context on a potentially very virtuous use of advanced data analysis capabilities to help solve real-world challenges regarding energy costs in the US. Before you get too excited about the potential here, remember to read the details. As you dig deeper into the list of projects you will note some potential for continued government-contractor goofiness and waste, like giving $600k to SRI to have them develop new software to read scientific publications. Seems like they could just buy some basic discovery tools for that or if they wanted to really use advanced big data tools could start by leveraging the Apache Hadoop framework first. So read the below but remember, the devil is in the details- bg

Energy Department Announces New SunShot Projects to Harness the Power of Big Data

January 30, 2013 -release

As part of the Energy Department’s SunShot Initiative, the Department today announced seven data-driven projects to unearth new opportunities for reducing costs and accelerating solar energy deployment in the United States. These projects—located in California, Colorado, Connecticut, Massachusetts, North Carolina and Texas—will result in viable methods for dramatically transforming the operations of solar researchers, manufacturers, developers, installers, and policymakers, and speed the commercialization and deployment of affordable, clean solar energy.

“Through powerful analytical tools developed by our nation’s top universities and national labs, we can gain unparalleled insight into solar deployment that will help lower the cost of solar power and create new businesses and jobs,” said Energy Secretary Steven Chu. “Projects like these will help accelerate technological and financing innovations—making it easier for American families and businesses to access clean, affordable energy.”

The Energy Department will invest about $9 million across the seven projects announced today. These efforts will help scientists, project developers, installers, and communities work together to discover previously unexplored ways to improve solar cell efficiency, reduce costs, and streamline installation processes.

Harnessing Real-World Data to Solve Industry Challenges

As part of the investment announced today, the Energy Department will provide $7 million to research teams led by Sandia National Laboratories, the National Renewable Energy Laboratory, Yale University and the University of Texas–Austin. These teams will partner with public and private financial institutions, utilities, and state agencies to apply statistical and computational tools to industry problem-solving and lead regional pilot projects across the country to test the impact and scalability of their innovations.

For example, Yale University researchers will partner with SmartPower’s New England Solar Challenge to design and implement innovative strategies that can increase the effectiveness of community-led bulk solar purchase programs. The team from the University of Texas–Austin will work with complex datasets from six Texas utilities to better understand customer needs and identify opportunities to streamline installation and interconnection. Similarly, the National Renewable Energy Laboratory in Golden, Colorado, will lead another project with Clean Power Finance to develop a computational model that will analyze data from over 1,300 solar installation companies to establish new types of community- and regional-scale financing structures.

Charting Market Evolution and Technology Innovation

Additionally, the Energy Department is investing $2 million across three projects led by the University of North Carolina–Charlotte, Massachusetts Institute of Technology, and SRI International to analyze decades’ of scientific publications, patents and cost and production data. Through these projects, researchers will be able to obtain a complete picture on the U.S. solar industry, discover methods to accelerate technological breakthroughs, and remove roadblocks to greater cost reduction.

Based in Menlo Park, California, SRI International will develop advanced software that reads and analyzes thousands of scientific publications and patents to discover new ways to speed solar energy technology innovation and commercialization. Meanwhile, Massachusetts Institute of Technology and the University of North Carolina–Charlotte will apply computational tools to patent, cost, and production data to speed up solar technology cost reductions and better forecast future cost reductions for new energy technologies.

The seven projects announced today will provide new insights that could dramatically accelerate the commercialization of affordable, reliable clean energy technologies. See the full list of projectsPDF.

The SunShot Initiative is a collaborative national effort to make solar energy cost-competitive with other forms of energy by the end of the decade. Inspired by President Kennedy’s “Moon Shot” program that put the first man on the moon, the SunShot Initiative has created new momentum for the solar industry by highlighting the need for American competitiveness in the clean energy race. For more information, visit www.energy.gov/sunshot.

 

Read the original blog entry...

More Stories By Bob Gourley

Bob Gourley, former CTO of the Defense Intelligence Agency (DIA), is Founder and CTO of Crucial Point LLC, a technology research and advisory firm providing fact based technology reviews in support of venture capital, private equity and emerging technology firms. He has extensive industry experience in intelligence and security and was awarded an intelligence community meritorious achievement award by AFCEA in 2008, and has also been recognized as an Infoworld Top 25 CTO and as one of the most fascinating communicators in Government IT by GovFresh.

Cloud Expo Breaking News
SYS-CON Events announced today that Cloudian, Inc., the leading provider of hybrid cloud storage solutions, has been named “Bronze Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. Cloudian is a Foster City, Calif.-based software company specializing in cloud storage. Cloudian HyperStore® is an S3-compatible cloud object storage platform that enables service providers and enterprises to build reliable, affordable and scalable hybrid cloud storage solutions. Cloudian actively partners with leading cloud computing environments including Amazon Web Services, Citrix Cloud Platform, Apache CloudStack, OpenStack and the vast ecosystem of S3 compatible tools and applications. Cloudian's customers include Vodafone, Nextel, NTT, Nifty, and LunaCloud. The company has additional offices in China and Japan.
After a couple of false starts, cloud-based desktop solutions are picking up steam, driven by trends such as BYOD and pervasive high-speed connectivity. In his session at 15th Cloud Expo, Seth Bostock, CEO of IndependenceIT, cuts through the hype and the acronyms, and discusses the emergence of full-featured cloud workspaces that do for the desktop what cloud infrastructure did for the server. He’ll discuss VDI vs DaaS, implementation strategies and evaluation criteria.
SYS-CON Events announced today that Esri has been named “Bronze Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. Esri inspires and enables people to positively impact the future through a deeper, geographic understanding of the changing world around them. For more information, visit http://www.esri.com.
Cloud computing started a technology revolution; now DevOps is driving that revolution forward. By enabling new approaches to service delivery, cloud and DevOps together are delivering even greater speed, agility, and efficiency. No wonder leading innovators are adopting DevOps and cloud together! In his session at DevOps Summit, Andi Mann, Vice President of Strategic Solutions at CA Technologies, will explore the synergies in these two approaches, with practical tips, techniques, research data, war stories, case studies, and recommendations.
Cloud Computing is evolving into a Big Three of Amazon Web Services, Google Cloud, and Microsoft Azure. Cloud 360: Multi-Cloud Bootcamp, being held Nov 4–5, 2014, in conjunction with 15th Cloud Expo in Santa Clara, CA, delivers a real-world demonstration of how to deploy and configure a scalable and available web application on all three platforms. The Cloud 360 Bootcamp, led by Janakiram MSV, an analyst with Gigaom Research, is the first bootcamp that introduces the core concepts of Infrastructure as a Service (IaaS) based on the workings of the Big Three platforms – Amazon EC2, Google Compute Engine, and Azure VMs. Bootcamp attendees will get to see the big picture and also receive the knowledge needed to make the best cloud decisions for their business applications and entire enterprise IT organization.
The Internet of Things promises to transform businesses (and lives), but navigating the business and technical path to success can be difficult to understand. In his session at 15th Internet of @ThingsExpo, Chad Jones, Vice President, Product Strategy of LogMeIn's Xively IoT Platform, will show you how to approach creating broadly successful connected customer solutions using real world business transformation studies including New England BioLabs and more.
“Distrix fits into the overall cloud and IoT model around software-defined networking. There’s a broad category around software-defined networking that’s focused on data center, and we focus on the WAN,” explained Jay Friedman, President of Distrix, in this SYS-CON.tv interview at the Internet of @ThingsExpo, held June 10-12, 2014, at the Javits Center in New York City. Internet of @ThingsExpo 2014 Silicon Valley, November 4–6, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading IoT industry players in the world.
Scott Jenson leads a project called The Physical Web within the Chrome team at Google. Project members are working to take the scalability and openness of the web and use it to talk to the exponentially exploding range of smart devices. Nearly every company today working on the IoT comes up with the same basic solution: use my server and you'll be fine. But if we really believe there will be trillions of these devices, that just can't scale. We need a system that is open a scalable and by using the URL as a basic building block, we open this up and get the same resilience that the web enjoys.
“The Internet of Things is a wave that has arrived and it’s growing really fast. The concern at Aria Systems is making sure that people understand the ramifications of their attempts to monetize whatever it is they build on the Internet of Things," explained C Brendan O’Brien, Co-founder and Chief Architect at Aria Systems, in this SYS-CON.tv interview at the Internet of @ThingsExpo, held June 10-12, 2014, at the Javits Center in New York City. Internet of @ThingsExpo 2014 Silicon Valley, November 4–6, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading IoT industry players in the world.
The Internet of Things is a natural complement to the cloud and related technologies such as Big Data, analytics, and mobility. In his session at Internet of @ThingsExpo, Joe Weinman will lay out four generic strategies – digital disciplines – to exploit emerging digital technologies for strategic advantage. Joe Weinman has held executive leadership positions at Bell Labs, AT&T, Hewlett-Packard, and Telx, in areas such as corporate strategy, business development, product management, operations, and R&D.
SYS-CON Events announced today that DevOps.com has been named “Media Sponsor” of SYS-CON's “DevOps Summit at Cloud Expo,” which will take place on June 10–12, 2014, at the Javits Center in New York City, New York. DevOps.com is where the world meets DevOps. It is the largest collection of original content relating to DevOps on the web today Featuring up-to-the-minute news, feature stories, blogs, bylined articles and more, DevOps.com is where the thought leaders of the DevOps movement make their ideas known.
There are 182 billion emails sent every day, generating a lot of data about how recipients and ISPs respond. Many marketers take a more-is-better approach to stats, preferring to have the ability to slice and dice their email lists based numerous arbitrary stats. However, fundamentally what really matters is whether or not sending an email to a particular recipient will generate value. Data Scientists can design high-level insights such as engagement prediction models and content clusters that allow marketers to cut through the noise and design their campaigns around strong, predictive signals, rather than arbitrary statistics. SendGrid sends up to half a billion emails a day for customers such as Pinterest and GitHub. All this email adds up to more text than produced in the entire twitterverse. We track events like clicks, opens and deliveries to help improve deliverability for our customers – adding up to over 50 billion useful events every month. While SendGrid data covers only abo...
SYS-CON Events announced today that the Web Host Industry Review has been named “Media Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. Since 2000, The Web Host Industry Review has made a name for itself as the foremost authority of the Web hosting industry providing reliable, insightful and comprehensive news, reviews and resources to the hosting community. TheWHIR Blogs provides a community of expert industry perspectives. The Web Host Industry Review Magazine also offers a business-minded, issue-driven perspective of interest to executives and decision-makers. WHIR TV offers on demand web hosting video interviews and web hosting video features of the key persons and events of the web hosting industry. WHIR Events brings together like-minded hosting industry professionals and decision-makers in local communities. TheWHIR is an iNET Interactive property.
SYS-CON Events announced today that O'Reilly Media has been named “Media Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. O'Reilly Media spreads the knowledge of innovators through its books, online services, magazines, and conferences. Since 1978, O'Reilly Media has been a chronicler and catalyst of cutting-edge development, homing in on the technology trends that really matter and spurring their adoption by amplifying "faint signals" from the alpha geeks who are creating the future. An active participant in the technology community, the company has a long history of advocacy, meme-making, and evangelism.
SYS-CON Events announced today that Verizon has been named “Gold Sponsor” of SYS-CON's 15th International Cloud Expo®, which will take place on November 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA. Verizon Enterprise Solutions creates global connections that generate growth, drive business innovation and move society forward. With industry-specific solutions and a full range of global wholesale offerings provided over the company's secure mobility, cloud, strategic networking and advanced communications platforms, Verizon Enterprise Solutions helps open new opportunities around the world for innovation, investment and business transformation. Visit verizonenterprise.com to learn more.