Click here to close now.

Welcome!

Big Data Journal Authors: Elizabeth White, Pat Romanski, Liz McMillan, Blue Box Blog, Harry Trott

Blog Feed Post

vCloud Automation Center – vCAC 5.1 – Amazon EC2 Configuration

Usually most people go straight for connecting vCAC to vCenter, but I have decided to connect to Amazon EC2 first. I’m doing this for a few reasons, but mainly because anyone reading this has access to EC2. All you really need is any computer with a Desktop Virtualization tool like VMware workstation and you can test vCAC with Amazon EC2. If you don’t have an Amazon AWWS account go to http://aws.amazon.com and sign-up.

Signing up for Amazon AWS is free and what’s even better is you can also provision “Micro.Instances” for free for an entire year as long as you stay within these guidelines. The basics are this:

  • 750 Hours of Linux/Windows Micro Instance Usage per month. (613Mb Memory). This is enough to run a single micro instance for the whole month.
  • 750 Hours of Elastic Load Balancing plus 15GB of data processing
  • 30GB of Elastic Block Storage
  • 5GB of S3 Storage with 20,000 Get requests and 2,000 Put requests
  • And some other goodies…..

You can run more than one micro instance at a time as long as the consecutive run time of your machines doesn’t go over 750 hours a month. Once you provision an instance it automatically counts as 15 minutes used. I don’t bother trying to calculate by the 15 minutes so the way I look at it is I can perform 750 provisioning tests per month if each test is less than an hour.

Backgroud information

Before we begin the configuration there are a few things we need in place. If you don’t already have vCAC installed and the foundation laid check out these posts to get going:

What were going to configure

In order to configure EC2 integration we are going to setup some additional components of vCAC as outlined below:

  • Credentials -Credentials will be utilized by out endpoints to authenticate us to the infrastructure element managers that we are going to communicate with.
  • End Point – Endpoints are how we manage connections from vCAC to other infrastructure elements in the environment. There are endpoints that allow us to communicate with EC2, vCenter, vCloud Director, vCenter Orchestrator, Hyper-V, NetApp Filers, as well as Physical Servers such as HP iLO, Dell iDrac, and Cisco UCS.
  • Enterprise Group – Although we already created an Enterprise Group we are going to add Compute Resources to the group in this exercise. FOr more information on what Enterprise Groups are see my earlier article “vCloud Automation Center – Laying the foundation“.
  • Reservations – A resource reservation is how we provide available resources to our provisioning groups. Resource Reservation are a one to one mapping to provisioning groups. Resource reservation will get created for any type of resources you want to make available to your groups. we will discuss these in more detail in another article.
  • Global Blueprints – A Blueprint is really a service definition that details what the consumer can request and all the policies and configuration of that service. We will create an Amazon Ec2 Blueprint that a consumer can request through the service catalog in this example. I will cover Blueprints in greater detail in another article.
    •  

      Configuring vCAC to provision to Amazon EC2

      Crating Credentials

      1.) The first thing we need to do is log into the vCAC console at “http://[host]/dcac“, then go to the “vCAC Administrator” menu on the “Left” and select “Credentials“.
      2.) On the “Credentials” page select “New Credentials” in the “Upper Right” corner.

      VCACEC2-1

      3.) Give your “Credential” a “Name” and “Description“. We then need to get your Amazon AWS “Access Key ID” and “Secret Access Key” which are covered in the following steps. The “Access Key ID” will be your “Username” and the “Secret Access Key” will be used as the “Password“.

      VCACEC2-2

      Getting your AWS Access Key ID and Secret Access Key

      4.)Login to your Amazon AWS account at “http://aws.amazon.com“. At the top “Right” corner “Hover” over “My Account/Console” and then select “Security Credentials

      VCACEC2-3

      5.) Scroll Down the page until you set to the section labeled “Access Credentials” and you will see your “Access Key ID” displayed. Copy and paste this in the “Credentials” “Username” field.

      VCACEC2-4

      6.) Next “Click” “Show” to display your “Secret Access Key“. Copy and paste this into the “Credentials” “Password” Fields.

      VCACEC2-5

      7.) Once you have input your “Username” and “Password” click the “Green” check on the “Left” hand side.

      VCACEC2-2

      Creating an EndPoint”

      8.) Next go to “vCAC Administrator” menu and “Click” “Endpoints” Once the “EndPoints” page displays “Hover” over “New EndPoint” and select “Amazon EC2“.

      VCACEC2-48

      9.) Give your “Endpoint” and “Name” and then “click” the selection box next to “Credentials“. Select the “Amazon EC2” “Credentials” you just created and “Click” “Ok“., then “Click” “Ok” on the “New Endpoint” Screen.

      VCACEC2-6

      10.) You will now see your newly crated Endpoint listed on the Endpoints screen. At this point vCAC executes a workflows that connects to Amazon AWS and validates your Credentials. If your credentials are validated the workflow will proceed to do a Data Discovery. The discovery will detect the available Amazon EC2 resources available for use. Once the discovery if finished the Amazon EC2 resources will become available within the “Enterprise Group” for selection.

      VCACEC2-7

      Adding Compute Resources to an Enterprise Group

      11.) Next let’s go to the “vCAC Administrators” menu and select “Enterprise Groups“. Once on the “Enterprise Groups” page “Hover” over the “Enterprise Group” we created and “select” “Edit

      VCACEC2-8

      12.) In the “Enterprise Group” we now see the “Amazon Regions” that are available. Select the “Amazon Region” that you would like to use and “Click” “Ok“.

      VCACEC2-9

      13.) Next if you go to the “Enterprise Administrators” Menu on the left and select “Compute Resources” you will see a “Compute Resource” for each “Amazon Region” you selected. Once the “Compute Resource” is available we can create a “Resource Reservation” to assign to our “Provisioning Group“.

      VCACEC2-10

      Creating a Reservation

      14.)On the “Enterprise Administrators” menu select “Reservations” and then “Hover” over “New Reservation” in the upper right corner and select “Cloud

      VCACEC2-11

      VCACEC2-12

      15.)On the “New Reservation – Cloud” page select the “Drop Down” dialog next to “Compute Resource” and select the “Amazon EC2” “Compute Resource

      VCACEC2-13

      16.) vCAC will “auto-generate” a “Name” for the “Reservation” however you can change the name if you like. The select the “Drop Down” dialog next to “Provisioning Group” and “Select” the “Provisioning Group” we created.

      VCACEC2-14

      17.) Next if you like you can set a “Machine Quota” to limit the number of machines that can be provisioned on to this “Amazon AWS Reservation“. You must set a “Priority” for the “Reservation” which is used to assist in making placement decisions if you have multiple reservations. I will talk more about this in another post. Once you have set your “Priority” “click” the “Resources” tab above.

      VCACEC2-15

      18.)”Amazon AWS” utilized “Key Pairs” for enhanced security of machine management tasks. You ave a few options within vCAC. You can let vCAC “Auto-generate a key pair per Provisioning Group“, “Auto-Generate a key pair per Machine“, or you can use a “Specific key pair” that you have already created through the “Amazon AWS” console. I’m going to use the “Auto-Generated per Provisioning Group” option in this example.

      VCACEC2-16

      19.) Next we need to select the “Locations” within the “Selected AWS Region” that we want to make available for use. I’m going to select them all. Then we need to select the “Security Group” we would like to make our machine part of. The “Security Group” can be looked at as a firewall rules for your machine. I’m going to select my “Default” “Security Group“. Optionally you can select a “Load Balancer” to attach the machine to as well. I will cover this in a later article. When you are finished “Click” “Alerts” above.

      VCACEC2-17

      20.) Here you can optionally enable “Alerts” that will send notifications if the “Reservation” is nearing capacity. Set the “Quota Threshold” for your alert, the email addresses to be notified, and the “Reminder Frequency” and click “Ok

      VCACEC2-18

      21.) You will now see your newly created “Reservation” listed on the “Reservations” screen. Now select “Global Blueprints” located under the “Enterprise Administrators” menu.

      VCACEC2-19

      Creating a Blueprint

      22.) Once you are on the “Global Blueprints” page “Hover” over “New Blueprint” and select “Cloud

      VCACEC2-20

      23.) Once on the “Blueprint Information” tab give your “Blueprint” a “Name“, and optionally change the “Display Icon“. Next assign it to a “Group(s)” and then optionally override the “Prefix” associated with this “Blueprint“. Then you can optionally set the max number of machines a user can request for this blueprint and a daily cost if you wish. Once complete select the “Build Information” tab above.

      VCACEC2-21

      24.) On the “Build Information” tab change the “Blueprint Type” to “Server”

      VCACEC2-22

      25.) Then next to “Amazon Machine Image” click the “Selection” box.

      VCACEC2-23

      26.) Once the dialog box appears you can filer the results at the top to narrow the result for the AMI you would like to use. If you selected multiple regions for use make sure the AMI is in the Region you want to use. Select the “AMI” you would like to use and click “Ok

      VCACEC2-24

      27.) “Optionally” you can “override” the “key Pair” setting that we configured in the “Reservation“.

      VCACEC2-25

      28.) “Optionally” you can “Enable” network options for the “Bluepeint“. The will allow the requester to select the “Security Group” they would like to apply to the machine if more than one was selected in the “Reservation“.

      VCACEC2-26

      29.) Next select the “Instance Types” you would like the requester to be able to choose from.

      VCACEC2-27

      30.) Then select the “Security” tab above.

      VCACEC2-28

      Making a Request

      31.) “Hover” over the newly created “Blueprint” on the “Global Blueprints” page and select “Request machine” to test our configuration. You can also go to the “Self Service” menu and select “Request Machine

      VCACEC2-29

      32.)On the “Confirm Machine Request” page click the “Drop Down” next to “Instance Type” and select the type of “Instance” you would like to request.

      VCACEC2-30

      33.) Then click the “Drop Down” next to “Provision Into” and select “Non-VPC Location” because we do not have a “VPC” configured.

      VCACEC2-31

      34.) Next select the “Drop Down” next to “Location” and select a location to provision to.

      VCACEC2-32

      35.) Next click the “Storage” tab above.

      VCACEC2-33

      36.) Optionally you can add “EBS Storage” volumes to your “Request“. Click the “Network” tab above.

      VCACEC2-34

      37.) “Optionally” if you added more than one “Security Group” to your “Reservation” and “Enabled” “Network Options” in the “Blueprint” you can select a different “Security Group” for your machine. Click “Ok” when finished.

      VCACEC2-35

      38.) Next under the “Self-Service” menu select “My Machines” to track the status of your request.

      VCACEC2-36

      39.) Your newly “Requested” machine will appear under “My Machines” and the status will show “Requested“. Note: If you machine does not show up click refresh as it can take a few seconds for it to appear.

      VCACEC2-37

      40.) If you continue to “Refresh” the page you will see the requests updated “Status“. The next “Status” your “Request” will go to is “CloudProvisioning“.

      VCACEC2-38

      41.) After your request goes to “CloudProvisioning” If you login to your “AWS Console” and go to “AWS Management Console“, then “EC2“, and then “Instances” you will see your newly provisioned machine in the “Pending State

      VCACEC2-39

      42.) Once finished the machine state in “vCAC” will go to “MachineProvisioned“, Then “Turning On“, and finally “On

      VCACEC2-40

      VCACEC2-41

      VCACEC2-42

      43.) You will now see your machine “Running” in the “AWS Console“.

      VCACEC2-43

      44.) In “vCAC” if you “Hover” over your newly created machine you will see the “Machine Options Menu” select “Edit

      VCACEC2-44

      45.) On the “Machine Information” tab near the bottom you will see “Admin Password“. Here you can show the “Local Password” for your newly provisioned “Amazon AWS Instance” Click the “Storage” tab above. Note: It can take Amazon 30+ minutes to make the password available even through the AWS Console. Once it is available from Amazon, it will not be available in vCAC until vCAC performs a data collection.

      VCACEC2-45

      46.) On the “Storage” tab you can add “EBS” storage “post-proviosioning” if you would like. Click on the “Network” tab above.

      VCACEC2-46

      47.) On the “Network” tab you can assign an “Elastic IP Address” if you have made them available through “Amazon AWS“. You can also change the “Security Group” and assign the machine to a “Load Balancer” Click “Ok” when you are done. More on these option soon.

      VCACEC2-47

      There are a few important things to note. If you add additional services such as Elastic IP Address, Elastic Block Storage, Elastic Load Balancers, Sucurity Groups, etc through the Amazon AWS Console they will not appear as available in vCAC until after the next Inventory Data Collection. You can perform a manual data collection as well as change the data collection frequency by doing the following:

      1. Go to “Enterprise Administrator” menu and select “Compute Resources
      2. Hover over the “Compute Resource” and select “Data Collection
      3. Under the “Inventory” section you can set the “Frequency” in hours as well as manually “Request” a “Data Collection“.
      4. If you “Request” a “Data Collection” you can select “Refresh” at the bottom of the page to get the status of the collection.

Read the original blog entry...

More Stories By Sidney Smith

Sid Smith, founder of DailyHypervisor is considered to be a cloud expert in the IT field with over 10 years experience in Virtualization, Automation, and Cloud technologies. Sid Smith started in the industry designing and implementing large scale enterprise server and desktop virtualization environments for fortune 100 and 500 companies. He later went on to become a key employee at DynamicOps the well know creators of Cloud Automation Center. In July 2012 DynamicOps was acquired by VMware who has adopted Cloud Automation Center as a center piece for it’s vCloud Suite of products. Sid has helped dozens of fortune 100 and 500 enterprises successfully adopt both private and public cloud strategies as part of their IT offerings. The result of which was large operational and capital savings for his customers. Sid continues to help large enterprise customers reach their hybrid cloud strategies at VMware. On DailyHypervisor you will find exclusive content that will help you learn how to adopt a successful cloud strategy through the use of VMware Cloud Automation Center, Open Stack, and other industry recognized cloud solutions.

@BigDataExpo Stories
Hadoop as a Service (as offered by handful of niche vendors now) is a cloud computing solution that makes medium and large-scale data processing accessible, easy, fast and inexpensive. In his session at Big Data Expo, Kumar Ramamurthy, Vice President and Chief Technologist, EIM & Big Data, at Virtusa, will discuss how this is achieved by eliminating the operational challenges of running Hadoop, so one can focus on business growth. The fragmented Hadoop distribution world and various PaaS soluti...
Cultural, regulatory, environmental, political and economic (CREPE) conditions over the past decade are creating cross-industry solution spaces that require processes and technologies from both the Internet of Things (IoT), and Data Management and Analytics (DMA). These solution spaces are evolving into Sensor Analytics Ecosystems (SAE) that represent significant new opportunities for organizations of all types. Public Utilities throughout the world, providing electricity, natural gas and water,...
The true value of the Internet of Things (IoT) lies not just in the data, but through the services that protect the data, perform the analysis and present findings in a usable way. With many IoT elements rooted in traditional IT components, Big Data and IoT isn’t just a play for enterprise. In fact, the IoT presents SMBs with the prospect of launching entirely new activities and exploring innovative areas. CompTIA research identifies several areas where IoT is expected to have the greatest impac...
There is little doubt that Big Data solutions will have an increasing role in the Enterprise IT mainstream over time. 8th International Big Data Expo, co-located with 17th International Cloud Expo - to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA - has announced its Call for Papers is open. As advanced data storage, access and analytics technologies aimed at handling high-volume and/or fast moving data all move center stage, aided by the cloud computing bo...
Every day we read jaw-dropping stats on the explosion of data. We allocate significant resources to harness and better understand it. We build businesses around it. But we’ve only just begun. For big payoffs in Big Data, CIOs are turning to cognitive computing. Cognitive computing’s ability to securely extract insights, understand natural language, and get smarter each time it’s used is the next, logical step for Big Data.
The Internet of Things will greatly expand the opportunities for data collection and new business models driven off of that data. In her session at @ThingsExpo, Esmeralda Swartz, CMO of MetraTech, discussed how for this to be effective you not only need to have infrastructure and operational models capable of utilizing this new phenomenon, but increasingly service providers will need to convince a skeptical public to participate. Get ready to show them the money!
SYS-CON Events announced today that MetraTech, now part of Ericsson, has been named “Silver Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9–11, 2015, at the Javits Center in New York, NY. Ericsson is the driving force behind the Networked Society- a world leader in communications infrastructure, software and services. Some 40% of the world’s mobile traffic runs through networks Ericsson has supplied, serving more than 2.5 billion subscribers.
As cloud gives an opportunity to businesses to buy services externally – how is cloud impacting your customers? In his General Session at 15th Cloud Expo, Fabio Gori, Director of Worldwide Cloud Marketing at Cisco, provided answers to big questions: Do you see hybrid cloud as where the world is going? What benefits does it bring? And how does Cisco connect all of these clouds? He also discussed Intercloud and Cisco’s investment on it.
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding bu...
17th Cloud Expo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises a...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading in...
Software is eating the world. Companies that were not previously in the technology space now find themselves competing with Google and Amazon on speed of innovation. As the innovation cycle accelerates, companies must embrace rapid and constant change to both applications and their infrastructure, and find a way to deliver speed and agility of development without sacrificing reliability or efficiency of operations. In her Day 2 Keynote DevOps Summit, Victoria Livschitz, CEO of Qubell, discussed...
Working with Big Data is challenging, especially when decision makers depend on market insights and intelligence from your data but don't have quick access to it or find it unusable. In their session at 6th Big Data Expo, Ian Khan, Global Strategic Positioning & Brand Manager at Solgenia; Zel Bianco, President, CEO and Co-Founder of Interactive Edge of Solgenia; and Ermanno Bonifazi, CEO & Founder at Solgenia, discussed how a revolutionary cloud-based BI along with mobile analytics is already c...
Gartner predicts that the bulk of new IT spending by 2016 will be for cloud platforms and applications and that nearly half of large enterprises will have cloud deployments by the end of 2017. The benefits of the cloud may be clear for applications that can tolerate brief periods of downtime, but for critical applications like SQL Server, Oracle and SAP, companies need a strategy for HA and DR protection. While traditional SAN-based clusters are not possible in these environments, SANless cluste...
Hardware will never be more valuable than on the day it hits your loading dock. Each day new servers are not deployed to production the business is losing money. While Moore's Law is typically cited to explain the exponential density growth of chips, a critical consequence of this is rapid depreciation of servers. The hardware for clustered systems (e.g., Hadoop, OpenStack) tends to be significant capital expenses. In his session at Big Data Expo, Mason Katz, CTO and co-founder of StackIQ, disc...
In their general session at 16th Cloud Expo, Michael Piccininni, Global Account Manager – Cloud SP at EMC Corporation, and Mike Dietze, Regional Director at Windstream Hosted Solutions, will review next generation cloud services, including the Windstream-EMC Tier Storage solutions, and discuss how to increase efficiencies, improve service delivery and enhance corporate cloud solution development. Speaker Bios Michael Piccininni is Global Account Manager – Cloud SP at EMC Corporation. He has b...
All major researchers estimate there will be tens of billions devices - computers, smartphones, tablets, and sensors - connected to the Internet by 2020. This number will continue to grow at a rapid pace for the next several decades. With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo, June 9-11, 2015, at the Javits Center in New York City. Learn what is going on, contribute to the discussions, and ensure that your enter...
SYS-CON Events announced today that DragonGlass, an enterprise search platform, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. After eleven years of designing and building custom applications, OpenCrowd has launched DragonGlass, a cloud-based platform that enables the development of search-based applications. These are a new breed of applications that utilize a search index as their backbone for data...
The OpenStack cloud operating system includes Trove, a database abstraction layer. Rather than applications connecting directly to a specific type of database, they connect to Trove, which in turn connects to one or more specific databases. One target database is Postgres Plus Cloud Database, which includes its own RESTful API. Trove was originally developed around MySQL, whose interfaces are significantly less complicated than those of the Postgres cloud database. In his session at 16th Cloud...
As the Internet of Things unfolds, mobile and wearable devices are blurring the line between physical and digital, integrating ever more closely with our interests, our routines, our daily lives. Contextual computing and smart, sensor-equipped spaces bring the potential to walk through a world that recognizes us and responds accordingly. We become continuous transmitters and receivers of data. In his session at @ThingsExpo, Andrew Bolwell, Director of Innovation for HP's Printing and Personal S...