Showing posts with label Oracle VM. Show all posts
Showing posts with label Oracle VM. Show all posts

Thursday, April 6, 2017

Running Oracle Linux as a Logical Domain on SPARC

Running Oracle Linux as a Logical Domain on SPARC

Abstract:

With the purchase of Cray SuperServer division and their StarFire platform, Sun Microsystems introduced Physical Domains to their server line. With the introduction of the UltraSPARC T1, Sun Microsystems introduced Logical Domains and offered support for the first release of "third party" Ubuntu Linux on SPARC. Fujitsu introduced their own Linux under their SPARC platforms. Since the purchase of Sun Microsystems by Oracle, the introduction of Oracle Linux has been made.

[Courtesy: Oracle Virtualization Blog]

Presenter:

Jeff Savit
Product Management Senior Manager
Oracle Corporation

Linux in an LDom

Jeff recently published a blog about a simple installation of Oracle Linux in an LDom, with 4 cores (32 vCPU threads) and 32 Gigabytes of RAM where the virtual disk was in a ZFS dataset. Some of the highlights included steps in loading Oracle Linux in an Oracle SPARC Logical Domain.


Preparing an LDom

Solaris 11 acts as the Control Domain in an Oracle VM for SPARC environment. From the Primary or Control Domain, a Logical Domain was configured with cpu, memory, disk, dvd, and virtual nic.
primary # ldm add-domain ols                                     
primary # ldm set-core 4 ols
                                    
primary # ldm set-mem 32g ols
                                   
primary # zfs create rpool/export/home/ldoms/ols
                
primary # mkfile -n 32g /ldoms/ols/disk0.img
                    
primary # ldm add-vdsdev
/ldoms/ols/disk0.img \                  
 olsroot@primary-vds0
                                           
primary # ldm add-vdisk boot olsroot@primary-vds0 ols
           
primary # ldm add-vdsdev \
                                      
 /export/home/OL-SPARC/OL-201703262026-R6-U7-sparc-dvd.iso \
    
 oliso@primary-vds0
                                             
primary # ldm add-vdisk iso oliso@primary-vds0 ols
              
primary # ldm add-vnet pvid=123 eth0 primary-vsw0 ols
           
primary # ldm set-variable auto-boot\?=false ols
                
The Domain "ols" is assigned 4x Cores (32 vCPU threads) with 32 Gig RAM. Jeff created a ZFS filesystem in the root pool, to simplify snapshots and cloning future images. A data file to act as the root disk of the Linux instance is created, served to guests, and added to the "ols" instance. An Oracle Linux installation ISO was also served to guests and added as a disk to Guest "ols" (although, serving as read-only would allow for multiple simultaneous installations.) A virtual network card was added on VLAN 123 to Guest "ols" and attached to the primary virtual switch. With "auto-boot" disabled, an OK prompt in a virtual OpenBoot instance will appear on binding and start of the Logical Domain.


Starting the LDom

Solaris 11 acts as a Service Domain in an Oracle VM for SPARC environment. The Console for Guest Logical Domains are available from a Service Domain, the Primary Domain normally "serves" a virtual console. A virtual console is not available until a iis bound to a domain.
primary# ldm bind ols                                           
primary# ldm start ols               
                           

primary# ldm list                                               
NAME      STATE  FLAGS  CONS VCPU MEMORY UTIL NORM UPTIME       
primary   active -n-cv- UART 16   32G    0.5% 0.5% 69d 10h 45m  

ols       active -n---- 5000 8    32G   
0.5% 0.5%  1d  1h  5m   
Normally, the virtual console ports start their numbering from 5000 and increment.

Acquiring Virtual Console

The first virtual console for guests start at 5000, the second virtual console assigned would be 5001, etc. Telnet to the localhost console port assigned to the Guest Domain will provide access to the SPARC OpenBoot
primary# telnet localhost 5000                                     
...                                                                
SPARC T5-2, No Keyboard                                            
Copyright (c) 1998, 2016, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.38.6, 32.0000 GB memory available, Serial #xxxxxxxx.    
Ethernet address 0:14:4f:f8:96:25, Host ID: xxxxxxxx.              
{0} ok
                                                            

Media bound to the domain can now be booted from the ok prompt.

Boot Oracle Linux from ISO

The available device aliases can be listed and an attempt to boot from the  installation media.

{0} ok devalias                                                                 
boot                     /virtual-devices@100/channel-devices@200/disk@0        
iso                      /virtual-devices@100/channel-devices@200/disk@1        
eth0                     /virtual-devices@100/channel-devices@200/network@0     
net                      /virtual-devices@100/channel-devices@200/network@      
disk                     /virtual-devices@100/channel-devices@200/disk@1        
virtual-console          /virtual-devices/console@1                             
name                     aliases                                                
{0} ok boot iso                                                                 
Boot device: /virtual-devices@100/channel-devices@200/disk@1  File and args:    
                                                                                
                             GRUB Welcome to GRUB!                              
                          GNU GRUB  version 2.02~beta3                          
 +----------------------------------------------------------------------------+ 
 |*Install linux using text mode (use DHCP)                                   | 
 | Install linux using VNC (graphical) mode (use DHCP)                        | 
 | Rescue mode (use DHCP)                                                     | 
 |                                                                            | 
 |                                                                            | 
 |                                                                            | 
 +----------------------------------------------------------------------------+ 
      Use the ^ and v keys to select which entry is highlighted.                
      Press enter to boot the selected OS, `e' to edit the commands             
      before booting or `c' for a command-line.                                 
      The highlighted entry will be executed automatically in 0s.               

In Conclusion:

Oracle Linux is now a viable platform under SPARC. The SPARC Silicon in Software, such as the DAX Query Accelerators, Decompression Engines, Crypto Engines, etc. are made fully available by the Solaris 11 based Oracle VM for SPARC instance. The Linux Guest Domains can be live migrated just like any Solaris 10 or Solaris 11 Guest Domains.




Thursday, August 13, 2015

Oracle VM Server for SPARC or LDoms 3.2

Abstract:

Virtualization under Solaris comes in different flavor. Logical Domains (LDom's) or Oracle VM for SPARC (OVM for SPARC) enables different OS's to be hosted on newer hardware without expensive electrical partitioning using ASIC's. Oracle has released LDom or OVM for SPARC 3.2.

Oracle Documentation:

[http] Overall Documentation Home
[http] What's New?
[http] 3.2 Release Notes
[http] 3.2.0.1 Supplemental Release Notes
[http] Installation Guide
[http] Administration Guide
[http] Security Guide
[http] Reference Manuals

Conclusions:

Oracle Logical Domains or Oracle VM for SPARC composes a very reasonable platform for hosting various Solaris Server instances. Solaris 11 bundles the latest version of OVM Server, simplifying a physical environment and providing additional flexibility to reduce planned downtime on current modern hardware.

Monday, September 24, 2012

Virtualizing the Data Center (SPARC)


Abstract:
Data Centers are often filled with racks of servers. Deployed servers are often poorly utilized or undersized for virtualized loads, in order to mitigate license costs. Legacy servers often run older operating systems, dedicated to older servers with high operating costs. Virtualization of the data center is made ever simpler when following Best Practices on SPARC hardware leveraging freely available software such as Oracle Enterprise Ops Center.

SPARC Cloud:
The Oracle "Systems Group" collaboratively authored the guide "Best Practices for Building a Virtualized SPARC Computing Environment". Included in the Best Practices guide are uses and guidelines for:
• SPARC T4 Systems
• SPARC T4 processor configurations
• Oracle VM for SPARC hypervisor
• Solaris 8, 9, 10, 11 configurations
• Oracle Ops Center 12c for GUI control
• Oracle ZFS Storage Appliance for data reliability
• Oracle network switches for infrastructure visibility
Benefits:
Implementing the best practices facilitates a dynamic, virtualized infrastructure which supports:
• GUI-based provisioning on bare metal, VMs, and OS's
• License mitigation through resource capped VM's
• Automated HA failover with physical server failures
• Automatic/Scheduled load balancing across a cluster of VM hosts
• Cluster Analytics and Performance Management]
• Complete end-to-end Fault Management
• Patch management


Thursday, April 12, 2012

Solaris Tab: Solaris LDom's / Oracle VM for SPARC Addendums

The Solaris Tab was recently updated with some white papers.

White papers were placed in date order, using shortened titles on the top, for easy access, while they were categorized with their full titles on the bottom according to topic.

Solaris Reference Material

2007-07 [PDF] Understanding and Deploying Logical Domains
2010-05 [PDF] Best Practices for Data Reliability with LDom's
2010-05 [PDF] Best Practices for Network Availability with LDom's
2010-05 [PDF] Increase Application Scalability and Improve Utilization with LDom's

Solaris LDoms / Oracle VM Server SPARC
  • 2007-07 [PDF] Beginners Guide to Oracle VM Server for SPARC:Understanding and Deploying Logical Domains
  • 2010-05 [PDF] Best Practices for Data Reliability with Oracle VM Server for SPARC
  • 2010-05 [PDF] Best Practices for Network Availability with Oracle VM Server for SPARC
  • 2010-05 [PDF] Increase Application Scalability and Improve System Utilization with Oracle VM Server for SPARC

Monday, January 23, 2012

Virtualizations: LPARs, LDoms, Xen, KVM, VMWare, and HyperV


Virtualizations: LPARs, LDoms, Xen, KVM, VMWare, and HyperV

IBM LPARs
IBM LPARs is a premium proprietary virtualization technology which sits on top of IBM POWER architecture. It leverages the Virtual I/O Server (VIOS) in order to manage operating system resource requests from other domains.

https://www.ibm.com/developerworks/wikis/display/virtualization/VIO
"This allows a single machine to run multiple operating system (OS) images at the same time but each is isolated from the others. POWER4 based machines started this in 2001 by allowing many Logical Partitions (LPAR) to run on the same machine using but each using different CPUs, different memory sections and different PCI adapter slots. Next came with POWER4, the ability to dynamically change the CPU, memory and PCI adapters slots with the OS running. With the introduction of POWER5 in 2005, further Virtualization items have been added."
http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/index.jsp?topic=/iphb1/iphb1_vios_virtualioserveroverview.htm
"The Virtual I/O Server is software that is located in a logical partition. This software facilitates the sharing of physical I/O resources between client logical partitions within the server. The Virtual I/O Server provides virtual SCSI target, virtual fibre channel, Shared Ethernet Adapter, and PowerVM™ Active Memory Sharing capability to client logical partitions within the system. As a result, client logical partitions can share SCSI devices, fibre channel adapters, Ethernet adapters, and expand the amount of memory available to logical partitions using paging space devices. The Virtual I/O Server software requires that the logical partition be dedicated solely for its use. The Virtual I/O Server is part of the PowerVM Editions hardware feature."

SPARC LDOM's or Oracle VM for SPARC
SPARC LDOM's (or now referred to as Oracle VM for SPARC) is analagous to IBM's LPARs. IBM's VIOS appears to be analagous to Control Domain under. The LDom Control Domain can be subdivided between Control, Service, and I/O Domains - to architect redundancy and additional performance in a SPARC platform. LDom's are a free Solaris SPARC bundled virtualization technology.

http://www.oracle.com/us/technologies/virtualization/oraclevm/oracle-vm-server-for-sparc-068923.html
"Oracle VM Server for SPARC (previously called Sun Logical Domains) provides highly efficient, enterprise-class virtualization capabilities for Oracle's SPARC T-Series servers. Oracle VM Server for SPARC allows you to create up to 128 virtual servers on one system to take advantage of the massive thread scale offered by SPARC T-Series servers and the Oracle Solaris operating system. And all this capability is available at no additional cost."
http://en.wikipedia.org/wiki/Logical_Domains
"The Control domain, as its name implies, controls the logical domain environment. It is used to configure machine resources and guest domains... The control domain also normally acts as a service domain. Service domains present virtual services, such as virtual disk drives and network switches, to other domains… Current processors can have two service domains in order to provide resiliency against failures. I/O domain has direct ownership of and direct access to physical I/O devices, such as a network card in a PCI controller… Control and service functions can be combined within domains."
There are basic technologies available through LDOM's to developers and architects such as cluster-in-a-box, redundant I/O domains, etc.
http://docs.oracle.com/cd/E19316-01/820-4676/ggtcs/index.html
"In this logical domains (LDoms) guest domain topology, a cluster and every node within that cluster are located on the same Solaris host. Each LDoms guest domain node acts the same as a Solaris host in a cluster. To preclude your having to include a quorum device, this configuration includes three nodes rather than only two."

Xen
There are some similarities to the way these former hypervisors and Xen is architected. Various implementations of Xen exist, such as Citrix Hypervisor, Oracle VM for x86, and OpenSolaris based Xen (now a project under Illumos.) Xen is an open-sourced hypervisor.

http://xen.org/files/Marketing/WhyXen.pdf
"A critical benefit of the Xen Hypervisor is its neutrality to the various operating systems. Due to its independence, Xen is capable of allowing any operating system (Linux, Solaris, BSD, etc) to be the Domain0 thereby ensuring the widest possible use case for customers. For example, many hardware manufacturers leverage NetBSD as their OS of choice for Domain0 and are able to deploy Xen in the manner of their choosing."

"This separation of hypervisor from the Domain0 operating system also ensures that Xen is not burdened with any operating system overhead that is unrelated to processing a series of guests on a given machine. In fact, more are beginning to break up the Domain0 from a single guest into a series of mini-OS guests each with a specific purpose and responsibility which drives better performance and security in a virtualization environment."

KVM
No, this is not a Keyboard switch. Late to the game was a Linux and OpenSolaris based virtualization technology, unfortunately called KVM, for Kernel Virtual Machine. First implemented under Linux.
http://wiki.linuxplumbersconf.org/_media/2010:02-lpc-kvmstoragestackperformance.pdf

Modern OS features such as DTrace and ZFS are now available to KVM after it was quickly ported to OpenSolaris source code base by Joyent for their Open Source SMARTOS cloud operating system and cloud offering
http://www.phoronix.com/scan.php?page=news_item&px=OTc5Ng
"Joyent has announced today they have open-sourced their SmartOS operating system, which is based on Illumos/Solaris. Additionally, this cloud software provider has ported the Linux KVM (Kernel-based Virtual Machine) to this platform.

Being derived from Illumos and in-turn from Solaris, SmartOS does ship with ZFS support, DTrace, and other former Sun Microsystems technologies."



Microsoft HyperV
Some vendors came very late to the hypervisor game. Microsoft HyperV have a similar architecture, available only under Intel & AMD processors, depend on hardware acceleration available under only certain CPU chips from both of those vendors.


VMWare ESXi
VMWare has a great deal of experience in hypervisors, growing out of a software-driven solution, before hardware handlers became popular (and leveraged) in the Intel/AMD world. They provide some of the best backwards-compatibility in the Intel/AMD world.

Tuesday, December 20, 2011

Solaris Tab - Secure Deployment of LDom's or VM Server for SPARC


Solaris Tab - Secure Deployment of LDom's or VM Server for SPARC

An Oracle White Paper, Secure Deployment of Oracle VM Server for SPARC , was added to the Solaris Tab on Network Management.

Solaris Reference Material
2011-01 [PDF] Secure Deployment of LDom's or VM Server for SPARC

Solaris LDoms / Oracle VM Server for SPARC
Secure Deployment of LDoms or Oracle VM Server for SPARC

Monday, December 19, 2011

SPARC T4: Optimizing with Oracle VM Server for SPARC


SPARC T4: Optimizing with Oracle VM Server for SPARC

Abstract:

Modern computing systems had found their footing through the history of computing. Some companies and architectures influenced the modern desktop computer more than others. One such company was Sun Microsystems, which had found it's way into Oracle. Oracle released their latest processor, the SPARC T4, with a dynamic new capability to offer the functionality to process two different workloads, via virtualization technology.

Processor History:

In 1985, Sun Microsystems produced their first Sun-3 workstation and servers based upon the 32 bit CISC Motorola 68000 processor. In 1987, Sun Microsystems produced their first Sun-4 workstations and servers upon the 32 bit RISC SPARC processor. In 1995, Sun Microsystems produced their first UltraSPARC system based upon 64 bit RISC UltraSPARC processor. In 2002, Sun Microsystems acquired Afara Web Systems, with a new high-throughput SPARC design. In 2005, Sun Microsystems released their first server (no desktops) based upon the UltraSPARC T1 processor, which was tuned for multi-threaded workloads. Oracle, who made their fortunes primarily from software upon SPARC, acquired Sun Microsystems and released their first server (no desktops) in 2010 based upon the SPARC T3. Oracle released the SPARC T4 in 2011, supporting both multi-threaded and single-threaded workload.


Workload History:

The workloads in the SPARC processors were traditionally single-threaded workloads from their early years. With the advent of RISC processors, the concept to reduce complexity allowed for the increase clock speed and thus the increase of single threaded performance. With the investment from AT&T and merger with SVR4, Solaris experienced multi-threaded workloads expansion. When SGI purchased Cray Research, Sun Microsystems purchased the Cray Superserver 6400 to create massive high-speed single threaded capability into massive multi-threaded workload throughput of 64 threads via racks of equipment.

With the release of UltraSPARC T1, Sun Microsystems managed to shrink 32 threads of slower integer and crypto capacity not only into a single socket, but onto single piece of silicon, performing outstanding aggregate capacity. With the subsequent release of the T2 processor, 64 threads were merged onto a chip. While the throughput was equivalent to racks of equipment in the T processors, the single threaded performance was a decade behind.

Workload Selection:

With the release of the Oracle SPARC T4 processor, a system can now be tuned to support single or multi-threaded workloads via Oracle VM Server for SPARC release 2.1, previously known as Logical Domains or LDom's.

The short tuning white paper from Oracle describes:
This paper describes how to use the Oracle VM Server for
SPARC 2.1 CPU threading controls to optimize CPU performance
on SPARC T4 platforms. CPU performance can be optimized for
CPU-bound workloads by tuning CPU cores to maximize the
number of instructions per cycle (IPC). Or, CPU performance
can be optimized for maximum throughput by tuning CPU cores
to use a maximum number of CPU threads. By default, the CPU
is tuned for maximum throughput
During the provisioning of a Logical Doman or VM under SPARC, the provisioner can choose the workload optimization required. This can be performed during ["add-domain"] or after ["set-domain"] provisioning.
ldm add-domain [mac-addr=num] [hostid=num]
[failure-policy=ignorepanicresetstop]
[extended-mapin-space=on]
[master=master-ldom1,...,master-ldom4]
[threading=max-throughputmax-ipc] ldom

ldm set-domain [mac-addr=num] [hostid=num]
[failure-policy=ignorepanicresetstop]
[extended-mapin-space=[onoff]]
[master=[master-ldom1,...,master-ldom4]]
[threading=max-throughputmax-ipc] ldom
The "threading" parameter defines the workload. The options from the white paper are defined as follows:



  • max-throughput.
    Use this value to select the threading mode that maximizes throughput. This mode activates all threads that are assigned to the domain. This mode is used by default and is also selected if you do not specify any mode (threading=).

  • max-ipc.
    Use this value to select the threading mode that maximizes the number of instructions per cycle (IPC). When you use this mode on the SPARC T4 platform, only one thread is active for each CPU core that is assigned to the domain. Selecting this mode requires that the domain is configured with the whole-core constraint.

Monday, August 29, 2011

Technical Posts 2H August

Technical Posts 2H August

The following are technical articles related to Network Management in the past half-month.
  • Security: Devastating' Apache bug leaves servers exposed

    Attack code dubbed “Apache Killer” that exploits the vulnerability in the way Apache handles HTTP-based range requests was published Friday on the Full-disclosure mailing list. By sending servers running versions 1.3 and 2 of Apache multiple GET requests containing overlapping byte ranges, an attacker can consume all memory on a target system.

    The denial-of-service attack works by abusing the routine web clients use to download only certain parts, or byte ranges, of an HTTP document from an Apache server. By stacking an HTTP header with multiple ranges, an attacker can easily cause a system to malfunction.

  • Mobile: Dish eyes 4G LTE wireless network

    The radio spectrum owned by Dish, and LightSquared, is reserved for satellites, but as satellite transmissions have a hard time penetrating buildings and terrain operators are allowed to build an Ancillary Terrestrial Component* – infill transmitters operating at the same frequency as the birds and providing signal to those without line of sight.

    LightSquared turned that model on its head, suggesting that the ground-based network would be primary, with the satellite providing in-fill: estimated at around 2 per cent of traffic. LightSquared then successfully lobbied the FCC to permit it (and its wholesale customers) to ship equipment that isn't even capable of satellite communications, turning the company into a 4G network wholesaler without having to shell out for 4G spectrum.

  • Security: Worm spreading via RDP

    an Internet worm dubbed “Morto” spreading via the Windows Remote Desktop Protocol (RDP).

    F-Secure is reporting that the worm is behind a spike in traffic on Port 3389/TCP. Once it’s entered a network, the worm starts scanning for machines that have RDP enabled. Vulnerable machines get Morto copied to their local drives as a DLL, a.dll, which creates other files detailed in the F-Secure post.

    SANS, which noticed heavy growth in RDP scan traffic over the weekend, says the spike in traffic is a “key indicator” of a growing number of infected hosts. Both Windows servers and workstations are vulnerable.

  • Cloud: Java arrives on Heroku code cloud

    Heroku – the multi-language "platform cloud" owned by Saleforce.com – is now running Java applications.

    Akin to Google App Engine, Microsoft Azure, or VMware's Cloud Foundry, Heroku is an online service for building, deploying, and readily scaling applications. It was originally designed for Ruby on Rails apps, but has since expanded to Clojure, Node.js, and now Java.

  • Mobile: Why Apple is Removing Unique Identifiers

    Apple is planning to phase out unique device identifiers from iOS 5, according to documentation sent out to developers, possibly to stop people worrying about their privacy on iPhones and iPads... they should "create a unique identifier specific to your app".

    [Wall Stree Journal] Henschel also pointed to the recent spat between the notoriously secretive Apple and analytics firm Flurry as a possible spur for the move. In January, Flurry reported that it had identified around 50 tablet devices in testing at Apple's campus in Cupertino using its analytics.

    "Some company called Flurry had data on devices that we were using on our campus – new devices," Jobs said live at the D8 conference in New York. "They were getting this info by getting developers to put software in their apps that sent info back to this company! So we went through the roof. It's violating our privacy policies..."

  • Mobile: Nokia accidentally unveils OS it should have had in 2009

    Nokia is expected to unveil the a major refresh of its Symbian OS today, bringing it bang up to date with competitive phones from two years ago. Owners of more recent Symbian^3 models should be able to update their handsets eventually.

    Four new devices are expected to be unveiled – either today, or very shortly. The Belle update should keep loyalists happy for some time to come. Performance and usability appear to have been improved greatly.

  • Cloud: Performance Monitoring is Someone Else's Problem

    “Amazon and Google don’t have an army of service operatives monitoring their farms,” says Graeme Swan, a partner at consultancy Ernst & Young. “They basically smashed as much infrastructure as they possibly could into warehouses, and then just assumed that capacity would be there. Now, clients are telling them they want a premium service. They are worried that they have no way of monitoring it or tweaking it. So there is no premium service.”

    You can buy as much premium support as you like (although some question how well it works). Premium performance streams? Not so much.

  • Cloud: VMware turns shrink ray on open source dev cloud

    On Wednesday, the virtualization giant introduced Micro Cloud Foundry, a free downloadable version of its Cloud Foundry service that runs on a single laptop. This past spring, when VMware unveiled Cloud Foundry and open sourced the code behind it, the company indicated it would eventually offer a shrunken incarnation that would allow developers to test applications on their local machines.

  • Cloud: VMware turns self into (virtual) database co.

    vFabric Data Director has a utility pricing model, as you would expect, at a cost of $600 per VM under management per year that is running a database image. vFabric Postgres, VMware's tweaked and tuned version of PostgreSQL, is available free of charge for developers and will be available for download starting today at cloudfoundry.com.

    If you put a vFabric Postgres image into production, then it costs $1,700 per VM per year. The underlying vFabric 5.0 Standard Edition costs $1,200 per VM per year, while the Advanced Edition, which has more bells and whistles, costs $1,800 per VM. The Advanced Edition includes RabbitMQ messaging and an SQL interface for GemFire called SQLFire.

  • Cloud: Dell floats cloud built on ... VMware

    At the VMworld virtualization and cloud extravaganza in Las Vegas today, Dell said that it was fluffing up the Dell Cloud using VMware's brand-spanking-new ESXi 5.0 hypervisor, the vSphere 5.0 management tools for it, the vCloud Director cloud fabric, and the vCloud Connector extensions that allow a private cloud and a slice of a public cloud to be managed from the same console and to teleport jobs back and forth from the public and private clouds.

    The Dell Cloud comes out of the Dell Services unit, which is the amalgam of Dell's server and PC support business and consulting services practice with the Perot Systems system and application outsourcing business it acquired in September 2009 for $3.9bn.

  • Cloud: HP mates blades with VMware vSphere

    The VirtualSystem VS2 configuration for vSphere 5.0 moves to a bladed server and bladed Lefthand P4800 SAN arrays. The VS2 setup has a dozen BL460c G7 two-socket Xeon blade servers and two BladeSystem c7000 blade server chassis. Each blade has a dozen cores running at 3.06GHz

    The largest VirtualSystem for vSphere 5.0 setup is the VS3 box, which is designed to support up to 6,000 VMs. This monster has four BladeSystem c7000 chassis, a total of 64 of HP's ProLiant BL460c G7 servers

  • Mobile: Samsung 'considering purchasing' HP's orphaned webOS

    Samsung may be mulling over the purchase of webOS – recently orphaned by HP – in a move to protect itself from an increasingly unfriendly Apple and the threat of Google and its new toy, Motorola Mobility.

    Or so say "sources from notebook players", speaking with the Taiwanese rumor-and-news website, DigiTimes.

  • Cloud: VMware orders vCloud army across five continents

    VMware envisions a world where applications can roam across one big intercloud. Apps won't just jump from internal data centers to public cloud services, the company believes. They'll move from cloud to cloud like phone calls across cell networks.

    That's why VMware is keen on getting its vSphere server virtualization not only in the corporate data center, but out there on the service providers who want to be the next Amazon EC2. Then VMware can own the corporate cloud computing on both sides of the firewall.

  • Cloud: Citrix Cloud.com goes open source

    After taking control of the CloudStack cloud management framework through its acquisition of Cloud.com back in July, Citrix Systems is now open sourcing the code behind the tool. At the same time, it's adding support for the provisioning of workloads on additional hypervisors and, for the first time, on bare-metal machines.

    Cloud.com was founded in 2008 at about the same time as rival Eucalyptus Systems. It was known as VMOps before it came out of stealth mode in May 2010. Citrix is trotting out CloudStack 2.2.10, which has been certified to support rival VMware's ESXi 5.0 hypervisor, part of the vSphere 5.0 server virtualization stack that was annoumced in July and which started shipping last week.

    Citrix is trotting out CloudStack 2.2.10, which has been certified to support rival VMware's ESXi 5.0 hypervisor, part of the vSphere 5.0 server virtualization stack that was announced in July and which started shipping last week.

  • Internet: The case for a free market in IPv4 addresses

    Officially, the world ran out of IPv4 addresses earlier this year, when a final batch of addresses was divided among the five Regional Internet Registries. There are still a lot of unused and underused IP addresses in the hands of various private organizations. All that is needed is an incentive for them to part with their unused addresses voluntarily. In other words, what's needed is a market in IP addresses.

    Earlier this year, Microsoft paid $7.5 million for two-thirds of a million IP addresses that were previously held by a bankrupt Nortel, suggesting that the going rate for an IP address is around $10.

    Ford, Merck, Xerox, Halliburton, and nearly a dozen other companies not primarily in the networking business were each given a Class A block of 16 million addresses. MIT also got a Class A block, and the UK government got two of them. The US government claimed about a dozen Class A blocks, giving it control of nearly 200 million addresses—more IP addresses than all of Latin America has today.

  • Mobile: Sprint to get seat at grown-up table when iPhone 5 hits?

    Sprint will be the next carrier to offer the iPhone to customers in the US, according to sources speaking to the Wall Street Journal. The carrier will begin offering the iPhone 5 in October alongside AT&T and Verizon, both of which are also expected to begin selling the device mid-month, though it is believed that Sprint will also carry the iPhone 4, bolstering earlier rumors that Apple would keep around the iPhone 4 as the new low-cost replacement for the iPhone 3GS.

Network Management Connection

The transition from IP Version 6 from IP Version 4 may be a slow moving target. With companies like Microsoft buying large blocks and other companies holding millions - IP Addresses are like gold and oil. These investments may prove to not only be profitable, but the sale of these virtual goods may slow the implementation of IP V6.

Cloud Computing, based upon Virtualization technology from VMWare and Citrix open-sourced Xen continues to try to make inroads. Large system vendors like HP and Dell align themselves with proprietary VMWare. Oracle's VM technology maintains some level of compatibility with Citrix Xen. With Cloud Computing, the network becomes vastly more important.

Microsoft Windows has another WORM exposure, around it's proprietary RDP technology, based partially around file transfer options while UNIX Apache finds itself vulnerable to denial-of-service attacks. These key infrastructure points underpin modern intranet and internet computing today, both putting pressure on "the network". The Apache DoS merely makes it "look like" a network problem while another Microsoft worm really creates a possible capacity issue with "the network", if it can't be controlled.

HP finds itself bailing out of the mobile handset market (with Samsung possibly trying to buy it up for patent protections) dominated by heavy weights like Google (who ate Motorola's handset division and creates a mostly open-sourced based Android solution), Apple (with it's popular iPhone BSD UNIX parially open sourced solution), and Oracle (who is assaulting Google for using Java without paying license fees, like every other mobile vendor does.)

The mobile market has the opportunity to heat up, with more mobile 4G vendors hitting the market. By diversifying 4G to include Satellite vendors, in conjunction with Cell Phone operators, as well as land-line operators, in addition to new WiMax vendors (i.e. Clear) - there is the opportunity for a real explosion in the mobile network arena... which will all need to be managed. With dominant smart phone vendors like Apple possibly releasing iPhone for Sprint - this could really grow their market, as ATT and Verizon raise their costs to customers.

Friday, July 1, 2011

Solaris Tab Update: Solaris 11 & Crossbow


Solaris Tab Update: Solaris 11 & Crossbow

New resources have been added to the Solaris Tab, primarily concerning Solaris 11.

There is a helpful PDF document demonstrating Virtual Networking via "Crossbow".

Network Management Connection

Setting up a completely virtualized server and switch environment on a single platform meets various requrements such as: portable network management demonstrations, framework to build network management test labs, and a framework to simulate and test network management applications in a WAN environment, without purchasing the hardware.

Powerful frameworks like Crossbow are available under Solaris 11 derivative operating systems like Solaris 11 Express, OpenSolaris, OpenIndiana, Illumos, etc.

Solaris Reference Material
2010-12 [PDF] Set Up a Virtual Network Automatically with Solaris 11 Express
2011-03 [PDF] Solaris 11 ISV Adoption Guide
2011-06 [HTML] Lab: Introduction to the Solaris ZFS File System
2011-06 [HTML] Lab: Protecting Your Applications with Solaris 10 Security
2011-06 [HTML] Lab: Protecting Your Applications with Solaris 11 Security
2011-06 [HTML] Lab: Installing Solaris 11 Express in Oracle VM VirtualBox

Friday, June 10, 2011

SNMP Page Update: Solaris 10 LDoms / Oracle VM Server for SPARC



SNMP Page Update: Solaris 10 LDoms / Oracle VM Server for SPARC

The Network Management SNMP page has been updated, adding a reference to Solaris 10 LDoms, or more recently called Oracle VM Server for SPARC.

There is an SNMP management infrastructure for the SPARC "T" series, which can be leveraged (free of cost) to provide multiple domain management fault and performance management. Capabilities include: reviewing the cpu/memory/disk/network/virtual-network resources, oberving logical domain stops/starts, and even stopping/starting logical domains through SNMP.

Why does this sound so foreign?

Because no one else does it for free, that is why... just another reason why Network Management resources are familiar & skilled with SPARC and Solaris.

SNMP - Solaris 10 Management Interface Base

LDoms 2.1 - [RFC] [MIB] [HTML] - Using the Oracle VM Server for SPARC Management Information Base Software

Monday, May 10, 2010

Oracle VM Server for SPARC (LDoms) Dynamic Resource Management



Orgad Kimchi at Sun, now Oracle, blogged on VReality an overview of Oracle VM Server for SPARC, previously called Sun Logical Domains or LDoms. In particular, he discussed Version 1.3 with Dynamic Resource Management or DRM. The allocation of CPU threads or resources according to pre-defined polices was the target.

Orgad posted a PDF which was formatted reasonably well, but the fonts made certain sections difficult to read in the PDF that he included. I copied the PDF contents into this blog, re-formated it (while trying to keep as close to the original style as possible), adjusted some typographical errors, and included it in this blog. While the blog is not the optimal format to hold this content in, I left some feedback on his original content suggesting some reformatting suggestions.

Oracle VM Server for SPARC (LDoms) Dynamic Resource Management

ABSTRACT:

In this entry, I will demonstrate how to use the new feature of Oracle VM Server for SPARC (previously called Sun Logical Domains or LDoms) version 1.3 Dynamic Resource Management (a.k.a DRM) for allocating CPUs resources based on workload and pre defined polices.

Introduction to Oracle VM Server for SPARC:

Oracle VM Server for SPARC is a virtualization and partitioning solution supported on Oracle Solaris CoolThreads technology-based servers powered by UltraSPARC T1, T2, and T2 Plus processors with Chip Multi-threading Technology (CMT).

This technology allows the creation of multiple virtual systems on a single physical system. Each virtual system is called a logical domain (LDom) and runs a unique and distinct copy of the Solaris operating system.

Introduction to Dynamic Resource Management:

With this feature, we can define policies to control an upper and lower threshold for virtual CPU utilization on an LDom. If an LDom needs more capacity and other LDoms on the same physical server have spare capacity, the system can automatically add to or remove CPUs from domains - as per the defined policies.

The main goal of dynamic resource management (DRM) is to provide the LDoms resource allocation flexibility in order to allocate resources to the LDom during peak time without human intervention.

Architecture layout :


Prerequisites:

We need to define the control domain and three logical domains. Refer to the Logical Domains 1.3 Administration Guide (http://docs.sun.com/app/docs/doc/821-0406) for a complete procedure on how to install Oracle VM Server for SPARC.

Dynamic Resource Management configuration:

We will define a total of three polices (policy1, policy2 ,policy3), one for each domain (ldg1,ldg2 ,ldg3), each policy will define under what conditions virtual CPUs can be automatically added to and removed from a logical domain.

A policy is managed by using the commands: ldm add-policy, ldm set-policy, and ldm remove-policy commands.

The following ldm add-policy command creates the policy to be used on the ldg1 logical domain.
# ldm add-policy util-lower=25 util-upper=75 vcpu-min=4 vcpu-max=8 attack=1 decay=1 priority=1 name=policy1 ldg1 
The following policy does the following:

■ Specifies that the lower and upper limits at which to perform policy analysis are 25 percent
and 75 percent by setting the util-lower and util-upper properties, respectively.

■ Specifies that the minimum and maximum number of virtual CPUs is 4 and 8 by setting
the vcpu-min and vcpu-max properties, respectively.

■ Specifies that the maximum number of virtual CPUs to be added during any one resource
control cycle is 1 by setting the attack property.

■ Specifies that the maximum number of virtual CPUs to be removed during any one resource
control cycle is 1 by setting the decay property.

■ Specifies that the priority of this policy is 1 by setting the priority property. A priority of 1
means that this policy will be enforced even if another policy can take effect.

■ Specifies that the name of the policy file is policy1 by setting the name property.

■ Uses the default values for those properties that are not specified, such as enable (off) and
sample-rate (10 sec).

This is the second policy for the second LDom (ldg2)
# ldm add-policy util-lower=25 util-upper=75 vcpu-min=8 vcpu-max=16 attack=1 decay=1 priority=2 name=policy2 ldg2
This is the third policy for the third LDom (ldg3)
# ldm add-policy util-lower=25 util-upper=75 vcpu-min=8 vcpu-max=16 attack=1 decay=1 priority=3 name=policy3 ldg3
Now we need to enable the policies:
# ldm set-policy enable=yes name=policy1 ldg1
# ldm set-policy enable=yes name=policy2 ldg2
# ldm set-policy enable=yes name=policy3 ldg3
The following example shows how the configuration looks on the control domain. You can verify
the policies have been created by using the "ldm ls -o res" subcommand.
# ldm ls -o res
NAME
primary
------------------------------------------------------------------------------
NAME
ldg1

POLICY
STATUS PRI MIN MAX LO UP BEGIN END RATE EM ATK DK NAME
on 1 4 8 25 75 00:00:00 23:59:59 10 5 1 1 policy1
WEIGHTED MEAN UTILIZATION
4.2%
------------------------------------------------------------------------------
NAME
ldg2

POLICY
STATUS PRI MIN MAX LO UP BEGIN END RATE EM ATK DK NAME
on 2 8 16 25 75 00:00:00 23:59:59 10 5 1 1 policy2
WEIGHTED MEAN UTILIZATION
0.1%
------------------------------------------------------------------------------
NAME
ldg3

POLICY
STATUS PRI MIN MAX LO UP BEGIN END RATE EM ATK DK NAME
on 3 8 16 25 75 00:00:00 23:59:59 10 5 1 1 policy3
WEIGHTED MEAN UTILIZATION
0.0%
The following example shows how a policy, called policy1, can be changed in order to add more
CPUs to a machine called ldg1
# ldm set-policy name=policy1 vcpu-max=16 ldg1
The following example shows how we can remove a policy, called policy1
# ldm remove-policy name=policy1 ldg1
Now, let's check how dynamic resource management works :
In order stress the CPU of your system, you can get the spinners loading tool from BigAdmin (see http://www.sun.com/bigadmin/software/nspin/nspin.tar.gz .)

We will monitor the system before and during the workload.

Connect to the console of the first guest domain (ldg1)
# telnet localhost 5000
Verify the number and CPUs load using the mpstat command
# mpstat

CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl
0 0 0 4 215 7 20 0 0 0 0 11 1 0 0 99
1 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99
2 0 0 3 21 6 19 0 0 0 0 11 1 0 0 99
3 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99

We can see that the LDom is underutilized (idl =99) and that we have 4 CPUs (0-3)
Let's start the workload using the nspins command and monitor the effect on the system utilization and the total number of CPUs :
# nspins -n 8 &
# mpstat 10
Now give it ~40 seconds. or so to run

CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl
0 0 0 52 201 0 2 8 0 0 0 1 100 0 0 0
1 0 0 4 20 4 12 13 0 0 0 6 100 0 0 0
2 0 0 2 31 11 23 18 0 0 0 13 100 0 0 0
3 0 0 3 21 5 11 12 0 1 0 38 100 0 0 0
4 0 0 2 16 1 6 10 0 0 0 1 100 0 0 0
5 0 0 2 23 2 13 13 0 0 0 2 100 0 0 0
6 0 0 1 17 2 8 10 0 1 0 2 100 0 0 0
7 0 0 0 12 1 4 9 0 0 0 1 100 0 0 0

We can see that all the machine's CPUs are utilized (idl=0) and the total number of CPUs are increased to 8 (0-7) In order to see the CPUs diminished effect we can stop the workload and monitor the LDom again.
# pkill nspins
# mpstat 10
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl
0 0 0 4 215 7 20 0 0 0 0 11 1 0 0 99
1 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99
2 0 0 3 21 6 19 0 0 0 0 11 1 0 0 99
3 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99
4 1 0 3 21 4 12 10 0 0 0 4 91 0 0 9
5 1 0 3 15 2 7 9 0 0 0 7 91 0 0 9
6 0 0 2 15 2 7 9 0 0 0 2 91 0 0 9

CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl
0 0 0 4 215 7 20 0 0 0 0 11 1 0 0 99
1 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99
2 0 0 3 21 6 19 0 0 0 0 11 1 0 0 99
3 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99
4 1 0 3 20 4 12 10 0 0 0 4 89 0 0 10
5 1 0 5 15 2 7 9 0 0 0 7 89 0 0 11

CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl
0 0 0 4 215 7 20 0 0 0 0 11 1 0 0 99
1 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99
2 0 0 3 21 6 19 0 0 0 0 11 1 0 0 99
3 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99
4 1 0 3 20 4 12 10 0 0 0 5 88 0 0 12

CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl
0 0 0 4 215 7 20 0 0 0 0 11 1 0 0 99
1 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99
2 0 0 3 21 6 19 0 0 0 0 11 1 0 0 99
3 0 0 3 21 6 19 0 0 0 0 9 1 0 0 99

We see from the mpstat output that the total number of CPUs has decreased by 1 in a cycle from 8 to 4

Conclusion:

Oracle VM Server for SPARC Dynamic Resource Management provides the system administrator the flexibility to have better dynamic resource allocation based on system utilization. In this blog entry, I demonstrated how to set up Dynamic Resource Management and how to monitor this feature during CPU utilization peak time.

About the Author:

Orgad Kimchi joined Sun in September 2007. He is currently working in the Independent Software Vendors (ISV) Engineering organization helping software vendors adopt Sun technology and improve performance on Sun hardware and software. Orgad’s blog can be found at http://blogs.sun.com/vreality.