Showing posts with label Update 10. Show all posts
Showing posts with label Update 10. Show all posts

Wednesday, October 16, 2013

OpenSolaris Successor: OpenSXCE (Part 1)

[OpenSXCE Mascot with Illumos Logo]

Abstract:

Solaris, once the standard in workstations, became the standard for datacenter server. Sun Microsystems had open-sourced Solaris, referring to it as OpenSolaris. Oracle, purchased Sun, released Solaris 11 upon the OpenSolaris foundation, and closed OpenSolaris. Various forks were made from the OpenSolaris code, Illumos being one of the most popular across various commercial businesses, but only OpenSXCE was successful in creating multiplatform SPARC and Intel editions. As of May 2005, Martin made his second release.
[OpenSolaris Logo]

History of OpenSXCE


Sun used to distribute a Solaris Express Community Edition (SXCE) and Solaris Express Developers Edition (SXDE) - but when Sun was preparing to drive towards Imaging Packaging system, these were canceled. OpenSolaris's final release supported both SPARC and Intel. One of the early forks from OpenSolaris was Illumos. Their premier distribution was OpenIndiana. OpenIndiana promised to also support SPARC and Intel, but people waited for years. Martin Bochnig invested the time into releasing an initial SPARC release of OpenIndiana, called MartUX. The Illumos and OpenIndiana team did not integrate his work, the wiki pages associated with his effort were purged, but Martin eventually released OpenSXCE - a fully SVR4 compliant SPARC and Intel release! At first, there was 2013.01 release, next came 2013.05. Martin was encouraged to possibly rename his distribution, to remove his name, and choose a more fitting title - OpenSXCE was born.

First Impressions


Considering the complexity & effort, the first 2013.01 DVD was impressive. The booting on SPARC actually worked, but the disk was only a live DVD. Clearly, he was close, and the community was amazed that he was able to do what former SPARC engineers from Sun Microsystems, who found their way to Illumos & OpenIndiana, were unable to accomplish!

A Pause and Moving Ahead...

Personal concerns forced me to severely curtail my community activity, much of the SPARC test equipment was placed into storage. As responsibilities started to clear more recently, the resurrection of SPARC equipment resumed.
[Sun Microsystems UltraSPARC 60 Desktop]

The Test Beds

A Microsoft Windows XP laptop with Hyperterimnal became the serial console for all servers.

Populating V120's with 15K drives began. Initial installations of SPARC Solaris 10 Update 10 had started, to ensure the platforms were functional. A single slim-line CD-ROM drive on a V120 platform with 3 Gigabytes of RAM would make a reasonable test-bed for a CD based Text based installer.

An Ultra 60 workstation with 2 Gigabytes of RAM was running a multi-terabyte file service using flash to accelerate the ZFS performance, but it's video card drop dead about 1 year ago. The Ultra60 has 2 Gigabytes of RAM and a DVD on-board, so it would still be reasonable for a DVD installer test.
[Solaris Logo]

The control case: Solaris 10

Solaris 10 can no longer be installed from a CDROM, but only from a DVD drive. Many older Sun platforms do not have DVD drives, and some DVD drives which fit those platforms are not always recognized.

Solaris 10 Update 10 has a nice feature where identical drives can be installed as a mirrored ZFS root during installation. This functionality was thoroughly tested by pulling drives out of the V120 while running an application which was performing constant writing writing to the disks, and a second application which was performing constant reading from those same disks - no indication of any hardware issues were noted by the applications, except error reporting on the console. The applications did not experience any degradation, even when drives were re-inserted, and resync'ing.

The resync'ing process for ZFS drives in a broken mirror takes seconds for short breakage durations, in contrast to other platforms where re-syncing a broken mirror would take hours, or sometimes days with larger drives. The applications on the Solaris 10 platform continued to operate flawlessly. during the operation.
[ZFS: The Default File System for OpenSXCE]

Second Impressions: OpenSXCE and Text Install

Windows Client Setup

If the terminal selection was not set to VT100 from the start, or Hyperterm was not correctly set to use Vt100, then the GUI might not operate as expected. Once the terminal was properly set up to use VT100 and Hyperterm was supposedly set up to use VT100 emulation, The installation went quickly. Most of the most common defaults were pre-selected, to make installation much easier.

SCSI Disk Drive Format

One of the two SCSI disks were not formatted, so I needed to drop out to a command line and format the disk. The "format" command was well known by my, but most people who use IDE, ATA, SATA, and USB drives are probably not familiar with the process. The process to conduct the format would have been nice had it been documented, but honestly - I don't remember seeing any recent UNIX operating system take people through that process automatically during the install process. The format command indicated it would take a little over 1 hour to format the drive - it took close to 24 hours to format the 72 Gigabyte 15K drive! (I am glad I did not have a 900 Gigabyte SAS drive, since even a hardened user might have thought there was a problem when such a format could have taken a week!)

Installation Notes

The installation documentation and process inform the user that the mirroring of the ZFS hard drives could be done after installation. This is a nice touch, since Solaris 10 Update 10 does this from the start as an option in the installer. This gives the user an opportunity to provide parity with Solaris 10 Update 10, without adding the complexity to the installer.

Install Experience

The installation was extremely quick - much faster than what I was expecting! I walked away during the install and it was completed when I returned. I will watch during my next install to time it properly. This truly beat Solaris 10 Update 10 install, hands-down.

There is an option to review the installation log, at the end of the install. The Hyperterm vt100 emulator appears to have been lacking since the screen split into 2 sides, where the left hand side seemed to scroll correctly, but the right hand side did not. Die-hard UNIX administrators would know that the [control][l] could be used to perform a refresh when the text screen became corrupt. It would have been nice to have such a warning, for new-be's - but I have not honestly seen such warnings for many years with textual installers.

Post-Install Experience

Pressing the [F8] key from the Hyperterm emulator did not initiate a reboot, at the final screen, as expected. There was a warning during the installation that function keys occasionally do not work from the emulators, and a user could revert back to using [ESCAPE] with a numeric aterwards. This worked flawlessly, the reboot started immediately after pressing [ESCAPE] followed by an [8].

Another thing which caught me by surprise, the root user was not allowed to log in from the serial console after installation, but the additional user specified during install MUST be used. I may have missed this during the installation warnings, perhaps it should be more clearly noted on the install screens.

There were some odd errors noted, with an "ldom" service, which did not surprise me since I was running on older SPARC hardware which did not support LDom's (or more recently known as Oracle VM for SPARC.) This functionality should only work on modern processors.It would be nice to have a check for old hardware and silently exit, or at least indicate that this is expected behavior on this class of hardware.

Amazing to me, there was no problem with the installation coming up in a fully functional way, with networking operating the way it was supposed to. This was some nice attention to detail.

Full Internet-Based Upgrade

The root user automatically provided a note which offered to upgrade the text installation from an external internet based repository. This was a wonderful addition, being able to use System V Revision 4 standard packaging formats for upgrading the OS from the internet! People may have noted that Sun (and later Oracle) decided to move from SVR4 packaging to a proprietary packaging format to get this feature, when clearly moving to a proprietary format was never needed for this functionality.

The internet upgrade time was 1 hour and 55 minutes, which was provided by the SVR4 packaging system. This was very nice forethought by the distribution! The command to boot into the new boot environment was provided by the upgrade process - kudos again to the distribution! The instructions were not as clear as they could be, for the process to reboot into the new boot environment, for new users.

Everything was not perfect. I lost my network functionality after the network upgrade from the internet. The process for mirroring the root disks with ZFS was not as clean as I had hoped.
[Sun Microsystems UltraSPARC IV Systems]

Final Thoughts

My first impression of the new system can be summed up in a single word: impressed. How could a part-time programmer from Eastern Europe do what was promised and could not be delivered by former staff of Sun Microsystems? Truly, this is "hat's off" time to Martin, I hope OpenIndiana or Illumos take some of his work "side-stream" or "upstream", and someone hires him to work on Solaris based engineering project!

Wednesday, February 13, 2013

Tab Update: Solaris



Solaris Tab Update!
The Solaris Tab was updated with some new Reference Material links, to correlate to the Solaris 10 Update 11 Release (aka Solaris 10 1/13.)

Solaris Reference Material
... 
2010-09 [HTML] Solaris 10 Update 9 Reference Library (Solaris 9/10)
... 
2011-08 [HTML] Solaris 10 Update 10 Reference Library (Solaris 8/11)
...
2013-02 [HTML] Solaris 10 Update 11 What's New? (Solaris 10 1/13)
2013-02 [HTML] Solaris 10 Update 11 Reference Library (Solaris 10 1/13)

Friday, August 31, 2012

Installing Solaris on Former Non-Solaris Disks


Abstract:
When installing [SPARC] Solaris on a non-Solaris disk drive, after completing system identification information, the installer may terminate with the error "One of the following problems exists: Hardware failure Unformatted disk" error. This is due to the lack of proper disk labeling. The user can exit the installer and perform the labeling exercize before restarting the installation.

What's in a Label?
The label is the description to the operating system regarding what is on the media. The media has a table filled with slices, some legacy systems support up to 16 slices, while Solaris supports 8 slices. There are two types of supported labels: SMI and EFI. SMI is used for UFS filesystem while EFI is used for ZFS filesystem.

Slices on a label may be overlapping, where slice 2 holds the entire disk (encapsulating all slices), slice 0 holds the root filesystem (and boot code), slice 1 normally holds the swap slice (to augment physical memory by acting as virtual memory), and other slices can be used for other filesystems such as /var (so a growing log file does not take down a system) or /export/home (so a user's home directory does not crash a system by having data which grows out of control.)
Labeling a Disk:
After a failed installation, the user will drop out to a root "#" prompt. The disks can now be labeled through the "format" command and system rebooted to the cdrom install media. Choose the SMI label, if prompted - this has been tested up to Solaris 10 Update 10.


# format -e
format&gt disk
(choose disk)
format&gt label
[0] SMI Label
[1] EFI Label
Specify Label type[1]: 0
format&gt quit
# cd / ; init 0

ok boot cdrom

Conclusion:
Non-Sun and non-Oracle disks can be used on older equipment to provide a storage or performance boost when installing Solaris 10. This procedure was used with Solaris 10 Update 10.

Sunday, September 18, 2011

Solaris 10: Update 10 - Released!


Solaris 10: Update 10 - Released

Solaris 10 Update 10 has been released, note the "What's New" document.

Performance Enhancements Include:
  • Faster ZFS performance
  • Faster boot, with option to skip POST
  • Faster upgrades: Live Upgrade on ZFS root partition, instead of mirrors
  • Faster installation: use Flash Archive on ZFS root using text mode
  • Faster reboot: option to skip some POST tests
  • Enhanced throughput leveraging smt_pause for busy-wait or idle loops
  • Enhanced throughput: 64 bit libmtmalloc, atomic operations replace locks
  • Faster memory: 64 bit libmtmalloc, matrix lookups replace linked list
  • Use libmtmalloc for applications with threads>=16
  • Use libumem for applications with threads <16
  • Disk I/O improvement for SSD's with poor read-modify-write firmware
  • Improved I/O performance under Nahalem-EX platforms
  • Improved floating point, audio, video processing with Intel AVX Support
  • Faster Oracle startup/shutdown with ISM and DISM improvements
  • Faster high-speed networking for x86 bnx driver Jumbo Frame support
  • Increased network performance through bge driver MSI support
  • Faster RAC 11g via Remote Direct Memory Access interfaces via RDSv3
ZFS Improvements Include:
  • Set file system properties in a sent/received snapshot stream
  • ZFS Diff: Determine differences between snapshots
  • ZFS Recovery: Import a pool missing an intent log file
  • ZFS Recovery: Import a damaged pool read-only
  • ZFS Synchronous Behavior: standard, always, disabled
  • Interval and Count for zpool: list and status
New Capabilities Include:
  • Greater than 2 terabyte memory support
  • Solaris Volume Manager clustered dataset import for recovery
  • User extensibility for up to 1024 group membership
  • SaMBa upgrade to 3.5.8
  • x86 BASH upgrade to 3.2
  • Apache C++ standard library upgrade to 4
Observability Enhancement Include:
  • ZFS Difference capability
  • Processor Group (pginfo) OS performance hardware view
  • Processor Group (pgstat) hardware and software utilization
  • Logical disk name to JBOD or blade chassis bays (diskinfo) view
Security Enhancements Include:
  • LDAP name service tol functionality without LDAP being configured
  • IVv6 NAT on IPFilter
  • Solaris Cryptographic and Key Management Framework support for OKM
  • Additional AES cyphers in kernel SSL (Secure Sockets Layer)
  • New Passwords no longer unlock accounts
  • Password construction policy applies to root by default
  • SSH supports chroot capability
Device Support Enhancements Include:
  • Intel ixgbe driver support for: 82599, x540/x540T
  • Intel igb driver support for: 82576, 82580, i350
  • Intel e1000g 82579LM/LF LOM controllers: 1502,1506, 1519
  • Broadcom bge driver support: BCM5717, BCM5724
  • QLogic P3+ FCoE CNA Ethernet qlcnic and device support
  • Mellanox ConnectX-2 10GigE mcxnex/mcxe drivers for GLDv3
  • Intel Patsburg SCU support: ld60, ld61, ld64, ld65, ld68, ld69
  • LSI MegaRAID Falcon SAS 2.0 HBA device via imraid_sas
  • LSI SAS 2308 HBA storage device via mpt_sas
  • LSI SAS 2208 HBA device via mr_sas
  • Public Generic LAN Driver interface for bge

Wednesday, August 24, 2011

Solaris 10 Update 10 Eminent and Imminent


Oracle Solaris 10 Update 10

Oracle's Solaris and SPARC public road map is pretty clear - Solaris 10 Update 10 release is expected 2H 2011 with Solaris 10 Update 11 scheduled for 2H 2012.

In a little more than 1 month away, Oracle OpenWorld 2011 is scheduled (October 2-6, 2011) to occur, which means significant announcements!

Solaris 10 Kernel Patch ID's

The Solaris patch id's for Solaris 10 Update 10 (and beyond) have been updated on Oracle's Solaris Patch Corner blog. It seems Update 10 is named 8/11 (or August 2011), which means it is scheduled to be released around now and is the talk of the town.
Solaris 10 SPARC Kernel PatchIDsSolaris 10 x86 Kernel PatchIDsDescription
147440-01 to 147440-xx147441-01 to 147441-xxKernel Bug Fixes post Solaris 10 8/11 (Update 10)
144500-19 only144501-19 onlySolaris 10 Update 10 Kernel PatchID
144488-01 to 144488-17144489-01 to 144489-17Kernel Bug Fixes post Solaris 10 9/10 (Update 9)
142909-17 only142910-17 onlySolaris 10 9/10 (Update 9) Kernel PatchID

2010-08 Features

Last year, some features were known to be rolled into Solaris 10 Update 10.
...indications on the following:

* RDSv3 for use with Oracel RAC
* PSARC/2007/587 Volo Low Latency Socket Framework
* PSARC/2010/108 zil synchronicity
* Adobe reader for X86 version 9.3.X
* Lightning Thunderbird extension for Oracle Beehive
With the zil synchronicity update it seems likely that
the next update, just as the last few, will get a large
backport of ZFS code from Solaris Next, but with some
features turned off, deduplication will be still be
disable in update 10. This would release will probably
also include support for the new SPARC T processors with
better single thread performance...
The SPARC T4 processor support is expected shortly.

2010-11 Features

Some additional features to Solaris 10 Update 10 were leaked the following month.
...good additions besides the bug fixes.

* IPfilter IPv6 NAT support
* 10Gb Ethernet support for Mellanox ConnectX-2 chipset
* SSH Support for ChrootDirectory and ConnectTimeout
* PSARC/2008/256 Native LDAP standalone tools (Duckwater Phase 0)
* Updated FireFox to 3.6.8+ and Thunderbird 3.1+
The ZFS update should include bits similar to snv_148 which
among other things include the following:
* RAID-Z/mirror hybrid allocator
* Missing log import (PSARC/2010/292) (CR 6733267)
* ZIL synchronicity PSARC/2010/108
* read-only import (PSARC 2010/306)
There might also be an update to the bundled samba which is a bit overdue.
2011-01 Features

There appears to be a ZFS refresh bundled into Oracle Solaris 10 Update 10.
Solaris 10 update 10 ZFS refresh

The internal builds of Solaris 10 8/11 (update 10) have had another
refresh of the ZFS code. It is now be synced with snv_153 which is
a even later build than Solaris 11 Express 2010.11 is based on. Also
related to storage this update will support the LSI SAS 2308 HBA and
the LSI SSS 6200 Solid State Storage.
2011-08 Features

A list of the patches comprising Solaris 10 Update 10 hit the internet.
SunOS 5.10: Solaris kernel patch

General informations
* This is a security patch
* Release date: 2011-08-04
* Detected status: RELEASED
* Synopsis: SunOS 5.10: Solaris kernel patch
* Archive size: 75925271 bytes (72.41 MBytes)
* Keywords: Patch, security, file, pass, audit, kernel,
descriptors, management, block, limit, s, acl, statd,
framework, permission, recursive, linker, account, LWP,
unix98, unix03, libmtmalloc, mtmalloc, pmap, ed, psrset,
sata, alloc, sysacct, loin, ssrv,
* Architecture: sparc sparc.sun4u sparc.sun4v
* Solaris Release: 10
* SunOS Release: 5.10
* Unbundled Product:
* Unbundled Release:
* Xref: This patch available for x86 as patch 144501
* Files: click here
* View README
* View differences between README versions
* Download at Oracle MOS
Linker Updates

New features for the Linker may be added to Solaris 10 Update 10.
Solaris 10 Update 10 Release
The -z rescan-now, -z recan-start, and -z rescan-end options provide additional flexibility in specifying archive libraries to a link-edit. See Position of an Archive on the Command Line.
Mistaken Early Release

It seems Oracle mistakenly released Solaris 10 Update 10 early to their Downloads section.
Friday (2011/08/12) I went to the Solaris Download page and Update 10 was available for download. Today I go back to the page and it has reverted back to Update 9. Anybody know what's up? Has Update 10 been released or not?
...
FWIW - What I'm hearing from my sources is that the ISO that was available IS the Update 10 that will be released. It will be officially released when the documentation is complete.
EMC PowerPath

If you are an EMC PowerPath user, Solaris 10 Update 10 should NOT be installed, until EMC 5.3 patch release has been made available. Please see NOTE 9 in the patch README.
NOTE 9:  Do not install this patch on systems running

EMC PowerPath, as all currently released EMC
PowerPath versions (as of August 18th 2011)
are incompatible with this patch.
EMC PowerPath is using a private Solaris
structure which was modified in this patch
to fix a race condition. Applications
should not use private Solaris interfaces
as they are subject to change.
EMC PowerPath Engineering is working on
a 5.3 patch release to resolve this issue
and have published ETA emc275344 on
https://powerlink.emc.com,
which contains further information.
Failure to abide by this patch release note is not pleasant.

In Conclusion

Oracle's release of Solaris 10 Update 10, heads and shoulders above the other patch updates, is probably moments away...