Joyent: Encapsulating Linux through Docker into a Zone

[Solaris 11 Launch image, courtesy Oracle]

Abstract:

Virtualization has been available in the UNIX OS world. The creation of users in a time sharing environment, to isolate executable threads from one another as well as protect files in an underlying file system started the journey. The creation of the Virtual File System, where disks could me mounted anywhere in a file system tree (instead of drive letter) revolutionized computing to allow those systems to grow in the shared environment! The creation of "chroot" so an application could run in it's own file system space, made an application "feel" like it is on a dedicated system. The merging of SVR4 into Solaris created a robust multi-processor infrastructure to host multi-user and  multi-tenant systems. The creation of Zones under SVR4 Solaris 10, further extrapolated the original concepts of the UNIX "chroot", isolating CPU, Memory, Users, Storage - effectively making a single instance of the Solaris OS truly multi-tenant. The creation of Branded Zones for Linux and Solaris came later, offering entire operating systems to be encapsulated under Intel and SPARC Solaris systems. Newer proprietary technologies continue to enter the horizon.

[Oracle Linux, courtesy Oracle]

The Linux Problem

People participating in the Linux ecosystem are interested in creating new raw environments,  isolated to their operating system under proprietary Intel processors, to supply a reasonable replacement for mature infrastructure. These replacements constitute very long efforts, which often never really get completed. Veterans understand the benefit of good engineering and can often take systems "to the next level." Vendors like Oracle had taken Linux, ran their applications on top of it, and supplied the patches necessary to keep Linux stable.

Joyent: Zones(KVM and Linux)

Former employees of Sun Microsystems continue to do the heavy lifting in the industry. Network Management wrote about Joyent's efforts to port KVM into Solaris Zones under their SmartOS, based upon Illumos. Illumos originated from Sun Microsystem's OpenSolaris project (which became the basis of Oracle's Solaris 11.)

[Solaris Zone/Container concept, courtesy former Sun Microsystems]

Joyent: Zones(Docker and Linux)

One might expect that Cloud companies who are obsessed with Virtualization like Joyent would continue their quest for a "better cloud". In 2015, Joyent released a presentation on the porting of Docker to encapsulate Linux into a Zone... using the same SmartOS based upon Illumos, which found it's roots in Sun Microsystem's OpenSolaris.

Docker and the Future of Containers in Production from bcantrill

For Joyent, The Cloud means chasing every container technology and integrating it into SmartOS, to give their customers choice, while simultaneously utilizing their infrastructure as efficiently as possible.

Conclusion

SVR4 UNIX and Sun Solaris developers have a long history of virtualization. The success story of Joyent in "Cloud" environments continues to lead the market in vision, taking things which were good but raw, and rolling them into mature facilities which continues to make the computing industry grow!

Third Annual Solaris Family Reunion (Part 1)

Abstract:
Deirdre at Joyent helped to organize The Third Annual Solaris Family Reunion sponsored by Joyent on September 23, 2013.Attendees ranged from former employees at Sun to current employees at Oracle. Each discoursed a short 10 minute presentation as to what they have been doing over the past 3 years. This includes sessions 1 through 6.


Session 1: Opening with Bryan Cantrill of Joyent


Session 2: Visualization & Medieval Medicine with Brendan Gregg since 2010
DTrace, Performance, Observability, and Visualization in SmartOS
System Tap, JDB, KVM, freezing, and crash dump, in Red Hat Linux: .
Introducing: Systems Performance: Enterprise and the Cloud


Session 3: VP Eric Schrock & CTO Adam Leventhal of Delphix since 2010
Formerly worked on FishWorks in Sun, cared about all workloads.
Delphix specializes in building virtualized databases, snapshots, and clones.
Improved ZFS for low space, fragmentation, small record conditions, and write throttle.
Tremendous innovation with Java Management Stack for OpenSolaris, Linux, HP-UX, IBM AIX.
Famous Quote, "The AIX Documentation completely outstrips the implementation" and "We use COMSTAR alot... it still sucks... love to rip it out"


Session 4: Nexenta, Illumos, and DEY Storage Systems Garrett D'Amore
Founded Illumos while at Nexenta, moved to DEY Storage Systems.
Generate analytics with DTrace. Crossbow can be used to virtualize storage service, uniquely under Solaris.


Session 5: Oracle employee Blake Jones
Revisited Virtual Memory System in Oracle Solaris, released in Solaris 11.1.
The 36 page paper in 2011 had a small number of papers implemented.
Free List Management was implemented with Dynamic Reconfiguration and memory retirement.
The M6-32 was released at Oracle, with 32 Gigabytes of RAM.
Large Shared Memory algorithms which do work with large pages.
Famous quote, "Now at Oracle, we still are building  the hardware, building the Operating System, and we are building stuff on top of it that really doesn't suck."


Session 6: Bill Moore
New startup with new high-capacity flash modules, new product to be released in a number of months.