Pre-build OpenSolaris 2008.05 JeOS RNJS AMI images

For creating of pre-build PUBLIC OpenSolairs AMIs I select Glassfish MySQL and WebStack AMP bundles, they are very easy to deploy and configure so they are ideal for Virtual Appliances as PoC (Proof-of-Concept) software.

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

AMI Net Install Image: os200805 JeOS + Glassfish & MySQL or AMP stack

ami-0d50b564

aki-7846a311

ari-7d46a314

sun-osol/2008.05_JeOS_32_1.0.img.manifest.xml

In fact this an another example how composite image can be created, this time I will use IPS net based install from default OpenSolaris repository.

Advanced ec2ify: ssh_indent_key + data disks formated with ZFS and mounted /mnt, user-data, updater, syncer

<p
See install steps bellow:
Get & Inst: Net based install of IPS packages into OpenSolaris 2008.05

Get & Inst: Net based install of IPS packages into OpenSolaris 2008.05

In fact this an another example how composite image can be created, this time I will use IPS net based install from default OpenSolaris repository.

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

New IPS packaging system

Local xVM / XEN environment as main development tool

Amazon EC2 is based on XEN hypervisor, AMI runs as DomU so any OS with XEN hypervisor implementation as popular Linux distributions, OpenSolaris Nevada and Indiana lines can be used for emulating Amazon EC2 environment for faster local development.

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

Because users don’t have access to Kernel/Ramdisk, they are located in Dom0 on RO mode. many issues with getting them before boot with PyGRUB from DomU image don’t apply, especially where OpenSolaris images with UFS or ZFS root is used in Linux based Dom0.

You can use rebundling process on Amazon EC2 for fast initial AMI creations, later you can download your private AMIS locally and unbundle (split into one image and decode) them. This is why it is good in process of rebudling set your password to root user, so you can after access image locally with console.

If you plan to run Linux based Dom0 is also good to get Kernel/Ramdisk images from running instance. t. m. save /platform dir with ssh.

I prepared XEN DomU OpenSolaris JeOS RNJS archives, its planned as Optional Feature Download, if somebody of you is experienced with XEN Hypervisor and will like try local development. Ask on Beta program email alias to get access to them.

ec2ify:me 5 optional steps to parametrize instance

Based on my previous Linux on Amazon AWS experience I define 5 optional Solaris ec2ify steps:

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

ec2ify:ident 5 required steps to login into instance

Based on my previous Linux on Amazon AWS experience I define 5 required Solaris ec2ify steps:

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

Getting sense of ephemeral store behavior under OpenSolaris (UFS,ZFS)

To get impression of ephemeral store behavior under OpenSolaris (UFS,ZFS) I use bonnie++, compiled from source with debug output. Pre-compiled binary can be get from [www.sunfreeware.com SunFreeware]

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

I will skip file based tests and use large file pool test only with size configuration more then 2x of instance memory, because main purpose of test is evaluate “Amazon EC2 documented ephemeral storage feature fist access can be significantly slower “.

Will OpenSolaris 2008.05 instance survive reboot after update ?

New OpenSolaris 2008.05 utilize ZFS root and use ZFS clones for system updates with IPS net based repository, it’s counts on ability of reboot OS instance into new environment.

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Will OpenSolaris 2008.05 OS survive reboot after update ? Yes !!!

Porting Solaris to Amazon AWS (EC2,S3) – need for ec2ify scripts

We need scrips to support specific features of Amazon AWS (EC2,S3), yes, we need ec2ify our Solaris instances.

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Bellow I will demonstrate some ec2ify functionality, however main purpose of them is to demonstrate ec2ify process and issues, rather then make perfect suit all script(s).

I will create this ec2ify functionality:

• ec2ify/ident To be able access created Solaris instance on Amazon AWS, we need to add ability to load user SSH key-pair.
• ec2ify/me Optionally we can create simple instance parametrization and customizable on boot update / on shutdown backup functionality

Both ec2ify services will be created as Solaris SMF services so we can make they depend on other services, see more about Solaris SMF in Predictive Self-Healing – Bigadmin home of SMF

Note: This stuff will sit in /opt/ec2ify directory, SMF services will start with ec2ify name

Amazon AWS (EC2,S3) environment Overview

Amazon AWS represent Utility on demand , Pay as you go concepts, Amazon AWS is also known as Highly Scalable, developer oriented, Web Platform build on XEN hypervisor technology.

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

Popular Amazon AWS (EC2,S3) programming LIBraries

Amazon APIs used network based protocols so they consumers are highly portable and are implemented in most popular programing languages as rich full libraries. classes or modules.

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

Download & Run: WebSynergy – Demonstrating AMI update from ZIP on S3

In this type of AMI image use, I will send a control data in form of ZIP file to AMI on instance start which will download from S3 prepackaged and zipped application stack, this way we don’t need to rebuild AMI and we can update it on boot time.

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Inst&Conf: SGMJ (Solaris Glassfish MySQL Java) Stack

For now it is just JIT (Just Install software) Virtual Appliance, developers will post-configure it using DOCs

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Inst&Conf: Liferay 5.0 on Glassfish bundle DEMO

Installation of Liferay Glassfish bundle DEMO is easy and is identical to install of empty Glassfish.

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Creating OpenSolaris CLI JeOS RNJS by Uninstall

Note: Because in Amazon EC2 we can’t update Kernel and Ramdisk plus OpenSolaris store ZFS pool configuration in Ramdisk in form of ZFS cache you will not be able at least for now to upload your images. You need to use our preprepared JeOS image:

This entry is part of ‘OpenSolaris on Amazon EC2′ workshop

Determining OpenSolaris 200805 CLI JeOS RNJS configuration

Get list of PKGs for OpenSolaris 200805 CLI JeOS RNJS confguration , focusing on xVM or XEN para VM, so we can also skip all HW drivers, Hura !

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Installing OpenSolaris 2008.05 into xVM or XEN VM in PARA mode

Simple 12 steps for installing OpenSolaris 2008.05 into xVM or XEN VM in PARA mode, in

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

JeOS on OpenSolaris Indiana line

OpenSolaris 0508 (code name Indiana) is based on IPS and ZFS root. IPS as modern packaging system give use more freedom when creating JeOS. However this first OpenSolaris release is Desktop and GUI oriented system with Live CD based installation only, so we need to process needed CLI components selection manually.

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

For next OpenSolaris Indiana line releases CLI unattended installation with similar functionality to JumpStart functionality is planned.

We will try to build CLI JeOS in xVM based on OpenSolaris Indiana line in similar RNJS profile as we did for SXDE0108 Nevada Line.

Pre-build SXDE79 JeOS RNJS AMI images

For creating of PUBLIC AMIs I select Glassfish bundles, they don’t have absolutely latest version of Glassfish, but they are very easy to deploy and configure so they are ideal for Virtual Appliances as PoC (Proof-of-Concept) software.

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Freeware SW for OpenSolaris Nevada line

We will install this additional SW with optional packages form sunfreeware.com (Sol10x86 versions)

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Netboot install of OpenSolaris Nevada line

Now, lets install JeOS profile with Netboot install of OpenSolaris Nevada line

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

JeOS on OpenSolaris Nevada line

We will use OpenSolaris Nevada line based JumpStart install:

• profile – which define disk layout and clusters, packages definitions
• sysidcfg – which will define system parameters

Best is to use network JumpStart server, alternatively you can use CD-ROM install with just profile and sysidcfg files.

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

Creating OpenSolaris based JeOS

JeOS is targeted minimal OS installation and is stand from Just Enough OS for running concrete Application(s). There is no “One shoes will fit all” approaches with JeOS creations, each JeOS is ideally individually created to fit concrete applications, so please take JeOS creations tips bellow as a guidelines how to create your JeOS.

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

‘OpenSolaris on Amazon EC2′ Workshop

As part of Alliances with Global Partners program SUN announce OpenSolaris on Amazon EC2 Beta private program and SUN also announce http://www.mysql.com/news-and-events/press-release/release_2008_16.html”;> MySQL support for Amazon EC2 users

See also: Getting started with OpenSolaris on Amazon EC2 and Official EC2 blog

---

Bellow I try to summarize my Solaris on Amazon AWS (EC2 , S3) field experience reusing my Linux, Solaris , xVM / XEN theme related knowledge:

• Amazon AWS (EC2,S3) from developer view
• Amazon AWS (EC2,S3) environment Overview
• Amazon EC2 and S3
• Amazon EC2 Instance Types
• Amazon EC2 instances are purely dynamic in nature
• Amazon EC2 Ephemeral – no persistent store
• Amazon EC2 Instance boot process
• Amazon EC2 Steps towards persistence
• Amazon S3 for Amazon EC2 users
• Amazon AWS (EC2,S3) Known Issues
• Typical AMI image creation processes (Comming soon)
• Suggested AMI image creation for Solaris (Comming soon)
• Typical AMI image usage processes (Comming soon)
• Suggested AMI image usage for Solaris (Comming soon)
• Local xVM / XEN environment as main development tool
• Hands-on Experince: OpenSolaris on Amazon AWS (EC2 and S3)
• Creating OpenSolaris based JeOS

 

• JeOS on OpenSolaris Nevada line
• Netboot install of OpenSolaris Nevada line
• FreeWare SW for OpenSolaris Nevada line

 

• OpenSolaris 2008.05 released
• JeOS on OpenSolaris Indiana line
• Installing OpenSolaris 2008.05 into xVM or XEN VM in PARA mode
• Determining OpenSolaris 200805 CLI JeOS RNJS conf
• Creating OpenSolaris CLI JeOS RNJS by Uninstall
• Instalation of IPS freeware SW into OpenSolaris or
  Indiana
• ec2ify: Adding Amazon AWS (EC2,S3) features to your Solaris VM instance
• Porting Solaris to Amazon AWS (EC2,S3) – need for ec2ify scripts
• ec2ify:ident 5 required steps to login into instance
• ec2ify:me 5 optional steps to parametrize instance
• Pre-Prepared AMI images plus Inst&Conf hits
• Pre-build SXDE79 JeOS RNJS AMI images
• AMI Evaluation Image: Liferay on Glassfish bundle DEMO
• Inst&Conf: Liferay 5.0 on Glassfish bundle DEMO
• AMI Developer Image: Glassfish & MySQL bundle from Java EE
• Inst&Conf: SGMJ (Solaris Glassfish MySQL Java) Stack
• AMI Composite Image: Empty SXDE79 JeOS RNJS + S3 Glassfish V3 TP2 update
• Download & Run: WebSynergy – Demonstrating AMI update from ZIP on S3
• Pre-build OpenSolaris 2008.05 JeOS RNJS AMI images

• Get & Inst: Net based install of IPS packages into OpenSolaris 2008.05
• New IPS packaging system
  
• Prepare Boot Environment
  
• Check repository setup
  
• Install Glassfish and MySQL as packages selection
  
• Install WebStack AMP (Apache, MySQL, PHP) as cluster bundle
  
• Finalize Boot Environment
  
• Now, you are ready for (re)bundling
  

• Glassfish 2.1 App Server and MySQL 5.1 AMI on OpenSolaris 2008.11
• Specifics of OpenSolaris setup on Amazon EC2
• Create MySQL 5.1 AMI-752CCB1C instance and install there GF 2.1
• Install JDK6 from OpenSolaris release repo
• Install MySQL 5.1 and J Connector
• Glasshish 2.1 Install from JAR distribution and configure it as non-root user
• Glassfish 2.1 AMI Create Info Phase
• Glassfish 2.1 AMI Cleaning phase
• Glassfish 2.1 AMI Rebuilding process (From inside AMI)
• Glassfish 2.1 AMI User First Run Postconfiguration (Securing)
• Amazon AWS (EC2, S3) usefull tools and libs
• Popular Amazon AWS (EC2,S3) programming LIBraries
• GUI tools for Amazon AWS (EC2,S3) – Usefull Firefox Plugins

Encourage experimenting: Try & See in Amazon AWS (EC2, S3) enviroment

• Will OpenSolaris 2008.05 instance survive reboot after update ?
• Will OpenSolaris 2008.05 OS survive reboot after update ? Yes !!!
• Will OpenSolaris 2008.05 data disks survive reboot after update ? No ?! Fixed !!!
• Getting sence of ephemeral store behaviour under OpenSolaris (UFS,ZFS)
• m1.small disk perf on UFS (1 disk)
• m1.small disk perf on ZFS (1 disk)
• m1.large disk perf on ZFS mirror (2 disks)
• m1.xlarge disk perf on ZFS raidz (4 disks)
• Amazon EC2 OpenSolaris re-bundling process trouble shutting

Instalation of IPS freeware SW into OpenSolaris or Indiana

New SUN IPS packaging with network based repositories simplify installation of third-party SW to OpenSolaris or Indiana, you don’t need any more to deal with Companion CD or manual packages + dependencies download, install. Great !

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

OpenSolaris 2008.05 released, use os200805.iso in Virtual Environments

[http://www.sun.com/launch/ OpenSolaris 2008.05 released] , two distribution Live CD media are available:

os200805.iso	GZIP compression	Primary Languages
os200805g.iso	LZMA compression	All Languages

Install of GZIP based media os200805.iso is reported to be faster in Virtual Environments like xVM, VirtualBOX, Vmware or Paralles.

Note: You can add languages later from pkg.opensolaris.org network repository with pkg install

For example to add Czech language support install these packages:
pkg search -r -s | grep Czech
SUNWgnome-l10nmessages-cs      GNOME software message files for Czech
SUNWlang-cs                    Czech language support
pkg install SUNWlang-cs SUNWgnome-l10nmessages-cs

Hint: You can also try OpenSolaris 2008.05 on many platforms using just released SUN VirtualBox version 1.6

GUI tools for Amazon AWS (EC2,S3) – Usefull Firefox Plugins

This entry is part of ‘OpenSolaris on Amazon EC2′ Workshop

• Amazon EC2 – ElasticFox Main Page, ElasticFox Tutorial

• Amazon S3 – S3Fox Organizer downalod, s3Fox Organized Home & Docs