PowerPoint - Computer Sciences Dept.

DEPLOYING CONDOR USING
VIRTUALBOXВ® ON WINDOWSВ® HOSTS
David Herzfeld1, Craig A. Struble, Ph.D2, and Lars E. Olson, Ph.D1
Marquette University
1Department
2Department
of Biomedical Engineering
of Mathematics, Statistics, and Computer Science
Southeast Wisconsin High Performance (SeWHiP) Computing
Consortium (www.sewhip.org)
1/19
INTRODUCTION
п‚ў Most
systems on Marquette’s campus run
Windows XPВ® or Windows VistaВ®
п‚ў Most researchers at Marquette require Linux
based environments
п‚ў Most sys-admins have primarily WindowsВ®
based experience
2
Tuesday, Apr. 21, 2009
2/19
PROJECT GOALS
п‚ў Allow
researchers to use underutilized
Marquette systems
п‚—
Requires Linux environment
п‚ў Allow
researchers full use of the Condor
system
п‚—
check pointing, migration, etc.
п‚ў Do
not change Windows® users’ experience
п‚ў Easy installation and maintenance for
WindowsВ® sys-admins
3
Tuesday, Apr. 21, 2009
3/19
POSSIBLE SOLUTIONS
п‚ў Use
п‚—
п‚—
Condor for WindowsВ®
Very few researchers using WindowsВ® based
applications
Most require a GUI
п‚ў WindowsВ®
п‚—
п‚—
Management is difficult
WindowsВ® users will be affected
п‚ў Condor
п‚—
п‚—
п‚—
– Linux dual boot systems
Virtual Universe
VMwareВ® = $
Xen does not support WindowsВ® hosts
Configuration Overhead
п‚ў Virtualization
4
Tuesday, Apr. 21, 2009
4/19
INITIAL SOLUTION: COLINUX
Based on previous work by Neeman, Serverini (U. of
Oklahoma), and Sumanth (Nebraska-Lincoln), 2006
п‚ў Runs natively in WindowsВ®
п‚ў
п‚—
Near native performance
Small hardware dependencies
п‚ў Open source
× Relatively unsupported – small community
Г— Only supports 32 bit environments
Г— No current SMP support
Г— Few recent developments
п‚ў
5
Tuesday, Apr. 21, 2009
5/19
CURRENT SOLUTION: SUN VIRTUALBOXВ®
Free & “Open Source”
п‚ў Capable or running under 32 & 64 bit WindowsВ®
п‚ў Guest Additions allow for near native speeds
п‚ў
п‚—
Some disk intensive operations may see a speed up
Supported & continually developed
п‚ў Large community support
Г— No current SMP support
п‚ў
п‚—
planned for future release
6
Tuesday, Apr. 21, 2009
6/19
VIRTUALBOXВ® & WINDOWSВ®
7
Tuesday, Apr. 21, 2009
7/19
CONDORMAC & COMON
п‚ў
CondorMAC:
Allows for distribution via images
п‚— Replaces the VirtualBoxВ® MAC address with a modification
of the host MAC address
п‚—
п‚ў
CoMon:
п‚—
п‚—
п‚—
п‚—
п‚—
Determine sec. since last key stroke
Determine total processor utilization
Determine VirtualBoxВ® processor utilization
Write data to file in host-guest shared folder
Visual Basic monitor service
8
Tuesday, Apr. 21, 2009
8/19
HCLUST_SERVICE
п‚ў Fork
headless VirtualBoxВ® machine at
WindowsВ® startup.
 Remove any VirtualBox® “remnant” machines
 “Nicely” shut down guest system when
requested (via ACPI)
9
Tuesday, Apr. 21, 2009
9/19
CONDOR VIRTUAL MACHINE
10
Tuesday, Apr. 21, 2009
10/19
VIRTUAL MACHINE BASICS
Guest hostname is based on assigned IP address
п‚ў Central Manager name & IP are determined
п‚ў
Personalized text file in shared folder
п‚— Variables replaced in condor_config.local
п‚—
п‚ў
For remote administration
п‚—
п‚ў
ssh key in shared folder
Condor launches after guest startup
п‚—
init.d script
11
Tuesday, Apr. 21, 2009
11/19
BENEFITS OF IMMUTABLE HARD DRIVES
Defines an upper limit on the amount of space Condor
users can utilize (100 GB).
 Removal of the snapshots – by hclust_service – returns
the VM to an original state.
п‚ў Returns unused hard drive space back to the
WindowsВ® host.
п‚ў
п‚—
This space would not be returned if it were simply a
dynamically expanding .vdi image
12
Tuesday, Apr. 21, 2009
12/19
CONDOR VIRTUAL MACHINE
13
Tuesday, Apr. 21, 2009
13/19
VM ADDITIONS
п‚ў Additions
included in immutable hard drive
п‚ў Software packages utilized by researchers
п‚—
Geant, OpenFOAM, AutoDock, etc.
п‚ў Sets
up execution path for use in Condor jobs
п‚ў Package names and versions added to Condor
ClassAds
14
Tuesday, Apr. 21, 2009
14/19
INSTALLATION
Distributed as a zip file, batch installer
п‚ў Installs VirtualBoxВ®
п‚ў Creates a new virtual machine
п‚ў
п‚—
п‚—
п‚—
MAC Address set by CondorMAC
Memory computed as fraction of total system memory
Bridged networking set up
Adds CentOS image to virtual machine
п‚ў Sets services to run at system startup
п‚ў Starts the new VM
п‚ў Installation time is minutes
п‚ў
15
Tuesday, Apr. 21, 2009
15/19
VIRTUALIZATION ISSUES
п‚ў Networking
Problems
Current bridged connection requires an additional
IP address for each worker
п‚— Doubles the on campus IP addresses!
п‚—
16
Tuesday, Apr. 21, 2009
16/19
FUTURE WORK
п‚ў SMP
Support
п‚ў Support for different networking modes
п‚—
using NAT, OpenVPN, etc.
п‚ў Specific
VM updates via repositories
п‚ў Tailored distributions
Bioinformatics
п‚— Fluid Dynamics
п‚— Neural Simulations
п‚—
17
Tuesday, Apr. 21, 2009
17/19
ACKNOWLELDGMENTS
Information Technology Services; Marquette
University
п‚— Kathy Lang; CIO, Clifford Brown, Patrick Blume,
Aaron Gember, Chad Gorectke
п‚ў Lingtao Zeng; Marquette MSCS System
Administrator
п‚ў Brad Bonczkiewicz; Marquette Engineering System
Administrator
п‚ў Biomedical Engineering Department
п‚ў Mathematics, Statistics and Computer Science
Department
п‚ў
Tuesday, Apr. 21, 2009
18/19
18
QUESTIONS/COMMENTS?
Thank you!
19/19