First we boot the standard Lenny system
[ 0.000000] Initializing cgroup subsys cpu
[...]
Debian GNU/Linux 5.0 lenny ttyS0
lenny login: root
Password:
Last login: Sat Apr 11 11:51:31 CEST 2009 on tty1
Linux lenny 2.6.26-1-686 #1 SMP Fri Mar 13 18:08:45 UTC 2009 i686
The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.
Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last was Sat 11 Apr 2009 11:52:02 AM CEST on ttyS0.
lenny:~# cat /etc/apt/sources.list
#
deb http://ftp.fr.debian.org/debian lenny main contrib
deb-src http://ftp.fr.debian.org/debian lenny main contrib
deb http://security.debian.org/ lenny/updates main contrib
deb-src http://security.debian.org/ lenny/updates main contrib
deb http://deb.openssi.org/alpha/openssi-lenny ./
deb-src http://deb.openssi.org/alpha/openssi-lenny ./
deb http://deb.openssi.org/alpha/openssi-lenny-extras ./
lenny:~# cat /etc/apt/preferences
Package: *
Pin: origin deb.openssi.org
Pin-Priority: 1001
lenny:~# cat /etc/apt/apt.conf.d/90auth
APT::Get::AllowUnauthenticated "true";
lenny:~# apt-get updateAnd do the initial install/remove stuff:
Hit http://ftp.fr.debian.org lenny Release.gpg
[...]
Hit http://ftp.fr.debian.org lenny/contrib Sources
Fetched 25.5kB in 1s (12.9kB/s)
lenny:~# apt-get install initrd-tools
The following packages were automatically installed and are no longer required:
libdns43 libisc44 perl-doc
Use 'apt-get autoremove' to remove them.
The following extra packages will be installed:
cramfsprogs dash sipcalc
The following NEW packages will be installed:
cramfsprogs dash initrd-tools sipcalc
0 upgraded, 4 newly installed, 0 to remove and 26 not upgraded.
Need to get 184kB of archives.
After this operation, 561kB of additional disk space will be used.
Do you want to continue [Y/n]?
WARNING: The following packages cannot be authenticated!
dash cramfsprogs sipcalc initrd-tools
Authentication warning overridden.
Get:1 http://ftp.fr.debian.org lenny/main dash 0.5.4-12 [93.0kB]
Get:2 http://deb.openssi.org ./ initrd-tools 0.1.84.2.ssi4 [38.4kB]
Get:3 http://ftp.fr.debian.org lenny/main cramfsprogs 1.1-6 [21.3kB]
Get:4 http://ftp.fr.debian.org lenny/main sipcalc 1.1.4-2 [31.0kB]
Fetched 184kB in 1s (92.4kB/s)
Preconfiguring packages ...
Selecting previously deselected package dash.
(Reading database ... 16379 files and directories currently installed.)
[...]
Setting up initrd-tools (0.1.84.2.ssi4) ...
update-rc.d: warning: /etc/init.d/initrd-tools.sh missing LSB information
update-rc.d: see <http://wiki.debian.org/LSBInitScripts>
lenny:~# apt-get remove nfs-common
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
libnfsidmap2 libdns43 libevent1 ucf libisc44 perl-doc portmap
Use 'apt-get autoremove' to remove them.
The following packages will be REMOVED:
nfs-common
0 upgraded, 0 newly installed, 1 to remove and 25 not upgraded.
After this operation, 434kB disk space will be freed.
Do you want to continue [Y/n]? y
(Reading database ... 16429 files and directories currently installed.)
Removing nfs-common ...
Stopping NFS common utilities: statd.
Processing triggers for man-db ...
lenny:~# apt-get remove libc6-amd64
Reading package lists... Done
Building dependency tree
Reading state information... Done
Package libc6-amd64 is not installed, so not removed
The following packages were automatically installed and are no longer required:
libnfsidmap2 libdns43 libevent1 ucf libisc44 perl-doc portmap
Use 'apt-get autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 25 not upgraded.
lenny:~# apt-get install openbsd-inetd
Reading package lists... Done
Building dependency tree
Reading state information... Done
openbsd-inetd is already the newest version.
The following packages were automatically installed and are no longer required:
libnfsidmap2 libdns43 libevent1 ucf libisc44 perl-doc portmap
Use 'apt-get autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 25 not upgraded.
lenny:~# modprobe loop
lenny:~# modprobe ext2
lenny:~# apt-get dist-upgrade
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
The following packages will be REMOVED:
initramfs-tools linux-image-2.6-686 linux-image-2.6.26-1-686
The following NEW packages will be installed:
libcluster
The following packages will be upgraded:
bsdutils libc6 libc6-dev libc6-i686 locales mount util-linux
The following packages will be DOWNGRADED:
dpkg dselect e2fslibs e2fsprogs grub initscripts libblkid1 libcomerr2 libss2
libuuid1 logrotate portmap procps strace sysv-rc sysvinit sysvinit-utils
udev
7 upgraded, 1 newly installed, 18 downgraded, 3 to remove and 0 not upgraded.
Need to get 19.7MB of archives.
After this operation, 60.1MB disk space will be freed.
Do you want to continue [Y/n]? y
WARNING: The following packages cannot be authenticated!
dpkg libc6-dev libc6 libc6-i686 libcluster e2fslibs e2fsprogs mount sysvinit
util-linux bsdutils initscripts sysvinit-utils libblkid1 libcomerr2 libss2
libuuid1 portmap sysv-rc logrotate procps locales strace dselect grub udev
Authentication warning overridden.
Get:1 http://deb.openssi.org ./ dpkg 1.14.22.ssi1 [2294kB]
Get:2 http://deb.openssi.org ./ libc6-dev 2.7-12-ssi3 [3392kB]
[...]
Get:26 http://deb.openssi.org ./ udev 0.080-1 [265kB]
Fetched 19.7MB in 1min25s (229kB/s)
Preconfiguring packages ...
(Reading database ... 16388 files and directories currently installed.)
Removing linux-image-2.6-686 ...
Removing linux-image-2.6.26-1-686 ...
Ok, proceeding with removing running kernel image.
Running postrm hook script /sbin/update-grub.
Searching for GRUB installation directory ... found: /boot/grub
Searching for default file ... found: /boot/grub/default
Testing for an existing GRUB menu.lst file ... found: /boot/grub/menu.lst
Searching for splash image ... none found, skipping ...
grep: /boot/config*: No such file or directory
Updating /boot/grub/menu.lst ... done
[...]
dpkg - warning: downgrading dpkg from 1.14.25 to 1.14.22.ssi1.
(Reading database ... 13792 files and directories currently installed.)
[...]
Setting up portmap (5-9.ssi2) ...
Installing new version of config file /etc/init.d/portmap ...
Configuration file `/etc/default/portmap'
==> File on system created by you or by a script.
==> File also in package provided by package maintainer.
What would you like to do about it ? Your options are:
Y or I : install the package maintainer's version
N or O : keep your currently-installed version
D : show the differences between the versions
Z : background this pocess to examine the situation
The default action is to keep your current version.
*** portmap (Y/I/N/O/D/Z) [default=N] ? I
Installing new version of config file /etc/default/portmap ...
[...]
Setting up udev (0.080-1) ...
Installing new version of config file /etc/init.d/udev-mtab ...
Installing new version of config file /etc/init.d/udev ...
Installing new version of config file /etc/modprobe.d/pnp-hotplug ...
Installing new version of config file /etc/modprobe.d/display_class ...
Installing new version of config file /etc/udev/udev.conf ...
Installing new version of config file /etc/udev/links.conf ...
lenny:~# dpkg -l udev
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Cfg-files/Unpacked/Failed-cfg/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
||/ Name Version Description
+++-==============-==============-============================================
ii udev 0.080-1 /dev/ and hotplug management daemon
lenny:~# ls /etc/udev/rules.d
50-udev.rules 70-persistent-net.rules
60-persistent-input.rules 75-cd-aliases-generator.rules
60-persistent-storage.rules 75-persistent-net-generator.rules
60-persistent-storage-tape.rules 80-drivers.rules
60-persistent-v4l.rules 91-permissions.rules
70-persistent-cd.rules 95-late.rules
lenny:~# rm /etc/udev/rules.d/*
lenny:~# bash -c 'source /var/lib/dpkg/info/udev.postinst abort-deconfigure; create_rules_symlink'
lenny:~# ls -l /etc/udev/rules.d
total 0
lrwxrwxrwx 1 root root 20 2009-04-11 12:25 020_permissions.rules -> ../permissions.rules
lrwxrwxrwx 1 root root 19 2009-04-11 12:25 cd-aliases.rules -> ../cd-aliases.rules
lrwxrwxrwx 1 root root 13 2009-04-11 12:25 udev.rules -> ../udev.rules
lrwxrwxrwx 1 root root 19 2009-04-11 12:25 z20_persistent.rules -> ../persistent.rules
lrwxrwxrwx 1 root root 12 2009-04-11 12:25 z50_run.rules -> ../run.rules
lrwxrwxrwx 1 root root 16 2009-04-11 12:25 z55_hotplug.rules -> ../hotplug.rules
lrwxrwxrwx 1 root root 17 2009-04-11 12:25 z70_hotplugd.rules -> ../hotplugd.rules
lenny:~# cat /etc/mkinitrd/modules
#
# This file should contain the names of kernel modules and their arguments
# (if any) that are needed to mount the root file system, one per line.
# Comments begin with a `#', and everything on the line after them are ignored.
#
# You must run mkinitrd(8) to effect this change.
#
# Examples:
#
# ext2
# wd io=0x300
ne2k_pci
lenny:~# ifconfig eth1 192.168.64.1 netmask 255.255.255 up
lenny:~# apt-get install openssiOk, we've installed OpenSSI, now reboot:
Reading package lists... Done
Building dependency tree...
Reading state information... Done
The following packages were automatically installed and are no longer required:
libnfsidmap2 libdns43 libevent1 libisc44 perl-doc portmap
Use 'apt-get autoremove' to remove them.
The following extra packages will be installed:
atftpd cluster-tools dhcp3-server dosfstools iproute ipvsadm libatm1
[...]
Suggested packages:
dhcp3-server-ldap iproute-doc heartbeat keepalived ldirectord
[...]
The following NEW packages will be installed:
atftpd cluster-tools dhcp3-server dosfstools iproute ipvsadm libatm1
[...]
0 upgraded, 34 newly installed, 0 to remove and 0 not upgraded.
Need to get 18.5MB of archives.
After this operation, 55.6MB of additional disk space will be used.
Do you want to continue [Y/n]? y
WARNING: The following packages cannot be authenticated!
linux-image-2.6.12-ssi-686-smp iproute cluster-tools dhcp3-server dosfstools
[...]
Authentication warning overridden.
Get:1 http://ftp.fr.debian.org lenny/main iproute 20080725-2 [363kB]
...
Get:34 http://deb.openssi.org ./ openssi 1.9.4-9 [24.0kB]
Fetched 18.5MB in 1min26s (215kB/s)
Extracting templates from packages: 100%
Selecting previously deselected package linux-image-2.6.12-ssi-686-smp.
(Reading database ... 13819 files and directories currently installed.)
Unpacking linux-image-2.6.12-ssi-686-smp (from .../linux-image-2.6.12-ssi-686-smp_1.9.6-9_i386.deb) ...
Done.
[...]
Unpacking linux-ssi-image-2.6-686-smp (from .../linux-ssi-image-2.6-686-smp_102.ssi3_i386.deb) ...
This command requires a CI/OpenSSI kernel.
Welcome to OpenSSI clustering!
Let's configure the first node in your cluster.
Enter a node number (1-125) or (?) [1]: 1
Select a network interface for the cluster interconnect.
Name IP address Netmask Hardware address
---- ---------- ------- ----------------
1) eth0 10.0.2.15 255.255.255.0 52:54:00:12:01:02
2) eth1 192.168.64.1 255.255.255.0 52:54:00:12:01:00
3) eth2 10.0.3.50 255.255.255.0 52:54:00:12:01:04
Select (1-3), (R)escan or (?) [1]: 2
Select (P)XE, (E)therboot or (?) [E]: P
Enter a clustername or (?): openssi-lenny
Do you want to enable root failover (y/n/?) [n]: y
The following configuration has been entered:
Node number: 1
NIC for interconnect: eth1
IP address: 192.168.64.1
Network hardware addr: 52:54:00:12:01:00
Network boot protocol: PXE
Local boot device: UUID="967228e7-bdef-44cb-9f63-dd3d6dbd8e6c"
Clustername: openssi-lenny
Root failover: Yes
Potential initnode: Yes
NFS support: yes
(W)rite new configuration or (R)econfigure [W]: w
Making /cluster/nodetemplate for ssi-addnode
[...]
Fixing /etc/fstab file...
Initialization of node 1 completed.
For adding other nodes to your OpenSSI cluster, please use
the ssi-addnode command.
For more information about your new cluster, please read
/usr/share/doc/openssi/Introduction-to-SSI.
Selecting previously deselected package mknbi.
Unpacking mknbi (from .../mknbi_1.4.4-1.1_i386.deb) ...
Adding `diversion of /usr/bin/mknbi-linux to /usr/bin/mknbi-linux.netboot by mknbi'
[...]
Setting up linux-image-2.6.12-ssi-686-smp (1.9.6-9) ...
Hmm. There is a symbolic link /lib/modules/2.6.12-ssi-686-smp/build
However, I can not read it: No such file or directory
Therefore, I am deleting /lib/modules/2.6.12-ssi-686-smp/build
Hmm. The package shipped with a symbolic link /lib/modules/2.6.12-ssi-686-smp/source
However, I can not read the target: No such file or directory
Therefore, I am deleting /lib/modules/2.6.12-ssi-686-smp/source
Running depmod.
Finding valid ramdisk creators.
Using mkinitrd to build the ramdisk.
[...]
Updating /boot/grub/menu.lst ... done
Examining /etc/kernel/postinst.d.
Setting up iproute (20080725-2) ...
Setting up cluster-tools (1.9.6-0) ...
Setting up dhcp3-server (3.1.1-6) ...
Configuration file `/etc/dhcp3/dhcpd.conf'
==> File on system created by you or by a script.
==> File also in package provided by package maintainer.
What would you like to do about it ? Your options are:
Y or I : install the package maintainer's version
N or O : keep your currently-installed version
D : show the differences between the versions
Z : background this process to examine the situation
The default action is to keep your current version.
*** dhcpd.conf (Y/I/N/O/D/Z) [default=N] ? i
Installing new version of config file /etc/dhcp3/dhcpd.conf ...
Generating /etc/default/dhcp3-server...
Starting DHCP server: dhcpd3check syslog for diagnostics. failed!
failed!
invoke-rc.d: initscript dhcp3-server, action "start" failed.
Setting up dosfstools (3.0.1-1) ...
...
Removing any system startup links for /etc/init.d/drbd ...
lenny:~# init 6Now we're running our first (1 node) OpenSSI system:
lenny:~# INIT: Switching to runlevel: 6
INIT: Sending processes the TERM signal
Stopping periodic command scheduler: crond.
Stopping internet superserver: inetd.
Saving the system clock.
...
Will now restart.
[ 4022.910017] Restarting system.
[ 4022.910320] machine restart
Linux version 2.6.12-ssi-686-smp (john@a.olympic) (gcc version 3.4.6 (Debian 3.4.6-8)) #1 SMP Wed Mar 11 14:18:45 CET 2009Set up the dhcpd.proto file and make a new dhcpd.conf, then restart dhcp3-server:
...
Gathering cluster info
Configuring eth1: 192.168.64.1/255.255.255.0
Configuring cluster
Running pre-root cluster initialization
This is a CI/OpenSSI kernel.
This Cluster Node: 1
Potential Initnode(s): 1:192.168.64.1
Name server registered with clms
[...]
INIT: Cluster formed: 1
INIT: Entering runlevel: 2
[...]
Debian GNU/Linux 5.0 lenny ttyS0
lenny login: root
Password:
Last login: Sat Apr 11 11:52:05 CEST 2009 on ttyS0
Linux lenny 2.6.12-ssi-686-smp #1 SMP Wed Mar 11 14:18:45 CET 2009 i686
The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.
Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
2 failures since last login.
Last was Sat 11 Apr 2009 12:53:57 PM CEST on tty1.
lenny:~# cat /etc/dhcp3/dhcpd.protoNow make sure that /tftpboot and /var/lib/tftpboot are linked:
next-server 192.168.64.1;
lenny:~# mkhcpd.conf
lenny:~# cat /etc/dhcp3/dhcpd.conf
# /etc/dhcp3/dhcpd.conf
#
# Do _not_ edit this file!! It was automatically generated by mkdhcpd.conf.
#
# Section 1 (from /etc/dhcp3/dhcpd.proto)
next-server 192.168.64.1;
# Section 2 (from /etc/clustertab)
subnet 192.168.64.0 netmask 255.255.255.0 {
if substring (option vendor-class-identifier, 0, 9) = "Etherboot" {
filename "/combined";
} else {
filename "/pxelinux.0";
}
host node1 {
hardware ethernet 52:54:00:12:01:00;
fixed-address 192.168.64.1;
}
}
lenny:~# invoke-rc.d dhcp3-server restart
Stopping DHCP server: dhcpd3 failed!
Starting DHCP server: dhcpd3.
lenny:~# ls -l /var/lib/tftpboot/Boot the second node into etherboot and use ssi-addnode to add it to the cluster:
total 0
lenny:~# mv /var/lib/tftpboot/ /var/lib/tftpboot.old
lenny:~# ln -s /tftpboot/ /var/lib/
lenny:~# ls /var/lib/tftpboot
combined initrd kernel pxelinux.0 pxelinux.cfg
lenny:~# ssi-addnodeOn the second node make a filesystem for it's boot partition and use the ssi-chnode command to initialise it:
This configuration tool can either use verbose prompts that
give you extra information about what it is doing, or it can
just ask the necessary questions. Experienced OpenSSI users
might prefer the latter option.
Even if you choose not to use verbose prompts, you can
select '?' at any prompt to get extra information.
Do you want verbose prompts (y/n) [y]: y
Every node in the cluster must have a unique node number.
The first node is usually 1, although you might want to
choose another number for a reason such as where the machine
is physically located.
Enter a node number (2-125) or (?) [2]: 2
Select the hardware address of the new node's cluster
interconnect NIC.
The list shows all unknown hardware addresses that have
recently probed the cluster's DHCP server. Choose the one
that is displayed on the console of the new node when it
attempts to network boot. If the desired NIC is not listed,
make sure the node has attempted to network boot on the
cluster interconnect, then select (R)escan.
Hardware address Time last probed
---------------- ----------------
1) 52:54:00:12:02:00 Apr 11 13:01:41
Select (1), (r)escan, (q)uit or (?) [1]: 1
Enter an IP address for the NIC.
The IP address must be unique and it must be on the same
subnet as the cluster interconnect NICs for the other
nodes. If you want, this program can scan the subnet for
IP addresses that seem to be available. It does this by
pinging every address in the subnet, which can take awhile
for larger subnets. You can safely skip this feature if you
know one or more available IP addresses.
Do you want to scan for available IP addresses (y/n/?) [n]: n
Enter an IP address or (?): 192.168.64.2
Select (P)XE or (E)therboot as the network boot protocol for
this node. PXE is an Intel standard for network booting, and
many professional grade NICs have a PXE implementation pre-
installed on them. You can probably enable PXE with your BIOS
configuration tool. If you do not have a NIC with PXE, you can
make use of open-source project Etherboot, which lets you generate
a floppy or ROM image for a variety of different NICs.
Select (P)XE, (E)therboot or (?) [E]: P
The nodename should be unique in the cluster and it should
resolve to one of this node's IP addresses, so that client
NFS can work correctly. The nodename can resolve to either
the IP address you configured above for the interconnect,
or to one of external IP addresses that you might configure
below. The nodename can resolve to the IP address either in
DNS or in the cluster's /etc/hosts file.
The nodename is stored in /etc/nodename, which is a context-
dependent symlink (CDSL). In this case, the context is node
number, which means each node you add will have it's own view
of /etc/nodename containing its own hostname. To learn more
about CDSLs, please see /usr/share/doc/openssi/cdsl.
Enter a nodename or (?): lenny-node2
Do you want this node to be a root failover node? It _must_
have access to the root filesystem on a shared disk in order
to answer yes. If you answer yes, then this node can boot
first as a root node, so you should configure it with a local
boot device. This is done after this node joins the cluster
and is described in the installation instructions.
Enable root filesystem failover to this node (y/n/?) [n]: y
Please make sure that the interface with MAC address 52:54:00:12:02:00
is not configured via /etc/network/interfaces
Press Enter to acknowledge:
The following configuration has been entered:
Node number: 2
IP address: 192.168.64.2
Network hardware addr: 52:54:00:12:02:00
Network boot protocol: PXE
Local boot device: none
Nodename: lenny-node2
Potential initnode: Yes
(W)rite new configuration, (R)econfigure, or (Q)uit without writing [W]: w
Creating /cluster/node2
Node 2 is a master for failover
Remember to configure a boot device
The configuration changes have been saved.
Rebuilding the boot materials
/tmp/initrd.FZSWUC: 69.3%
Synchronizing network boot images: succeeded
Stopping DHCP server: dhcpd3.
Starting DHCP server: dhcpd3.
Synchronizing local boot devices
syncing UUID="967228e7-bdef-44cb-9f63-dd3d6dbd8e6c" on node 1: succeeded
All new nodes are allowed to join the cluster. If you wish to setup a
local boot device for a node, wait until it's fully up, create a Linux
filesystem on one of its local disks using fdisk and mkfs, then run
ssi-chnode to configure the filesystem as a local boot device.
lenny:~# nm_add_node: Node 2 added
INIT: +++ nodeup completed on node 2
lenny:~# cluster -v
1: UP
2: UP
lenny:~# onnode 2 /bin/shNow we can reboot the second node, allowing it to start from it's own boot disk instead of the etherboot:
lenny-node2:~# mkfs -t ext3 /dev/hda1
mke2fs 1.40-WIP (14-Nov-2006)
Filesystem label=
OS type: Linux
Block size=1024 (log=0)
Fragment size=1024 (log=0)
126976 inodes, 506016 blocks
25300 blocks (5.00%) reserved for the super user
First data block=1
Maximum filesystem blocks=67633152
62 block groups
8192 blocks per group, 8192 fragments per group
2048 inodes per group
Superblock backups stored on blocks:
8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409
Writing inode tables: done
Creating journal (8192 blocks): done
Writing superblocks and filesystem accounting information: done
This filesystem will be automatically checked every 28 mounts or
180 days, whichever comes first. Use tune2fs -c or -i to override.
lenny-node2:~# ssi-chnode
Select a node number (1,2) [1]: 2
Select (P)XE, (E)therboot or (?) [P]: P
Enter a new boot device: /dev/hda1
The following configuration has been entered:
Node number: 2
IP address: 192.168.64.2
Network hardware addr: 52:54:00:12:02:00
Network boot protocol: PXE
Local boot device: UUID="ea073072-54be-4b60-9fcf-88a871c69fdc"
Potential initnode: Yes
(W)rite new configuration, (R)econfigure, or (Q)uit without writing [W]:
The configuration changes have been saved.
Do you wish to configure another node (y/n) [n]:
Rebuilding the boot materials
/tmp/initrd.OzHutZ: 69.3%
Synchronizing network boot images: succeeded
Stopping DHCP server: dhcpd3.
Starting DHCP server: dhcpd3.
Synchronizing local boot devices
syncing UUID="967228e7-bdef-44cb-9f63-dd3d6dbd8e6c" on node 1: succeeded
syncing UUID="ea073072-54be-4b60-9fcf-88a871c69fdc" on node 2: succeeded
Node 2 has been updated.
lenny-node2:~# clusternode_shutdown -h -N 2 now
Broadcast message from root@lenny (1/ttyS0) (Sat Apr 11 13:13:40 2009):
Node 2 is going down for system halt NOW!
INIT: Sending processes the TERM signal
lenny-node2:~#
[1]+ Stopped onnode -p 2 /bin/sh
Node 2 has gone down!!!
lenny:~# /etc/init.d/rc.nodedown 2 running
fsck 1.40-WIP (14-Nov-2006)
INIT: +++ nodedown completed on node 2
lenny:~# cluster -v
1: UP
2: DOWN
lenny:~# nm_add_node: Node 2 added
INIT: +++ nodeup completed on node 2
lenny:~# cluster -v
1: UP
2: UP
lenny:~#