An example of EDAC messages in the dmesg:

EDAC MC0: CE row 0, channel 1, label "": (Branch=0 DRAM-Bank=6 RDWR=Read RAS=16075 CAS=2974, CE Err=0x2000 (Correctable Non-Mirrored Demand Data ECC))
EDAC MC0: CE row 0, channel 1, label "": (Branch=0 DRAM-Bank=0 RDWR=Read RAS=7233 CAS=6, CE Err=0x2000 (Correctable Non-Mirrored Demand Data ECC))
EDAC MC0: CE row 0, channel 1, label "": (Branch=0 DRAM-Bank=0 RDWR=Read RAS=7233 CAS=6, CE Err=0x2000 (Correctable Non-Mirrored Demand Data ECC))
EDAC MC0: CE row 0, channel 1, label "": (Branch=0 DRAM-Bank=5 RDWR=Read RAS=12666 CAS=2968, CE Err=0x2000 (Correctable Non-Mirrored Demand Data ECC))
EDAC MC0: CE row 0, channel 1, label "": (Branch=0 DRAM-Bank=0 RDWR=Read RAS=7233 CAS=6, CE Err=0x2000 (Correctable Non-Mirrored Demand Data ECC))
EDAC MC0: CE row 0, channel 1, label "": (Branch=0 DRAM-Bank=1 RDWR=Read RAS=3174 CAS=4, CE Err=0x2000 (Correctable Non-Mirrored Demand Data ECC))

I just want to completely disable EDAC on this system but disabling the kernel modules. The procedure to turn it off should be the same for all RHEL6.x derived distributions and more or less the same for all Linux 2.6/3 based systems.

Some of the EDAC code is platform specific so there will be a ‘core’ module and some platform specific bits. In this case, i5000_edac is the module specific to my platform.

# lsmod | grep -i edac
i5000_edac              8867  0
edac_core              46773  3 i5000_edac

And now we just need to blacklist the loading of those modules.

[root@archdbn1 ~]# cat > /etc/modprobe.d/edac.conf < blacklist i5000_edac
> blacklist edac_core
> END

Reboot the system and then verify that the EDAC kernel modules are not loading and that there are no message in the system dmesg.

# lsmod | grep -i edac
# dmesg | grep -i edac

First use mmlsfs to find the block device name for the filesystem.

# mmlsfs all

File system attributes for /dev/foo:
=========================================
flag                value                    description
------------------- ------------------------ -----------------------------------
 -f                 131072                   Minimum fragment size in bytes
 -i                 512                      Inode size in bytes
 -I                 32768                    Indirect block size in bytes
 -m                 1                        Default number of metadata replicas
 -M                 2                        Maximum number of metadata replicas
 -r                 1                        Default number of data replicas
 -R                 2                        Maximum number of data replicas
 -j                 cluster                  Block allocation type
 -D                 nfs4                     File locking semantics in effect
 -k                 all                      ACL semantics in effect
 -n                 32                       Estimated number of nodes that will mount file system
 -B                 4194304                  Block size
 -Q                 none                     Quotas enforced
                    none                     Default quotas enabled
 --filesetdf        No                       Fileset df enabled?
 -V                 12.10 (3.4.0.7)          File system version
 --create-time      Wed Feb  8 18:34:14 2012 File system creation time
 -u                 Yes                      Support for large LUNs?
 -z                 No                       Is DMAPI enabled?
 -L                 4194304                  Logfile size
 -E                 Yes                      Exact mtime mount option
 -S                 No                       Suppress atime mount option
 -K                 whenpossible             Strict replica allocation option
 --fastea           Yes                      Fast external attributes enabled?
 --inode-limit      18300928                 Maximum number of inodes
 -P                 system                   Disk storage pools in file system
 -d                 nsd1;nsd2                Disks in file system
 -A                 yes                      Automatic mount option
 -o                 none                     Additional mount options
 -T                 /gpfs/bar                Default mount point
 --mount-priority   0                        Mount priority

Before attempting to modify the filesystem, you need to make sure that it unmounted on the cluster.

# mmumount /gpfs/bar -a
Wed Apr  4 17:50:07 MST 2012: mmumount: Unmounting file systems ...

The mount point can be modified with themmchfs command.

# mmchfs /dev/foo -T /net/bar
mmchfs: Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.

Then remount the filesystem on it’s new mountpoint.

# mmmount /net/bar -a
Wed Apr  4 17:51:57 MST 2012: mmmount: Mounting file systems ...

IMHO – Fake RAID has no place in a sever environment as it does nothing for you that the tools included in virtually ever modern OS provide. It’s actually a step backwards in that it’s an extra setup step in provisioning that will be different not only for every hardware vendor but between different models. Once upon a time Fake RAID may have had a place the desktop but the basic BIOS ability to support a sequential list of boot devices makes it useless there as well. I do use software RAID1 on a great number of server and desktop systems and it’s nice to be able to use the same kickstart script across all classes of hardware.

On the S5520 series of boards, I’ve also encountered some strangeness with the AHCI ROM doing things like hanging the boot process infinitely if it doesn’t like partition table. After testing this under many different firmware revisions and after a failed attempt to get Intel to acknowledge it as a bug, I just set the SATA controller to ENHANCED mode and go on with life. Skipping this option ROM actually shorten the boot time on a motherboard that probably holds the crown for the longest x86 BIOS boot process (something to do with it’s dual UEFI/BIOSness?).

And here be dragons. If you change the SATA mode to ENHANCED or COMPATIBILITY after the RAID status screen vanishes from the boot process. However, if a fake raid set had already been created it does not go away. In disbelief, I’ve gone as far as physically pulling the drives from the system and zeroing them out with dd. The fake raid keeps coming back like it’s a T1000. The fix is to reenable the SATA SW RAID mode and clear out the entire configuration and, then change the SATA mode back again.

This is the menu option to completely dump the config:

This is what a system with two SATA disks and no Embedded RAID configuration looks like:

This was a “proof of concept” I did a few weeks ago to see if the florescence would be bright enough to capture in a camera. The exposure was completely hand held (w/ IS) from a distance of ~2′ @ 1/10s, F/2.8, 55mm, ISO1600. The scorpion was on the order of 2-3″ in length and was partially hiding under the stuco in front of my garage door along the side of the house. The effect was bright enough that he was visible from ~10′ away with a well dark adapter mark I eye ball. If you look closely in the image you can see light from the scorpion reflecting off of the base of the garage door.

In this example, the node that has been reprovisioned from scratch is “dec06″.

As far as the rest of the cluster is conerned, that node is in a nonsensical state:

[root@dec01 ~]# mmgetstate -N dec06

 Node number  Node name        GPFS state
------------------------------------------
       6      dec06            unknown

It can not be deleted from the cluster:

root@dec01 ~]# mmdelnode -N dec06
Verifying GPFS is stopped on all affected nodes ...
dec06.tuc.noao.edu:  mmremote: Unknown GPFS execution environment
mmdelnode: Command failed.  Examine previous error messages to determine cause.

Nor can GPFS be started on it:

[root@dec01 ~]# mmstartup -N dec06
Fri Mar 30 16:27:29 MST 2012: mmstartup: Starting GPFS ...
dec06.tuc.noao.edu:  mmremote: Unknown GPFS execution environment
mmstartup: Command failed.  Examine previous error messages to determine cause.

The solution lives in the manpage for mmdelnode.

A node cannot be deleted if any of the following are true:
…
3. If the GPFS state is unknown and the node is reachable on the
network.

You cannot delete a node if both of the following are true:

– The node responds to a TCP/IP ping command from another node.

– The status of the node shows unknown when you use the mmget-
state command from another node in the cluster.

Thus, we just have to make the node unpingable for a few moments.

root@dec01 ~]# ssh dec06 reboot

Wait a few moments for the host to go down and then we can delete it from cluster.

[root@dec01 ~]# mmdelnode -N dec06
Verifying GPFS is stopped on all affected nodes ...
mmdelnode: Command successfully completed
mmdelnode: Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.

Wait another few moments for it come back online…

[root@dec01 ~]# ping dec06
PING dec06.tuc.noao.edu (140.252.27.26) 56(84) bytes of data.
64 bytes from dec06.tuc.noao.edu (140.252.27.26): icmp_seq=1 ttl=64 time=0.810 ms
^C
--- dec06.tuc.noao.edu ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 655ms
rtt min/avg/max/mdev = 0.810/0.810/0.810/0.000 ms

Then add it back into the cluster:

[root@dec01 ~]# mmaddnode -N dec06
Fri Mar 30 16:32:42 MST 2012: mmaddnode: Processing node dec06.tuc.noao.edu
mmaddnode: Command successfully completed
mmaddnode: Warning: Not all nodes have proper GPFS license designations.
    Use the mmchlicense command to designate licenses as needed.
mmaddnode: Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.
[root@dec01 ~]# mmchlicense client -N dec06

The following nodes will be designated as possessing GPFS client licenses:
	dec06.tuc.noao.edu
Please confirm that you accept the terms of the GPFS client Licensing Agreement.
The full text can be found at www.ibm.com/software/sla
Enter "yes" or "no": yes
mmchlicense: Command successfully completed
mmchlicense: Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.

And the node is now back into a rational state:

[root@dec01 ~]# mmgetstate -N dec06

 Node number  Node name        GPFS state
------------------------------------------
      18      dec06            down

From the Changes file:

0.08 Sat Feb 11 23:40:43 MST 2012
    - rt.cpan.org #52645 : UTC offsets must be in the same format
      (basic|extended) as the time as to which it is attached.

Available @:

• https://github.com/jhoblitt/DateTime-Format-ISO8601
• http://search.cpan.org/~jhoblitt/DateTime-Format-ISO8601-0.08/

After some Googling, I discovered that Android has the ability to read vCards encoded in a QR Code. The downside to this is that vCard is a fairly verbose format and you burn up bytes rather quickly. A high byte count QRcode is difficult to fit in a usable size on a US standard 2″x3.5″ card. qrstuff claims to have a work around for this by just encoding a HTTP URL. I tried this myself (not using the qrstuff service) and it did not work for me under Android 2.2 on my Droid2 (2.3.20). Experimentally, it seems that an encoded vCard stripped down to only a couple of entries is feasible.

I created the QR codes for the back of my new business cards using the qrencode package and then did the layout of the card using Gimp. It would probably have been better to use a package better suited to page layout like Scribus but I was in hurry to get the cards in time for SCALE10x and didn’t want to learn a new package. This is the Makefile I used to generate the QR code images.

all: jhoblitt_vcf.png jhoblitt_linkdin.png

jhoblitt_vcf.png: jhoblitt.vcf
cat jhoblitt.vcf | qrencode -l L -s 16 --margin=4 -o jhoblitt_vcf.png

jhoblitt_linkdin.png:
qrencode -l L -s 27 --margin=4 -o jhoblitt_linkdin.png "http://linkd.in/jhoblitt"

clean:
rm jhoblitt_vcf.png jhoblitt_linkdin.png

The -s flag is the number of pixels in the output image to use to present a QR code pixel. The values I used were from trial and error trying to get the output image as close to 900x^2 as possible. Since the number of pixels in a QR code depends on the number of bytes being encoded, this value needs to be adjust based on the input. I then scaled the images to 900px square with the intent (hope?) that the card printer I used (uprinting.com) will be printing at 600dpi. I would have preferred to use WHCC, as I trust their color management, but they couldn’t guarantee me a 1 day production window needed to get the cards by Wednesday and I leave for SCALE10x on Thursday.

Here are the finished results. The versions used for printing are 2100x * 1200px.

username: configuration
password:
(password is blank)

username: information
password:
(password is blank)