A Blog in Need of Posts

Glue Conference 2012

2012-06-03T14:25:00.000-04:00

Glue Conference 2012 took place at the Omni Interlocken Hotel Bloomfield, CO on May 23 and 24th. Gluecon is an information packed developer conference that focuses on cloud, mobile, APIs, big data, and most importantly, developers. Some of the topics included NoSQL, node.js, HTML5, backend-as-a-service, cloud management and security, cloud storage, Hadoop, DevOps, mobile app development, and cloud platforms.

I attended the conference with sponsorship (full ride) from FullContact. These guys were unbelievably gracious and showed me a great time while I was out there. I came in contact with them when Bart Lorang, CEO of FullContact contacted me over e-mail and wanted to setup a time to talk with him and his engineering team about a paper I had published at a KDD'11 workshop. After meeting with the guys and talking shop, I found out that they are solving the same real world problems (at world scale) that I was working on in my graduate research (at individual scale).

Some of the more interesting presentations/demo's of the conference included:

FullContact's Dan Lynn gave a presentation on Storm
The title of the presentation is Storm - The Real-Time Layer Your Big Data Has Been Missing. The problem with big data that is constantly changing is that your processing jobs are typically done in batch processing, and while this works and is usually perfectly acceptable, batch processing operates over a snapshot in time of your data. If you want to get the most accurate, and most up-to-date picture of your data, real-time processing is what you want. Storm is a new framework for real-time computation on big data that operates using new concepts of streams, spouts, tuples and bolts.

EmergentOne

EmergentOne makes it ridiculously easy to launch an API. Generate a complete and customized REST API for an existing application in minutes using a GUI interface. I saw a demo of this hooked up to a world country MySQL database. Within minutes the guy had created an API that I could hit over the internet.

Tempo

Tempo is purpose-built database used to store and analyze massive streams of time-series data. Think the internet of things here where each thing is generating data where the most important attribute is the time-stamp. From their site "TempoDB is the first purpose-built data layer that enables the scalable storage and instant analysis of your time-series streams, so that you can learn from the past, understand the present, and predict the future."

Distil.it

Distil.is used to guard your website against unauthorized web scraping, competitor data mining, and more, without impeding your end user. Distil.it was the winner of the Demo Pod which contained 12 new startups that were competing against each other for this title. (FullContact was the winner of the Demo Pod for GlueCon last year). While Distil.it will be welcomed by many a content generator over the internet, it flies in the face of the web-scrapers out there like myself and FullContact who harness the massive amounts of information on the internet in order to aggregate the data into a meaningful product. I'm still skeptical that they could prevent the scraping used in ArchiveFacebook.

Shout out to Robbie Jack and Kyle for showing me a great time in Boulder, CO the Friday after the conference. We had fun bar hopping and playing Werewolf at the TechStars Boulder HQ. I'm definitely going to have to try and come back for next years GlueCon.

Benefficient 1.0

2012-06-03T12:59:00.000-04:00

Benefficient for Android was launched in the Play Store (or whatever the hell they call it these days) today. Benefficient was created because I have seven credit cards, each with their own set of rewards that I can never seem to keep straight. Why do I have seven credit cards? That's a good question, let me explain. I make all my purchases with credit cards in order to earn money from the rewards they offer. I get different rewards for each card and by using the right card for the right purchase I can maximize these rewards, in some cases getting 5% cash back per purchase! I've been tracking these rewards over the last two and a half years and I've averaged about $1300 cash-in-pocket per year. I realize this approach isn't for everyone because it requires the discipline to pay the balance each month (which would wipe out any and all rewards accrued), but if you have the financial discipline for this, you can make a lot of money.

So, why is it hard to remember the rewards on my cards? Let me demonstrate. My American Express Blue Card gets 5% cash back on gas, groceries and pharmacies and 1% cash back on everything else. However, that is only after I have achieved the $6500 spent on the card for that year. Before that limit is met, I get 1.5% cash back on those categories and .5% on everything else. My Discover More Card gets 5% cash back on revolving categories that change every one to three months. This card also has category limits in which it stops the reward after say $750 spent in one particular category.

It gets even more confusing when you introduce points/miles into the mix. My Citi Hilton HHonors Visa card gets 6 HHonors points per dollar at Hilton Brands hotels, 3 HHonors points on groceries, pharmacies and gas, and 2 HHonors points for all other purchases. However, HHonors points don't exactly match up to cash back percentages. In order to compare point accruing credit cards to cards that accrue cash back, you need to assign a cash value to the points. With this particular card, since you can only redeem the points by booking Hilton Brands hotel stays, I've assigned a lower value to the value of the points. Specifically, each point is worth half of a penny. In other words 6 HHonors points per dollar spent would equal 3% cash back. This is my only card of the 7 where I can't redeem for cash, but I like the card because I only use Hilton Brand hotels (the Embassy Suites managers reception with free alcohol pays for itself!) and I know that I will redeem the points that I accrue.

From these scenarios you can begin to see that this is too much information for the average person to remember. Some people are really good at remembering this type of stuff like the Points Guy who travels frequently and blogs about how he games the travel miles system, but this is his career (or at least his side job). I however, don't cut coupons, or stand in long lines for Black Friday. In fact, I actually don't even spend that much time paying attention to credit card rewards. All I do is think for a second or two before I make a purchase about what card gets me the best reward. Many times I am wrong. Actually, I've found by using Benefficient in testing over the last month or so that I am wrong alot more than I thought!

According to my Mint account, I spent about $57k last year, which would make the $1,100 in rewards I redeemed in cash last year about 1.9%. Considering that I get 2% cash back on all purchases made with my FIA Rewards Card from American Express, and I get 5% cash back on other categories, I should have accrued around 3% (or $1,710) cash back if I had properly optimized!

That's the beauty of Benefficient, you don't have to be like the Points Guy, or the coupon-cutter or the Black Friday shopper. You can make purchases like normal and rely on Benefficient to do the heavy-lifting! It's that simple.

Android + LastPass is a Match Made in Heaven

2011-08-28T20:26:00.000-04:00

Since the invention of the smartphone there's been one thing that has irked almost every user - password management. Getting passwords in the browser was a challenge for a while, but that has pretty much been handled by browser based password managers. Up until this point however, the user/password problem for apps has not been solved. Every time I install Facebook, or Last.fm or Zillow, I am presented with a username and password challenge. If it was just as easy as remembering the password and then inputting it, it wouldn't be that bad. The problem is, I can't ever remember my passwords to social media sites. They are not important enough to me to remember. Its completely bothersome to load up an app for the first time only to be presented with a blank password form.

Finally, there is a solution. LastPass Plus gives the ability to input usernames and passwords into apps. It does this by using a custom keyboard. Is it a perfect solution? No. Does it work? Yes. The keyboard itself is not nearly as good as the stock Android keyboard so its annoying to use for other apps, but what I do is use it only for the time that I need it and then switch back to stock when I don't. Once again its not perfect, but it works. I don't see another way to do it with the present state of Android. The only other way to do it would be with Intents, but I'm pretty sure Intents don't provide the security needed to be requesting and sending passwords back and forth.

Until Android gets serious about password management, LastPass has a working solution. I am very pleased that this solution is available to me as it solves a nagging problem.

Trip Report: KDD 2011

2011-08-28T20:03:00.006-04:00

The SIGKDD 2011 conference took place August 21 - 24 at the Hyatt Manchester in San Diego, CA. Researchers from all over the world interested in knowledge discovery and data mining were in attendance. This conference in particular has a heavy statistical analysis flavor and many presentations were math intensive.

I was invited to present my masters project research at the Mining Data Semantics (MDS2011) Workshop of KDD. In this paper, we present an approach to find social media profiles of people from an organization. This is possible due to the links created between members an organization. For instance, co-workers or students will likely friend each other creating hyperlinks between their respective accounts. These links, if public, can be mined and used to disambiguate other profiles that may share the same names as those individuals we are searching for. The following figure shows the amount of profiles found from the ODU Computer Science student body for each respective social media site and the links found between them.

This picture represents the actual students themselves and the links between them. Black nodes are undergrads, green nodes are grads, and red nodes are members of the WS-DL research group.

These are the slides:
An Unsupervised Approach to Discovering and Disambiguating Social Media Profiles

View more presentations from carlton.northern.

Here is the paper:
MDS 2011 Paper: An Unsupervised Approach to Discovering and Disambiguating Social Media Profiles

View more documents from carlton.northern.

I've synopsized some of the interesting presentations from the conference:

Stephen Boyd - Stanford University "From Embedded Real-Time to Large-Scale Distributed". Stephen Boyd's talk focused on his current research area of convex optimization. He explained that convex optimization is a mathematical technique in which many complex problems of model fitting, resource allocation, engineering design, etc. can be transformed to a simple convex optimization problem to be solved and then transformed back into the original problem to get the solution. He went on to explain how this can be implemented in real-time embedded systems sych as a hard disk drive head seek problem, to large distributed system such as California's power grid.

Amol Ghoting - IBM "NIMBLE: A Toolkit for the Implementation of Parallel Data Mining and Machine Learning Algorithms on MapReduce". Use Hadoop to write a map function and a reduce function where you can map anything to a (key, value) pair. The problem with Hadoop is that it has a two-stage data flow which can be cumbersome for programming. Also, job scheduling and data mangement is handled by the user. Lastly, code-reuse and portability is diminished. This toolkit tries to make the key features of Hadoop available to developers but without a Hadoop specific implementation. NIMBLE actually decouples algorithm computation from data management, parallel communications and control. It does this through using a series of basic datasets and basic tasks that create a DAG. Tasks can spawn other tasks. With this structure in place, simultaneous data and tasks parallelism is achievable.

David Haussler – UC Santa Cruz “Cancer Genomics”. DNA sequencing cost has reduced dramatically. DNA sequencing was following Moore’s law but is now reducing cost 10 fold every two years. Can now cheaply sequence entire genomes. Created the Cancer Genome Atlas. 10,000 tumors will be sequenced in the next two years using this Atlas. Cancer genome sequencing will soon be a standard clinical practice. Because each persons DNA is different, and each tumor resulting from a persons DNA is different, a huge computational processing problem looms in the near distant future.

Ahmed Metwally - Google. "Estimating the number of people behind an IP Address". Most research assumes that there is 1 person using 1 IP address, but this is not the case. IP's also change size of users, for instance, a hotel with a conference will have many more users possibly using the same IP address than usual. So, how would one estimate the amount of these users in a non-intrusive way? One method is to look at trusted cookie counts. Another method is to look at diverse traffic. Google caps traffic volume per IP to stop people from gaming the system using the same IP address. Google knows how many users share an IP address because they are logged in with a username and password to Googles sites. However, some of Googles traffic is from users that don't have a Google account. This research is for those who want to filter users without asking them for any identification, thus preserving their privacy. This method is currently being used at Google for determining click fraud.

D. Scully - Google "Detecting Adverserial Advertisements in the Wild". An adversarial advertiser would be an advertiser that uses Google AdWords or AdSense to advertise misleading products like counterfeit goods or scams. Most ads are good, only a small amount are bad. Using in-house trained people to hand build rule based models. Allowing these people to hand-build the rules gave a great incentive and improved morale rather than just having them do repetitive tasks over and over again. Automated methods are being used as well, but this part of the presentation went right over my head.

Chunyu Luo - University of Tennessee "Enhanced Investment Decisions in P2P Lending: An Investor Composition Perspective". In this paper, they are trying to decide which loans are worthwhile to invest, in other words, what makes a good loan? Use a bipartite investment network with one side investors and the other investees and the edges between them loans. Each loan can be considered a composition of many investors. The idea is that by looking at the past performance of the other investors of a given loan, you can improve your prediction of the return rate for that loan. Performed experiment from dataset of prosper.com. The composition method far outperformed the average return of investment.

Susan Imberman - College of Staten Island "From Market Baskets to Mole Rats: Using Data Mining Techniques to Analyze RFID Data Describing Laboratory Animal Behavior". This paper presents the data mining techniques used in analyzing RFID data from a colony of Mole Rats. Much like we use RFID in cars for tolls like EZ Pass, they are using RFID on Mole Rats and when they pass specific points of the colony (a series of pipes and rooms) they collect that sample. They used k-means clustering which showed animal place preference. Used an adjacency matrix to get an idea of which Mole Rats liked to be near one another. This created 3 distinct sub graphs which corresponded well to the different colony structure of Mole Rats, queen workers, large workers and small workers. Next they correlated common transactions made in the grocery store with items in a basket to repeat behavior of Mole Rats.

After the conference ended on Wednesday, Hurricane Irene was on track for a direct hit to Hampton Roads. My flight was scheduled to arrive in Norfolk around 11pm which was cutting it very close to the storm hitting. So I decided to extend the trip till Monday and ride out the storm here in sunny San Diego. In total, I managed to miss a hurricane, a tornado, an earthquake, and a swamp fire. I think I made a good decision...

How To: Permanent Root and Flash CyanogenMod on Newer MyTouch 4G's

2011-03-23T11:00:00.003-04:00

So, I purchased my MyTouch 4G back in October of last year and had no problem rooting it using the methods that came out in November. However, I just got another brand new MyTouch 4G through work that also needed to be rooted and I ran into big problems. After about 6 hours of tinkering I finally found out that the new phone had a non-engineering HBoot. This means that there isn't as much flexibility in what you can and can't do with it and you have a greater chance of bricking if something goes wrong. So, how do you know which HBoot you have? Simple, reboot the phone into the bootloader by holding the power and bottom volume button. Then on the boot loader screen it will either say 0.86.000 or 0.85.2007. If it is the .85 then you have the engineering HBoot and any permanent root method should work. If it says .86 then you don't have an engineering HBoot and you need to use this method. To be clear, I didn't create these methods, I am simply aggregating the three steps needed to perm root and load CyanogenMod.

This tutorial assumes you are familiar with adb, if not look here. If you are running a 64 bit version of Windows you may have problems loading the adb driver. This thread should provide the solution.

Follow tutorial for temp root using Visionary: http://theunlockr.com/2010/11/15/universal-android-rooting-method-visionary-method/

Then this method will perm root the phone: http://forum.xda-developers.com/showthread.php?t=858996

These instructions below were extracted from the link above for convenience. I fitted them for .86 boot loader situation.

Download this file:
http://www.mediafire.com/?s7afymwe2wb3x60 New version of gfree with more options! See below.
md5sum: b73c56ca0e21664c5756d4ad295063c5

1. Now unzip the file into your SDK tools directory.

2. Plug your device into your computer.

3. Now open explorer and hold down shift at same time you right mouse click on your SDK tools directory (platform-tools if you have the R8 version of the SDK). Select open command window here. If you are in linux (ubuntu) right mouse click on your SDK tools folder, choose actions, and choose open command window(or whatever it's called). Otherwise, open a command prompt and cd your way to your SDK tools directory.

4. Type "adb push gfree /data/local" and hit enter.

Optionally, you could dl the file to your phone use androzip or something like it to unzip the file and then use root explorer to move the file named gfree to /data/local. Not the gfree.h file. All the other files are source code inlcuded for the gnu license. This would skip the first 4 steps.

5. Now unplug your device from the computer.

6. Run visionary to gain temp root. (If you were already permarooted w/s=off ignore this step.)

7. Open terminal emulator on your device, type "su", and hit enter to gain root privileges.

8. Type "cd /data/local" and hit enter.

9. Now type "chmod 777 gfree" and hit enter to make the program executable.

10. Type "./gfree -f" and hit enter.

New features in gfree.
gfree usage:
gfree [-h|-?|--help] [-v|--version] [-s|--secu_flag on|off]
-h | -? | --help: display this message
-v | --version: display program version
-s | --secu_flag on|off: turn secu_flag on or off
-c | --cid : set the CID to the 8-char long CID
-S | --sim_unlock: remove the SIMLOCK

With the new features you can turn off one thing at a time. You can also turn security back on and set the CID back to stock if you wish. To turn simlock back on you still have to follow the revert procedures on this page as the information that is patched to turn the lock off is encrypted and we can't write back to it other than restoring the entire image.

So, if you wanted to leave simlock on but turn security off and set super CID the command would be "./gfree --secu_flag off --cid 11111111" + enter. The -f switch after ./gfree that is now in the above step (./gfree -f) just tells gfree to patch everything.

11. Wait for the program to finish and then reboot into HBoot to see if S=Off. Also, check your bootloader version. If it says s=off and has bootloader version 0.86.0000 it worked.

12. Run visionary again (temproot w/set system r/w after root checked and then attempt permroot) to make root privileges permanent and then reboot again. Now "su" should work properly for you.

Gfree writes a backup of the file that it patches named Part7backup-numbers.bin on your sdcard. I suggest putting this file in a safe place as it is the only way to revert if you need to.

Next, follow these steps to flash the engineering bootloader
1. Restart your phone and plug it back into your computer.

2. Download this file: http://www.megaupload.com/?d=NN5726Z8
md5sum: df4fd77f44993eb05a4732210d2eddc6

3. Copy the file to your SDK tools directory.

4. Open a command prompt again and cd into your SDK tools directoty (platform-tools if your on the new R8 SDK).

5. Type "adb push hboot_dhd.nb0 /data/local" and hit enter.

6. Now open terminal on your device and type "su" and enter to gain root priviliges.

7. Type "cd /data/local" and enter.

8. Now type "dd if=hboot_dhd.nb0 of=/dev/block/mmcblk0p18" and hit enter.

9. You should see something like: 2048 bytes in 2048 bytes out 1048576 bytes copied blah blah blah.

10. Now restart the device into hboot and check if your bootloader version is 0.85.2007. That is what you want to see.

Congratulations, you now have a TRUE root and engineering bootloader on your shiny MT4G!!!

Lastly, follow this one for loading custom rom's: http://wiki.cyanogenmod.com/index.php?title=TMobile_myTouch_4G:_Full_Update_Guide&oldid=10207#Install_a_Custom_Recovery_Image

Once CyanogenMod is loaded, you will need to pull out and then replace the battery to get WiFi working.

Enjoy CyanogenMod!!

Total Cost of Ownership for the iPad 2

2011-03-04T11:23:00.003-05:00

So, with the announcement of the new iPad 2 there has been a lot of talk of it's competition and how the iPad 2 stacks up. What is incessantly compared are the tech specs, apps, and initial cost but what is almost never discussed is the total cost of ownership. The technical specs are of course important, and on that front, I'd say the iPad 2 and the XOOM (the only real competition to the iPad 2 currently) are evenly staked. The iPad 2 is lighter and thinner and has better battery life, but the XOOM has (or will have with a free hardware upgrade) 4G and a removable SD card (it also has a Barometer, but that has limited usefulness).

The iPad series of course is much better suited in the app space, but that's only because it has a year on Google's first Tablet approved OS, and at the rate the Android is giving away new XOOM's to developers, I' believe it's only a matter of time before there are as many Android Tablet apps as there are iPad.

The initial cost is a point of contention in most comparisons as well. Depending on the bias of the author towards one platform or the other you get comparisons like these. "The iPad 2 is cheaper than the XOOM with entry level costs of $499 compared to $799." Or, "The XOOM at $799 is comparable in price to the high end iPad 2 at $829." Just recently leaked however is new pricing from Sam's club for a WiFi only version of XOOM for $539 which is a cool $60 cheaper than the 32GB iPad 2. So, I think we can safely agree that these two tablets initial costs are comparable.

The last comparison, and the one that I want to discuss more in depth is how much it costs to get data, and the limitations of data on these devices. The first option for either is to just sign up for a data agreement. The data prices are comparable, especially considering that you can get data for either of these devices from the same carrier, Verizon... This option is for suckers though, why pay for data when you more than likely have data on your phone, and both Android and the iPhone support data tethering?

This, is where it gets a little tricky. For the iPad to tether from your iPhone you need to purchase the tethering package plan which will add an additional $20 to your data plan. The catch is that for those of you grandfathered-in, unlimited iPhone data plans, you have to switch to a limited data plan. Further, the extra $20 dollars that you pay is only for 4GB of data. You could go through 4GB of data in a week watching YouTube, so you may very well end up paying much more than $20.

The answer to all of these absurd charges/limitations for data on the iPad2 is to forgo the iOS family of products and go with Android. I have a 4G Android phone on T-Mobile which I pay $25 for unlimited data. I use the hotspot on my phone to share my 4G data connection to my XOOM for $0. I guess I could do the same with an iPad2, but the point is you need an Android phone, not an iPhone, to do this.

Other useful information to take notice of is that I only pay $30 a month (with my 10% corporate discount) for my cellular service in which I get 750 minutes (for $10 more I could get 1500). If I'm ever worried about going over minutes I can make calls for free using Google Voice over SIP from my Xoom or my phone). I also don't pay anything for text messages because I use Google Voice which provides free text messaging. All total I pay $55 a month with no contract. Life without strings is great isn't it?

20 Things the Motorola XOOM Can Do that the iPad Can't

2011-02-25T17:49:00.004-05:00

So once again my favorite tech sparring partner and I are at it. The screenshot below speaks for itself.

So, I put together this list (which came quite easy) of 20 things the XOOM can do that the iPad can't:

Google Maps 5 with 3D Maps
Widgets
Live Wallpapers
Cloud Syncing (apps, settings)
Dual core processing
More pixels, better DPI (nicer screen)
2 Cameras, front and back
Dual Flash on back camera
Video chat
Removable SD Card ~~and battery~~ (update: apprently he battery isn't removable... shame on you Motorola)
HDMI
Improved 1080p video playback
Share Data Connections with Portable Wifi Hotspots (this by the way is how I am getting 4G data to my XOOM, from a hot spot on my MyTouch 4G on TMobile)
Improved gaming with a Gyroscope
Predicts the weather with a Barometer
720p video capture with Movie Studio to directly edit video on the device
Google Maps Navigation (The iPad Wifi version doesnt even have a GPS)
True multitasking
System Bar (in bottom right corner) for global status and notifications
Application Bar (in top left corner) for contextual options, navigation, widgets, or other types of content

Android = Open. It Doesn't Matter What Some Carriers Choose to Do With It.

2010-09-10T10:41:00.002-04:00

A recent TechCrunch article written by the infamous MG Seigler entitled Android Is As Open As The Clenched Fist I’d Like To Punch The Carriers With, argued that Android is indeed a closed system because the carriers and handset makers that implement Android load their own custom skins, lock the phones, and put unremoveable crapware on the devices. This of course sparked huge controversy and we're now seeing (at the time of this writing) about a 1,000 comments on the thread, the most I personally have ever seen on TechCrunch.

A reply that I posted to a retweet of the post on Facebook ensued a rather good bit of argument with a co-worker Caleb Davenport, that I'd like to share here.

Here's the thread:

Caleb Davenport openness is an illusion http://tcrn.ch/cO2Sz1 #android #iphone

My Reply:

Carlton Northern Are you serious? You honestly believe that android is a closed system? If that is the case, could you please define what an open system is?

His Response:

Caleb Davenport

that's not what the article said at all. it said that the android os being open source does not make it an open platform for the consumer. in fact, it can never be open for the consumer because google is letting carriers run the platform. so, according to the article, the fact that it's open (to the carriers) means that they can install "crapware", block google's own app store, restrict from out-of-store installations which makes it closed (or at least less open) to the consumer.

if it's open:

why can't you install skype off of verizon?

why can't you install bing off of verizon?

why can't you uninstall the trial apps that come with it?

why are only 4% of phones running the latest software?

why can't i install apps external to the app store on all android devices?

My Reply:

Carlton Northern

Oh Caleb Caleb Caleb.. Why do you do this to me. I know what the article said and the article is wrong. And my questions to you still stand because you said in your post "openess is an illusion" referring to the Android platform.

Let me say it again, you can't both have a system that is open while still maintaining control! The two are mutually exclusive. By creating an open system, the creator itself loses all control at the point of distribution. As long as the carriers and handset makers comply with the open source license of Android, they can do whatever they want with it, including locking the phones and putting unremoveable crapware on them. Google can't control that. But it doesn't mean that the platform isn't open. It just means that there are a few bad eggs in the bunch.

Let me also argue your point that its not open to the consumers. You're wrong. If there were one Android phone, let's call it the aPhone, that only ran on one US carrier, that would be a closed system. However, there are like 70 Android phones that run on all the major carriers in the US and many more throughout the world. Many of these phones run vanilla android without any crapware. Many of these phones are also unlocked, or if they aren't unlocked they can be unlocked very easily, or they can be purchased unlocked on eBay. Furthermore, Android complies with software and hardware standards that are open. Things like 3.5mm headphone jacks, microUSB, Adobe Flash, the ability to run Java, C, C++, and other scripting languages on the phone, etc.

Lastly, the answer to all of your "if its open" questions is, precisely, "because it is an open system". Because it is open, Verizon can do whatever the hell they want to with it, Google has no control over Verizon like Apple has over AT&T. Their is fragmentation of versions precisely because it is an open system and carriers have the choice to upgrade or not. But let me also point out that those figures are more than a month old. There has been a massive amount of upgrades since then. Furthermore, many of the phones in the 35% not on Android 2.x are because they were first generation phones and they can't support the newer 2.x operating system.

A Lookup for Nicknames and Diminutive Names

2010-08-28T17:15:00.002-04:00

I created a simple lookup file that contains United States given names (first names) and their associated nicknames or diminutive names. For example "gregory" -> "greg", or "geoffrey" -> "geoff". The file can be downloaded and contributed to from here http://code.google.com/p/nickname-and-diminutive-names-lookup/.

This lookup was started from http://www.tngenweb.org/franklin/frannick.htm which is used for genealogy purposes. It was a good source to start from but because it is used for genealogy purposes there are some pretty of old names in there. There was also a significant effort to make it machine readable, i.e. separate names with commas, remove human readable conventions, like "rickie(y)", so that it would be made into two different names "rickie", and "ricky".

This is a large list with about 700 entries. Any help from people to clean this list up and add to it is greatly appreciated. Think of it as a wiki where you can contribute or change it as needed. CSV was the easiest format to use. Maybe I'll release this in XML or something later, or maybe a kind soul who uses this library wants to contribute another format they converted it into?

I was rather surprised that I couldn't find anything like this on the web. The best I could find was the pdNickname database and it costs $500. So, I created my own and released it as open source so that others could benefit from my work.

My Life is Now Complete

2010-07-21T12:43:00.000-04:00

NEW EPISODES OF KIDS IN THE HALL!!!!!!!!!!

Kids in the Hall: Death Comes to Town - watch more funny videos

An Homage to Paco

2010-07-04T10:46:00.003-04:00

This is a gallery of photos of Paco, our little puppy. I guess he's not so little anymore. He's 7 months now and about 20 pounds. The photos are sorted chronologically. Enjoy!

This is me talking to every iPhone fanboy I've ever known. (NSFW)

2010-06-28T20:11:00.000-04:00

Talking Time Travel

2010-02-17T14:17:00.000-05:00

I'd like to share with you a special talent
It ain't so hard to do, it's called time travellin'

Well, I woke up this morning feeling quite unpleasant,
Found I couldn't enjoy my present.
So I sat in my bed and tried to superimpose
Things I would have rather saw in front of my head.

I was time travelling,
Teleporting
Darn tootin'

Well, I travelled back to a different time
When people besides rappers enjoyed the rhyme.
One thing I can't comprehend
Is why poets nowadays don't call rhymes their friends.
Maybe I could be their friends, too.
Well, I must have been doin' something right
Hung out with the types of people
Who wrote, edited and updated Strunk & White

I was a travellin' troubador,
Village storyteller
I'd like to think so.

Well, it got a litte bit cold in my old log cabin,
So I devised a new mode of time travelling:
Instead of visual superimposition
I tried my hand at writing fiction
About things I ain't did yet,
But intended to do
And thereby make 'em happen.

Well, all of a sudden, my seat felt trembly
Found myself on a schoolbus to a school assembly
Where my supergroup was performing.
Well, you can be in my supergroup on one condition:
That you're my best friend, musician,
And don't mind unpaid conditions.
We was invited to the high school by the Peace Club
To fight the Fight Club
On their 100-watt light blub radio station.
Well, at that station, we met a kid, about 13,
Painted our schoolbus green
And called it the Joke-A-Minute Brain Machine.

He was bipolar,
Avant-garde,
High roller, savant tard
Well, on board that bus--I don't know why--
I got a hankerin' to learn to cry.
Now, learning to cry was quite a chore,
Just like doing anything you ain't never done before.

I was log flumin'
Jet streamin',
Quite relievin'

Well, I could have gone for the rest of the evening,
Or perhaps till the world ended,
When a moan from my girlfriend did bring me home
Next to her pillow.
Lookin' so gorgeous
(Don't like me to say so--
Thinks it's shallow).

AltDaily Covers ArchiveFacebook

2009-10-01T14:23:00.002-04:00

The good people over at AltDaily.com decided to do a story on my Firefox add-on ArchiveFacebook. Go check it out Take that Facebook!

ArchiveFacebook 1.0 is Live

2009-09-18T10:41:00.004-04:00

Just launched my Firefox extension for archiving your facebook account. Here's the download page. Here's the support page. Thanks to my advisers Dr. Michael Nelson and Dr. Frank McCown for the guidance and support (and the great idea).

You may not believe this, but Facebook will not always be around. Your Facebook account will not always be accessible. It's up to you to archive your data before it lands in the big bit-bucket in the sky.

Here's an Ignite presentation I put together for it.

Archiving Facebook Ignite

View more presentations from carlton.northern.

Gmail Down: System Failure or Genius Marketing Ploy?

2009-09-01T17:53:00.010-04:00

The Internet has been buzzing with the news that one of the largest web services on the web, Gmail, is down. Just a few hours ago TechCrunch wrote an article about how this news was crippling Twitter. They estimated that during that time there were 10k twitter posts being generated every minute containing the word "gmail". Can you imagine how much publicity this is generating for the email powerhouse? This is Twitter alone. Doing a search for "gmail" on Google News and limiting the results to the last 24 hours we get back 16k results. It's insane how newsworthy this is.

There are some really bright minds at Google. They have some of the best engineers in the world, but Google realizes that their engineers can't do it alone. Google has been hiring top notch management and business professionals all the while. I wouldn't put it past some young MBA, trying to make a mark for himself, pitching the idea of a fake outage for sheer publicity. Sure, its bad publicity, but as we all know - there is no such thing as bad publicity.

Google has a history of timing their press releases and public events at crucial moments. Take for instance the launch of Chrome OS right before Microsoft launches Office in the Cloud, effectively stealing their thunder. They also conveniently started sharing information about Google Squared before it was even launched in an attempt to steal the limelight from Wolfram Alpha.

Google may seem like a clumsy, brain filled company, but they know what they're doing. Eight years of recruiting the best talent from Stanford and other hotbeds of brilliance has kept them sharp and creative, and I think their marketing team just maybe had a moment of glory, at the expense of their engineers.

Phil Hartman Was the Best

2009-08-27T15:25:00.004-04:00

Translation Party, Will You Please Translate "My Humps"?

2009-08-08T16:23:00.004-04:00

Translation Party is a new mashup that finds the point at which no changes are made between a traslation with English and Chinese in Google Translate. This point is called the "equillibrium". Needless to say, the equillibrium is almost always hillarious.

I thought it would be fun to try the Black Eyed Peas song "My Humps". I couldnt have been more right. This:

What you gon 'do with all that junk? All that junk inside your trunk? I'ma get, get, get, get, you drunk, Get you love drunk off my hump. My hump, my hump, my hump, my hump , my hump, My hump, my hump, my hump, my lovely little lumps. Check it out

Turned into this:

All waste in the square? All waste in the trunk? Kawano Megumi Nobu, please use the wine. My hump, my hump, my hump, my hump, my hump, my hump, my hump, my hump, my lovely little lumps. Check it

I have no idea where "Kawano Megumi Nobu" came from. Here's the link to the complete translation.

Update: Looks like it got a little better over the last few months. I issued the same query and got this result:

What Gon 'Do all of SPAM? All the junk in your trunk? I love to drink my hump to get really clear. My hump, my hump, my hump, my hump, my hump, my hump, my hump, my hump, my lovely little lumps. Check it out

Night Man

2009-07-30T10:01:00.001-04:00

Night man,
Sneaky and mean
Spider inside my dreams
I think I love you
You make me wanna cry, you make me wanna die
I love you, I love you , I love you , I love you, I love you.
Night Man
Every night you come into my room and pin me down with your strong arms
You pin me down down and I try to fight you
you come inside me and fill me up…

Just two men sharing the night
It might seem wrong but it’s just right
It’s just two men sharing each other
It’s just two men like loving brothers
One on top, and one on bottom
One inside, and one is out
One is screaming he’s so happy
The other’s screaming a passionate shout
It’s the Night Man
The feeling so wrong it’s right man
the feeling so wrong…
I can’t fight you man when you come inside me and pin me down your strong hands and I’ll become the Night….the passionate, passionate Night Man.

They took you Night Man
and you don’t belong to them
They left me in a world of darkness
without your sexy hands
and I miss you Night Man
so bad.

The New HTC Hero Looks Awesome

2009-06-24T18:51:00.001-04:00

I want this phone so bad. It's not coming out until late 2009 for the US though.

Let's Eradicate the Fax Machine

2009-06-03T09:56:00.003-04:00

Why are fax machines still common place in every office? With the advent of scanners and e-mail, the fax machine is completely redundant. Every office needs a scanner to make electronic copies of documents. And if your office isn't using email, then I doubt you're reading this in the first place. So, why require another piece of useless hardware to maintain and take up space? Why require a separate phone line for this archaic mode of communication? It not only is costing your organization money, it costs time also. You have to go through the trouble of creating a cover sheet, you haver to learn how to user the thing, and then you have to worry about whether the recipient got the fax. Do the smart thing, throw that wortkess piece of junk in the trash, or better yet, have your very own gangster Office Space moment.

Yet Another Post on Spock.com

2009-05-06T18:50:00.004-04:00

Techcrunch recently did an article on Spock.com stating that Spock is running low on cash and may be bought by Intelius. This is no surprise to me. Spock really didnt offer anything new. Spock basically did exactly what Wink.com was doing except that the user could edit other peoples pages, they even had a feature called Spock Power that controlled the editing ability of users. The idea at this stage was pretty cool, but then something happened. Slowly everything novel about Spock started to dissapear. First to go was the Spock Power. They did this in an attempt to stop spam. It may have worked, but along with the spam went most of the users that used to visit the site on a regular basis. Secondly, you could no longer edit other peoples pages. This made the site effectively exactly the same as other people search engines.

I had an idea for Spock to make a name for themselves but they never bit. Shortly after I wrote that article, Jay Bhatti contacted me and wanted to talk data portability. I pled my case and told him what they should do and why they should do it. He told me that Spock was treading a thin line because their data - which is mostly harvested from other big name social networks - is only allowed to be harvest from these sites because it basically provides links back to, and advertisement for the originating site. Spock became a less social site because the big name social networks threatened to shut off their flow of data. He cited this as a reason why they couldnt make Spock's data more portable. I disagreed and cited 4 different areas that Spock could improve upon that wouldn't piss anyone off and I put concrete suggestions for improvement into an email that was later passed to their engineering department and most likely forgotten. Here is the entirety of that email:

Spock Data Portability Initiatives:

1. Implement XHTML Friends Network (XFN) microformat

a. For every link in the “Web” section of a user’s search result add a rel=”me” to the link. This will allow for identity consolidation which will make Spock THE destination for identity consolidation because this information is already being aggregated on your site. I would suspect that this would draw a lot of traffic to Spock because anyone who wanted to consolidate their online identity could easily go to Spock and add any links in their web section that aren’t already there. I have already done this, but without the rel=”me”, services like Google SocialGraph won’t be able to pick up on it.

b. For every related person in the “Related People” section add a rel=”x” where is x is equal to one of these attributes “friend, acquaintance, contact, met, co-worker, colleague, co-resident, neighbor, child, parent, sibling, spouse, kin, muse, crush, date, sweetheart”. I would recommend using these attributes when the user themselves have used one of these attributes. If the user has used a term outside of these attributes, just use “contact”. You can also use multiple values like rel=”friend met colleague”. You could even take it further and map some terms to these values i.e. map “girlfriend” and “boyfriend” to “sweetheart”.

c. I see no reason for social networks to not want you to do this. All you’re doing is promoting connectedness between people on the web. This will actually help social networks recommend friends to their users because they can go to your site and see what users are friends on Spock that aren’t already friends on their site.

2. Implement OpenID

a. Follow Plaxo’s guide for OpenID-Enabling your site

b. OpenID eliminates the need for multiple usernames across different websites, simplifying your online experience. This is basically doing your users a favor. Rather than making them have to remember what email they used to register with your site and what password they used, they just use their OpenID login and password. The login and pass are authenticated at the OpenID provider and the session is returned to your site authenticated. It doesn’t get any easier. As OpenID gains momentum, I believe this will draw many more users to your site. I can’t tell you how many times I’ve been to a website that wants me to register and I just leave because I don’t want feel like going through the hassle.

3. Implement the rel-tag microformat

a. Just add a rel=”tag” to the tags link. For example “software engineer” would then be “software engineer”.

b. This isn’t as important to me as numbers 1 and 2. I t should drive more traffic to your site as it better let’s search engines know what the page is about. It also makes browsing tags easier. Well, you guys already have your own implementation for viewing the tags, but rather than showing tag searches as http://www.spock.com/q/”software-engineer”, you would show it as http://www.spock.com/tag/software-engineer.

Moustache May

2009-05-01T11:01:00.003-04:00

And so begins another celebration of Moustache May. I along with colleagues from work, friends, and even family will be shedding the excess hair on our face, all except the magical region directly above our upper lips. In this time of celebration, let us reflect upon our moustaches with great veracity and be thankful that we may wear such a glorious configuration of facial hair.

I havent quite shaved my beard into a moustache yet. I have a wedding to attend tomorrow and didn't want to steal any thunder away from the groom with my terawesome moustache. The moustaches you see in the picture come from last year's celebration. Come sunday I will have the moustache and the pics to prove it.

Some people here in my office are under the false assumption that you must begin Moustache May with a clean shaven face. I don't buy into any of that malarky. I think that just takes away from the limited time we have to don moustaches.

Anyways, to kick-off this month in style I thought a wikipedia entry on Moustache May was fitting. So check it out and contribute!

Spock Turns Pay Only

2009-04-22T13:59:00.004-04:00

Looks like Spock.com is most likely in its death throws. In a last gasp to remain afloat it has turned to charging users for its services. The change wasnt even made in a way that makes sense. When clicking on a users profile you are asked to pay $19.95 or to "skip". Both buttons however link to the same PayPal page. So there's no way to remain on spock.com at that point unless you hit your back button. I'd expect this from a website that was made by a teenager in high school, but not from a well funded silicon valley startup like Spock.

Update: Actually, it appears that Google just made Spock useless by letting people control search results about themselves.

This is Wierd

2009-04-01T10:06:00.005-04:00

So I get an email from SlideShare this morning:

Hi carlton.northern,

We've noticed that your slideshow on SlideShare has been getting a LOT of views in the last 24 hours. Great job ... you must be doing something right. ;-)

Why don't you tweet or blog this? Use the hashtag #bestofslideshare so we can track the conversation.

Congratulations,
-SlideShare Team

I only have one SlideShare presentation and its nothing special. It's just a presentation I did for school on Atom and hAtom. It's currently showing 30,000 views. The last time I checked (which was probably a few months ago) it had like 500 views. I am assuming from the email that I got most of my views in the last 24 hours. I checked google's backward links and nothing shows up. Any ideas how my presentation became popular?

Update: I checked SlideShare today and found that my presentation was back down to 328 views. I can only assume that SlideShare had some kind of internal error. Wonder if anyone else reported these problems?

Update: Ok, I got pwned. Apparently this was an April fool's joke from SlideShare. Hardy har har.