Password Managers Relieve Password Headaches

Ben Gross — Tue, 31 Jan 2012 16:51:01 +0000

Passwords Are a Hassle

I’ll be the first to admit I can’t remember all my passwords. Most of us can’t, so we pick a few passwords that are easy to remember and then use them with multiple sites. This results in two immediate problems. A password manager can help with both of these problems. First, passwords that are easy to remember are typically also easy to guess. Second, a compromised password is a risk to every site where it has been reused. A password manager helps alleviate both of these problems since it can generate a secure and unique password for each site, but only requires that you remember a single password to unlock the database. While it is possible to create passwords that are secure and memorable, it is more difficult to do this with the significant number of passwords we frequently use in modern life. I detailed some additional problems with passwords in previous articles Your NYE Resolution—Pick Better Passwords and Data Evaporation and the Security of Recycled Accounts. I find that password manager with solid browser integration is well worth the initial setup time and expense.

While there are many good options, my password manager of choice is 1Password from AgileBits that is available for Mac OS X, Windows, and the iPhone, iPad, iPod Touch. I consider it an indispensable tool and I use it daily both on my desktop and my phone. 1Password integrates with many popular browsers, which makes logging into web sites faster and more convenient. The application allows me to easily switch between multiple browsers and multiple devices without worrying, which browser I might have saved a particular password.

When I first looked at 1Password in 2006, I thought there was no way I would be willing pay for it since all modern browsers ship with password management functionality. Shortly after I started testing the application I found it so convenient, I changed my mind and purchased it. Nearly six years and many major upgrades later, I have no regrets. I have nearly eight hundred logins saved in 1Password. Even though I regularly clean out duplicates and entries for dead services, this is still a ridiculous number of accounts. Look at it this way, I test services so you don’t have to.

We All Forget Passwords

A 2007 paper A Large-Scale Study Of Web Password Habits of more than half a million users found that about 1.5% of all Yahoo! users forgot their password each month. Yahoo Mail alone has more than 200 million accounts, so this is a significant number. The authors found that the “average user has 6.5 passwords, each of which is shared across 3.9 different sites. Each user has about 25 accounts that require passwords, and types an average of 8 passwords per day.”

Complicated Passwords and Compact Keyboards Don’t Mix

The current crop of smartphones ship with highly capable browsers, but entering lengthy passwords on a phone keyboard is even more error prone and frustrating on the desktop. Here again, a password manager can reduce the complexities of entering many different password strings on a mobile device. The application allows you to make a mobile keyboard optimized and possibly simplified password that protects your longer more complex passwords and notes. This is of course a security tradeoff.

Mobile Safari on the iPhone and iPad does not permit plugins, so the 1Password application on iOS devices embeds a browser that is able to offer the automatic login feature. I prefer the default browser, but unfortunately there is no option for direct integration. The 1Password bookmarklet makes it relatively quick to look up an entry in the database and then copy and paste long passwords from its database far more easily than trying to type them in by hand

Other Advantages of 1Password

I regularly use multiple browsers. I also frequently delete my cookies and browser settings when I test services. This would typically cause a nightmare of needing to re-authenticate to each web site where I deleted the cookies. Since all of my login information is stored in 1Password rather than the browser, I don’t have to care about which browser I am currently using or even if my cookies still exist.

Since 1Password is also a general form filler it can cope with login forms that have partial entries or multi-stage. For example, many services require that users re-enter their password to access account management features even if they are already logged in. This is to prevent another person from simply walking up to your unattended computer from viewing or making changes to billing information, email forwarding, and passwords. In most cases, 1Password is able treat the re-authentication sign in forms exactly like a standard sign in form.

Some sign in forms are multi-stage where login process is split across several forms. For example, many online banks are multi-stage sign in forms. In the first stage, the user enters a username and their browser must acquire a cookie from the bank. If the user does not already have a cookie from a previous session, the user must enter a second authentication factor such responding to a text message with a unique code or entering the code from a hardware token. Next, on a second form on a separate page the user enters a password.

In cases where 1Password is confused by multiple stage forms, the work around for this type of site is to simply make two separately named entries in 1Password. For example, the first entry would contain the username and the second entry would contain the password. The user must go through the full sign in process the first time to received a cookie from the bank by completing the two-factor authentication process and has create a 1Password entry for each step in the form. Each subsequent login to the bank will be treated like all other sites and can be automated with the auto-login and auto-submit features.

Here is a small laundry list of other features I regularly use and appreciate about 1Password.

General form saving support. 1Password can save and replay many kind of web forms, which is a useful feature if you find yourself filling out the same information over and over again.
Support for “identities” where the application stores commonly used bits of information such as name, email, phone number and can populate this information into many types of forms with little effort.
Basic anti-phishing protection since by default 1Password will only post usernames, passwords, and other forms back to the same domain name as the original.
The application can generate random passwords with several different templates that will satisfy most password requirements.
In addition to usernames, passwords, forms and identities, 1Password also supports encrypted notes.
The Mac OS X desktop application will sync over the local wired network and WiFi for iOS devices
1Password will sync with Dropbox for all desktop and mobile applications including Windows and Android

Limitations of 1 Password

There are several important limitations with 1Password. The application cannot handle login forms built with Adobe Flash. Previous generations of 1Password supported login forms with HTTP basic authentication, however the new plugin architecture for Safari and Chrome do not offer support for HTTP basic. AgileBits says it is working on a solution for Firefox.

The features of the Windows version of 1Password are not quite yet on part with the Mac, for example it only supports 32-bit Internet Explorer, 32-bit Firefox, Chrome, and Safari. This said that covers most browsers that user’s need.

Pricing

1Password for Mac and 1Password for Windows is $49.99, 1Password Pro is $14.95 is available for iPhone, iPad, and iPod touch.

1Password Bookmarklet Gone Missing

If you are a frequent 1Password user, particularly on iOS devices, you may have noticed that AgileBits discontinued support for the 1Password bookmarklet, which was the best option for integrating with Mobile Safari rather than the integrated browser in the application. Fortunately, Kevin Yank and * have produced a working 1Password bookmarklet. I have reproduced it here:

javascript:window.location='onepassword://'+window.location.href.substring(window.location.href.indexOf('//')+2)

Your New Year's Resolution--Pick Better Passwords

Ben Gross — Thu, 29 Dec 2011 16:30:15 +0000

As we near the end of 2011, I can’t help but think this is the year I had the most trouble telling the difference between actual news stories and pieces from “America’s Finest News Source”, The Onion. As I write this article, details are still unfolding from the data breach at the private intelligence firm Stratfor.

According to reports, the Stratfor hackers found a weakly protected database of usernames and passwords and an unencrypted database of credit card information. The hackers proceeded to make donations to charitable organizations with the credit cards in the database. As any story benefits from more absurdity, there were claims and counter claims of whether or not the attack was associated with Anonymous, the discerning hacker’s first choice of affiliation.

According to Identity Finder, the Stratfor database contained [approximately 44,000 hashed passwords in the database], roughly half of which have already been exposed(http://www.identityfinder.com/blog/post/Identity-Finder-Releases-Detaile…). Unfortunately, another 20,000 or passwords on pastebin would not even be newsworthy, if it were not for the notoriety of Stratfor. Note: if you think you might have been on the list of compromised accounts in the Stratfor database, you can check at Dazzlepod.

There is plenty of blame to go around. First, Stratfor stored user passwords as basic unsalted MD5 hashes, which is simply irresponsible. There are well-regarded and widely-available solutions for storing passwords such as bcrypt, which is nicely summarized in Coda Hale’s How To Safely Store A Password. Secondly, and more importantly, storing customer’s credit cards in clear text is unconscionable. Never mind the question of why on earth Stratfor stored CCVs in their database, which is never OK.

Given the recent attacks against Sony, Gawker, HBGary Federal, and Infragard Atlanta, one could reasonably expect that Stratfor would pay more attention to the operational security side of their business. To put the Stratfor hack in a more global context, the 2011 Verizon Data Breach Investigations Report aggregates data from Verizon RISK, the U.S. Secret Service and the Dutch High Tech Crime Unit. DataLossDB Statistics collected data from open sources including news reports, Freedom of Information Act (FOIA) requests, and public records. These reports give a more nuanced breakdown of the types of breaches and data exposed across many industries.

As much as it pains me to blame the victim, a great many of the subscribers to Stratfor’s service, clearly could and should have picked better passwords. According to Stratfor Confidential Customer’s passwords analysis, we could start with the 418 users who picked “stratfor” as their password or even the 71 users who picked “123456.” The database was full of weak passwords, which was why the clear text of nearly half the passwords followed in a post shortly after the original password hashes appeared online.

In Data Evaporation and the Security of Recycled Accounts, I described how passwords for email accounts are frequently the weak link in the security chain. It is common for sites to allow users to reset their passwords to the email address listed on the account. This means that a compromised email account may be the only method an attacker needs to gain access to other accounts.

In my dissertation interviews, I talked with people about how they managed their accounts and passwords. Many of my interviewees told me they effectively had 2–3 passwords they used for most accounts with some minor variations due to password complexity rules. The interviewees frequently reported using a set of low, medium, and high security passwords. Unfortunately, the email accounts were often given the low security passwords.

It pains me to think how many of the customers in Stratfor’s database likely reuse the same password on multiple sites. In Measuring password re-use empirically, Joseph Bonneau analyzed the overlap between rootkit.com and gawker.com passwords in addition to other studies and found a wide-spread ranging from 10% to 50% overlap. Even with 10% overlap, there are significant benefits from leveraging one exploited password database to compromise another. As always, XKCD keeps track of the pulse of the internet and has informative comics for both Password Reuse and Password Strength.

Realistically, it’s getting to the point where unless you have a pretty fantastic password, if your password is in a database of poorly hashed passwords then someone with a bit of time can discover it. Why is that you might ask? Whitepixel the purveyors of fine open source GPU accelerated password hashing software report that it currently achieves 33.1 billion password/sec on 4 x AMD Radeon HD 5970 for MD5 hashes. This is fast enough to make rainbow tables (pre-computed hashes for a dictionary attack) much less compelling. If the attacker has any additional personal information this significantly increases the chance of a successful attack since so many people use bits of personal information in their passwords. Bruce Schneier describes commercial software that exploits personal information when attempting compromise password hashes in Secure Passwords Keep You Safer.

In general, unless your password or pass phrase is quite long you are far better off with a long randomly generated string that you manage with a password manager. There are many good options including my personal favorite 1Password, UsableLogin, LastPass, RoboForm, or the open source projects PwdHash or Password Safe. PasswordCard is a nice alternative if you would prefer a solution you can always carry with you that does not require any dependencies besides what you can carry in your wallet.

Unfortunately, none of the password managers are magic. You will still have to deal with a depressingly large number of services that force you to choose poor passwords with arbitrary restrictions. Troy Hunt names some offenders in the Who’s who of bad password practices – banks, airlines and more. Still, if you simply use a password manager and different password with each service, you will dramatically limit any potential damage, as an attacker cannot reuse your password on another service.

You should follow me on Twitter.

Security, Productivity, and Usability in the Enterprise

Ben Gross — Wed, 30 Nov 2011 19:04:02 +0000

During interviews I conducted for my dissertation research, I asked individuals how the security policies and systems affected their daily life in terms of productivity and work and personal communication. Interviewees gave many examples of tradeoffs between security and usability. People understood the reasoning behind many of the security restrictions. However, these implementations often significantly reduced productivity and frustrated employees everyday work practices and basic personal communications needs. Many implementations actively motivated employees to subvert security protections. The lengths to which people went to “work around” what they perceive as overly restrictive security and compliance implementations led to distinctly counterproductive measures in terms of overall security.

Security implementations in systems and security policies vary widely across the enterprise. These systems can help prevent unauthorized access, dissemination of proprietary business information, and confidential customer data. Security and compliance systems are also essential to passing an audit. The effectiveness of a system’s security is directly related to the overall user experience of the system. Security implementations that do not adequately consider a range of factors including existing work practices, the overall usability of the system, and basic social communication requirements may have serious negative consequences for morale, productivity, and information security.

Unsurprisingly, interviewees often responded that they were more concerned with job performance and completing the tasks at hand than with complying with corporate security policies. In short, they were far more worried about a lost job or a promotion from not getting their work done than about violating security policies. Don Norman summarized the problem nicely as “The more secure you make something, the less secure it becomes.”

People did not distinguish between the technology failing, not understanding how the technology works, and not realizing that a task was technically infeasible. In one example, an employee had tried to work from home over the weekend. This employee was not able to access the corporate network, because the VPN was inoperable over the weekend and the situation was possibly complicated due to a user misconfiguration. The following Monday morning, the employee was rebuked for not completing the project by the deadline.

Institutions that do not pay attention to employee’s perception that they can be productive and efficient when implementing security policies may find their employees at odds with their own policies. The employee perceived the situation as technological failure that prevented the work from being completed. This had significant consequences as the employee began to regularly copy data to an external device or via a personal email account to ensure he would be able to work. It is easy to criticize employees who violate security policies and argue they should be reprimanded or fired. However, in nearly every case in my interviews, the employees who violated policies did so to work around situations the company could have avoided though a more nuanced implementation that took productivity into account. In the particular case of the VPN, it was clear there were widespread problems with remote access that lad to undesirable methods of replicating data.

Companies would be rewarded with higher levels of job satisfaction and productivity if they took greater efforts to both explain security policies and ensure that users, especially mobile users, were not regularly prevented from communicating or managing documents. When companies did this, employees were appreciative of how productive the system allowed them to be while still mindful of the risks involved. Explaining the reasoning behind the policies and implementations goes a long way to improve compliance. In the now classic paper, “Users Are Not the Enemy” Adams and Sasse found that individuals did not have adequate understanding of security issues and that security mechanisms were not adequately explained to them. In addition, the authors found that security departments did not understand their users’ perceptions of security or their needs. The lack of understanding combined with lack of communication resulted in reduced security overall.

Many businesses could reduce the risk of compliance violations by taking into consideration their employees’ everyday communications needs and practices. Internal needs assessments, possibly including surveys and interviews, can be used to determine how well corporate needs for security and compliance align with employee’s work practices and other communications needs. Security policies and compliance systems that take social factors, work practices, and overall understanding of the reasoning behind the requirements into consideration will be far more effective than those that do not. Unfortunately, it seems that this is the exception and not the rule.

References

A. Adams and M. A. Sasse. Users are not the enemy. Communications of the ACM, 42(12):40–46, 1999.

D. Norman When Security Gets in the Way

You should follow me on Twitter.

The World Is Not Flat and Neither Are Social Networks

Ben Gross — Mon, 31 Oct 2011 17:12:15 +0000

Now that I and the rest of the Internet has grown accustomed to Google Plus and Facebook’s most recent friend categorization features, I thought it was time to revisit and revise a previously unpublished piece of mine. Take a moment and think about your friends, family, colleagues, friends of friends, acquaintances, and members of the same social club. These six groups could comprise a large part, but certainly not all, of the people that you know. You may also have extended family, classmates, common members of sports teams, religious associations, and the familiar strangers you recognize, but don’t know their names. To further complicate matters, the people in these groups often change over time as we move through life. How we conduct ourselves depends on the situation. It is highly unlikely that you act the same way around your grandmother as you do at a party with your friends and people do not expect you to act the same way. Your friends, work colleagues, and extended family do not all know each other and I suspect that in many cases you would like to keep it that way. For this reason, it seems odd to expect that our interactions in online social networks would be any different.

I had the final word in Erica Naone’s Technology Review article Can Google Get Social Networking Right?. Naone’s piece argues that Google needed to dramatically improve its social offerings to compete against Facebook. She asked me to comment on Google’s social services such as Buzz and Profiles and how they might interact with user’s search history. It is interesting to see how much the discussion has changed since the article appeared. Disclosure: I worked as an engineering intern on Google Accounts during 2005-2006, but this was well before any of Google’s social options existed. I responded with a discussion of broad problems I saw with social network services. The following quote in the Naone’s article mostly reflects my statements, although the quote makes it appear that I am singling out Facebook for criticism, which misses the point that I think this is a fundamental problem across many social networks.

“Facebook, meanwhile, has its own problems, and some of these could turn out to be opportunities for Google. Ben Gross, an expert in online identity, notes that Facebook and other social networks don’t accurately differentiate between people’s social connections, making their social graph information less valuable to users and advertisers. For example, social networks tend to put all of a user’s connections into a single group of “friends,” and expect users to manage complex privacy settings to sort out family, work connections, and bar buddies. “Social network services should not assume that networks are flat, or that people are willing to put in the effort to articulate these networks or that they even want to,” he says.”

My full response from which the quote was taken follows below. I fixed a few typos, but it is otherwise unedited.

“I see several consistent problems with many of the social network services. First, they often unify disparate social networks in ways that do not match people’s actual experience and may not even make sense to them. In order to have a real representation of people’s social networks, they would have to fully articulate these networks to the service, which is a pretty unnatural thing to do. For many people the edges of the network shift regularly. Most social network services do not make it easy to maintain multiple independent networks on the service. It is common for people to maintain independent social networks, where individuals may not want the networks unified and people may not even care or wish to know about the other networks. For example, one’s extended family vs. one’s work colleagues vs. one’s friends they have brunch with on the weekend. The idea that there is a single flat network is sort of ridiculous.

I often hear people say that people who want to maintain independent identities or networks are somehow up to no good. I have interviewed quite a few people about this topic for my dissertation. It’s clear that people’s lives are complicated and their identifiers and networks reflect this. If you think about it, it is not at all strange for someone to want to separate their work life, from their family life, from their friend, or all manner of combinations. The boundaries of these relationships shift and behaviors vary widely. Social network services should not assume that networks are flat, that people are willing to put in the effort to articulate these networks, or that they even want to. Also for many people, they may have portions of their network that they are connected to online and therefore the online representation of their network may be very skewed. Even if people are connected to multiple networks online, they may use different social network services for different social networks. For example, it is not at all unusual for people to primarily have email conversations with some connections, use AIM for others, Google Talk for others, SMS for another group, and Facebook for yet another. Each service would be missing the chunk of connections for the other service.”

You need context to create a meaningful representation of a person’s social network. To make matters worse, that context shifts constantly as do peoples social relations, particularly those with whom we have weak connections. This is why people often see online social network representations as a cartoonish view of their own complex and ever changing social worlds. This is not a new revelation about social relations. William James published the following in 1890.

Properly speaking, a man has as many social selves as there are individuals who recognize him and carry an image of him in their mind. To wound any one of these his images is to wound him. But as the individuals who carry the images fall naturally into classes, we may practically say that he has as many different social selves as there are distinct groups of persons about whose opinion he cares. He generally shows a different side of himself to each of these different groups. Many a youth who is demure enough before his parents and teachers, swears and swaggers like a pirate among his ‘tough’ young friends. We do not show ourselves to our children as to our club-companions, to our customers as to the laborers we employ, to our own masters and employers as to our intimate friends. From this there results what practically is a division of the man into several selves; and this may be a discordant splitting, as where one is afraid to let one set of his acquaintances know him as he is elsewhere; or it may be a perfectly harmonious division of labor, as where one tender to his children is stern to the soldiers or prisoners under his command.

It is important to recognize that forcing people to interact with their social relations as a flat network has many undesirable consequences. Figuring out how to restore a more natural balance to social relations is a grand challenge for social networks. People we think of as friends, enemies, and acquaintances change over time as friendships intensify and cool and we move through life phases. Also, complete visibility in networks is not always desirable or healthy. When we remove people’s choice to disclose their relationships and group memberships we strip them of something that is fundamentally human. We provide people with only one option for presenting themselves at a time denies them an important means of self-expression that is also fundamentally human.

I find it heartening to see how much has improved over the last year as both Google Plus and Facebook have dramatically improved the situation in allowing us more options to interact naturally with different social spheres. Framing choices about self presentation as choices about privacy misses the point that the issue is usually about context. Previously, the issue with online social networks was that they typically lacked this context. Far too often this forced people to articulate everyone that should be included or excluded from a particular interaction. In these cases, the cognitive overhead of potentially making this judgment for each interaction is staggeringly high. Unless you are a public figure, you likely never need to decide if what you say is appropriate or even remotely interesting to someone you went to grade school with, someone you went to college with, a work colleague, your aunt, your next door neighbor, and a dear friend. We should not force people to work this hard unnecessarily.

References

danah michele boyd. Friendster and publicly articulated social networking. In CHI ‘04 extended abstracts on Human factors in computing systems, pages 1279–1282, New York, NY, USA, 2004. ACM. Articulated Social Networks: An Ethnographic Study of Friendster

Erving Goffman. Presentation of Self in Everyday Life. Anchor Books, New York, 1959.

Francesca Grippa, Antonio Zilli, Robert Laubacher, and Peter A. Gloor. E-mail may not reflect the social network. In Proceedings of the North American Association for Computational Social and Organizational Science Conference, 2006.

Ido Guy, Michal Jacovi, Noga Meshulam, Inbal Ronen, and Elad Shahar. Public vs. private: Comparing public social network information with email. In CSCW ‘08: Proceedings of the ACM 2008 conference on Computer supported cooperative work, pages 393–402, New York, NY, USA, 2008. ACM

Kai Fischbach, Peter A. Gloor, and Detlef Schoder. Analysis of informal communication networks – a case study. Business & Information Systems Engineering, 1:140–149, 2009.

William James. The Principles of Psychology, volume 1. Henry Holt & Co., 1890

Hat tip to Gaurav Mishra whose similar titled article The World is Not Flat and Neither is the Social Web (site is currently offline), from 2008 I found after I finished writing this post.

You should follow me on Twitter.

Tracking, Geolocation and Digital Exhaust

Ben Gross — Wed, 12 Oct 2011 14:23:49 +0000

You are unique… In so many ways…

The accounting systems on which modern society depends are surveillance systems when viewed with another lens. All administrative, financial, logistics, public heath, and intelligence systems rely on the ability to track people, objects, and data. Efficiency and effectiveness in tracking have been greatly aided by improvements in data analysis, computational capabilities, and greater aggregations of data.

Advances in social network analysis, traffic analysis, fingerprinting, profiling, de-anonymization/re-identification, and behavioral modeling techniques have all contributed to better tracking capabilities. In addition, modern technological artifacts typically contain one or more unique hardware device identifiers. These identifiers—particularly in mobile devices, but also RFIDs, and soon Intelligent Vehicle-Highway Systems—are widespread, but also effectively unmodifiable and relatively unknown to most of their owners. For example, with mobile devices, each network interface (cellular, Bluetooth, WiFi) requires a minimum of one unique hardware identifier—all uniquely trackable. One hand, aggregating these unique identifiers allows services like Google, Skyhook, and others to associate geolocation data with WiFi access points and provide useful services. On the other hand, Samy Kamkar’s work described in Hack pinpoints where you live: How I met your girlfriend shows the potentially awkward and invasive side effects.

Individuals generate transactional data from common interactions offline such as card key systems and nearly every online transaction. Improvements in techniques to correlate disparate data as well as techniques to analyze the unique characteristics of software, hardware, network traffic to form a fingerprint is frequently unique. For example, a large-scale analysis of web browsers from the Panopticlick project showed that over 90% of seemingly common consumer configurations were effectively unique. IP geolocation data can be used to increase security as with Detecting Malice with ModSecurity: GeoLocation Data or it can be used in ways that are quite Creepy.

Another major shift is the widespread collection and aggregation of geolocation information from mobile devices. Location can be a highly unique identifier, even if the mobile device changes. Philippe Golle and Kurt Partridge show that two data points sampled during the day—one at home and one at work are enough to uniquely identify many individuals, even in anonymized data. Geolocation data can also reveal significant information about the people spend time with and a view of their social network. Jeff Jonas sums this up well in Your Movements Speak for Themselves: Space-Time Travel Data is Analytic Super-Food! In a sense the mobile phone has caused an enormous increase in uniquely identifiable data that can be used for tracking.

An average person now generates a constant stream of geolocation data that is collected by mobile carriers. Geolocation information is generated from cellular triangulation, geolocated IP addresses, and integrated GPS units, which deliver down to 10 meter accuracy. Geolocated mobile transaction data aggregated across multiple carriers is increasingly available for commercial use. It is possible to accurately track large numbers of individuals in constrained environments simply by sniffing the ITMI (temporary ID) as //p10 [dot] hostingprod [dot] com/ [at] spyblog [dot] org [dot] uk/blog/2008/05/20/path-intelligence-footpathtm-a-few-more-details.html">Path Intelligence does in mall, although they could sniff the IMEI just as easily, but they say they do not to protect privacy. Still, large-scale analysis of geolocation data is in its infancy. ReadWriteWeb describes how Developers Can Now Access Locations of 250 Million Phones Across U.S. Carriers

Tracking technologies—particularly when combined with geolocation information—have matured far beyond tracking individuals and are rapidly becoming capable of tracking groups and larger populations, which could be applied to entire enterprises or political organizations. Tools and techniques have made it feasible to correlate geolocation information, commercially aggregated profiles of online use, digital fingerprints, and offline transactional data. In addition, analysis of current anonymization techniques has repeatedly shown that simply adding another source of data is enough to re-identify a large percentage of the population. The Spatial Law and Policy blog is doing a nice job of tracking the policy implications of geolocation data.

The immense potential value of geolocation and other tracking data may well provide enough incentive for it to be used in ways counter to our own interests. Potential threats for misuse of the data need to be taken into account when designing systems. For example, what is the value of highly accurate logistical data about a US corporation derived from geolocation data and social network analysis to a foreign industrial competitor? Even a small amount of data that allowed a rudimentary analysis of external individuals meeting with internal high-level executives would be a worthwhile target. Similarly, both foreign industrial interests and foreign states may be willing to spend significant resources to acquire details on the movements and meetings of political parties.

More broadly I have been thinking about the question—What does it mean for a third-party to acquire better logistics about an organization than the organization has itself? What are the policy implications when and if these tracking tools are deployed in places without the rule of law, stable transitions of government, and low levels of corruption that we assume in the US? Could changes in the design and implementation of these systems mitigate the risks outlined? For example, should these design changes include internal controls, data scrubbing capabilities, and user interfaces that more clearly indicate a big picture of what data is being given off. Are there behavioral strategies that would reduce risks? To what extent can user education reduce risk?

You should follow me on Twitter.

Dragon Dictation Mobile: A Transcriber in Your Pocket

Ben Gross — Wed, 21 Sep 2011 15:37:17 +0000

Dragon Dictation is the mobile version of Nuance Communication’s flagship Dragon Dictate voice recognition product made for Apple iOS devices. Even after a year, using the application often makes me smile and think “It’s nice to live in the future.”

The simple user interface and high quality transcription are a winning combination. To use the application, you press the record button and start speaking until you are finished and then press the done button. That is all. The recording of your voice is sent to Nuance’s servers via Wi-Fi or cellular connection, processed and the text is returned to your application.

Once Dragon Dictation has finished transcribing, the application offers choices to send the transcribed text via an SMS message, email, Facebook, Twitter, or to copy the text to the clipboard. You may also edit the text using the built in keyboard after the transcription is complete. I was able to produce the first draft of this entire article using only Dragon dictate on my iPhone. In some ways the product is similar to the Mac Speech Transcribe application that allows you to take pre-recorded text and transcribe it after-the-fact.

Overall, the quality of the transcription is quite good and I recommended highly. Unlike the desktop version of Dragon Dictate, you don’t see the transcription until it is complete. This means there is no real-time feedback mechanism or method to edit or correct in real-time. The application does not require training to transcribe, but it will adapt to your voice over time and it is possible to correct mis-recognized words to improve future accuracy. You can record up to sixty seconds at a time, although Dragon will continue to append to existing text if you press record again. The application needs low levels of ambient noise. This unfortunately meant that I had limited success with transcriptions made while speaking and walking—a situation I find particularly useful. The Dragon Dictation support documentation is brief, but provides a set of useful tips and tricks for improving accuracy and listing the spoken commands for providing punctuation and movement commands.

The Dragon Dictation mobile application is available for the iPhone, iPad, and iPod Touch. Dragon Dictate for Email is available on BlackBerry App World. The product is currently free although it is ad-supported and advertisements for nuances own transcription products appear at the bottom of the screen but this has no impact on the usability in short if you are looking for an easy to use transcription pride on your mobile device DragonDictate mobile is an excellent option.

Paper in, PDF out: Fujitsu ScanSnap S1500M

Ben Gross — Wed, 07 Sep 2011 15:35:32 +0000

The Fujitsu ScanSnap line of scanners is an impressive combination of good design, usability, and smoothly integrated hardware and software. This is unfortunately a rare occurrence in business devices.The Fujitsu ScanSnap S1500 has earned a prominent place on my desk.

Simple and Straightforward to Use

The ScanSnap makes the process of converting stacks of paper into PDF files simple. It is a sheet-fed scanner—not much bigger than a toaster—that can process twenty pages a minute duplex. This means you can scan forty pages a minute if all your pages are double-sided. That is fast for a consumer device. The user interface for the scanner is a single button. The ScanSnap will scan color and gray scale documents at up 300 DPI and black and white documents at up to 600 DPI. The scanner connects via USB, there is no on or off button, if it is plugged in, it is on. When you close up the device it will go to sleep There are no options on the hardware to fiddle with, and it all just works.

The bundled software is large, but relatively painless to install. The sheet feeder is convenient, although it sometimes may grab a couple of sheets at one if the paper is in poor condition. The default output is PDF, you can optionally choose to OCR text from the scans, but this makes the process take considerably longer.

Bundled Software Is Obsolete

The ScanSnap is available in two models. A Mac version (white) the ScanSnap S1500M and a PC version (black) the S1500. Both models ship with the ScanSnap software (which can not be found online) in addition to ABBYY FineReader, Acrobat Professional, and business card scanning software. Cardiris for the Mac and CardMinder for Windows. Unfortunately, the bundled software is now mostly obsolete.

The Macintosh model includes a copy of ABBYY FineReader 4, Acrobat Professional 8, Cardiris 3.6 (upgradable to version 4). ABBY released FineReader Express Edition for Mac version 8 (they skipped a few versions) in 2010.However, Acrobat Professional 8 is more problematic as it does not work on recent versions of Mac OS X and it is now only useful for obtaining a discount on more recent versions. The Windows model of the S1500 ships with ABBYY FineReader 4, Acrobat Standard 9, and CardMinder 4.

The outdated versions make the bundle of hardware and software less attractive that when the product was not released. Acrobat does not offer combo updaters for versions of Acrobat prior to version 10, so I had to install many incremental updates individually and the older version of Adobe Updater can be finicky. Updating old version of Adobe Acrobat is overall a tiresome and unpleasant experience. Luckily, the most recent versions have improved dramatically. The downside is that the older versions are only useful as a discount for modern versions.

Overall Recommended

The ScanSnap S1500 and S1500m retail for $495. Fujitsu makes two other ScanSnap lines—A highly compact S1100 model ($199) meant for use while traveling, which scans about 8 pages a minute and a mid-range model, the S1300 ($295) that will scan 16 pages a minute. The S1100 and S1300 models only ship with the ScanSnap software and no third party software. All in all I highly recommend the ScanSnap S1500, my only significant complaint is the outdated bundle of software, in all other respects the scanner is an excellent product.

Callcentric Internet Phone Service Is a Solid Value

Ben Gross — Mon, 29 Aug 2011 15:35:23 +0000

After researching my options for an Internet phone service, I chose Callcentric. I have been happy with my selection, as the feature set meets my needs and both the service and the call quality have been good and reliable. My Callcentric number serves as my primary public number and I send most calls directly to voicemail, which I then receive both in both MP3 and transcribed form via the Phonetag service. I wrote about PhoneTag in Voicemail is Dead. Long Live Voicemai. Callcentric uses the widely supported SIP standard that is interoperable with many software-based and hardware-based VoIP phones.

Features

Overall I find the pricing quite reasonable for a secondary line. The phone number, E911 cost recovery fee, and my minutes are typically less than $4 a month total. Inbound calls are 1.5 cents a minute, outbound domestic calls are about 2 cents and the international rates are competitive. The service offers a respectable feature set that includes Caller ID with Name (CNAM), call forwarding, selective forwarding, simultaneous ring, call blocking, and voicemail, which can optionally receive via an email with a MP3 attachment. The service allows you to register multiple phone numbers for $1.95 a month each and you may assign multiple numbers for the outbound caller ID, although the configuration is somewhat complicated. The basic service allows for three incoming channels. Additional channels are $1 a month. Callcentric also offers business features such as SIP trunking and calling packages for call centers, IVR services, and conference rooms. In addition to the pay per minute options,

Callcentric has a few minor downsides. Numbers cannot receive SMSs and receiving faxes requires a separate number. The address book is weak. For example, each record can only contain one name field and one phone number field, so you must create multiple records for people with multiple phone numbers. The address book does not support numbers that contain a plus or a dash, which makes importing existing numbers more difficult. There is no import mechanism for vCard files. Fortunately, I manage my address book on my computer, which is also synched to my phone, so the Callcentric address book has not been an issue.

Callcentric on the iPhone

The Callcentric setup gives me the option use a SIP softphone or a hardware phone to turn it into a real phone line should I ever choose to do so. When I travel, I use an Acrobits SIP client on my iPhone (also offered in Android flavor). Groundwire for the iPhone, is Acrobits business oriented softphone that includes call transfer and attended transfer, call waiting, call conferencing and multiple lines. The Acrobits clients work well and user interface for configuring the SIP credentials is far more usable and streamlined than other products I have used. Callcentric recently released an iPhone VoIP Call back App that is similar to many low-cost call back services, but I prefer to use a standard SIP client.

Notes on Signing Up

Callcentric accepts local number portability transfers both in and out of the service. This means you can transfer any existing number to Callcentric or take your number with you if you leave, you are not locked in. Number portability is labor intensive and thus costs $25 per number.

If you choose to say that you live outside the US when you sign up, you won’t be charged the 911/E911 recovery fee. I don’t recommend this as cannot change this option and you would need to provision a new line to enable 911 service. However, if you are out of the country for an extended length of time you may enable 911 service on sign up and later specify that you are currently out of the US or Canada. I believe Callcentric will stop charging you the fee during that time. This should give you the option to turn it back on later, where the other one will not.

Callcentric Compared with. Google Voice

By any measure Google Voice is an impressive. Its SMS service is particular convenient its automated voicemail transcriptions are nearly instantaneous. I find the human transcription of PhoneTag far more reliable, but it does mean there is often a five-minute delay. When I first signed up with Callcentric Google Voice did not yet offer number portability. Google Voice still has significant restrictions on number portability and only mobile numbers can effectively ported into the service Port your number into Google Voice FAQ. Additionally, Google voice does not currently offer SIP connectivity, and this is one feature I appreciate with Callcentric as it allows me to use the service as a secondary phone line and to make outbound calls with the caller ID of my public number. It is possible to use services such as sipgate or Tropo to use your Google Voice service with SIP, but this complicates the process.

In addition to Callcentric’s pay per minute plan, they offer a personal domestic unlimited plan for $5.95, and office domestic unlimited plan for $8.95, a service provider unlimited plan for $19.95, and unlimited international plans starting at $24.95. Overall, I am very happy with Callcentric’s service and I recommend it.

Stop Hunching Over Your Laptop with the LapDawg X4

Ben Gross — Mon, 25 Apr 2011 18:52:36 +0000

Working on a laptop in locations without an ergonomic setup can be a serious pain in the neck. I mean that in the literal sense. People frequently work on laptops hunched over desks at work or from home in locations that span the home office desk, to the kitchen table, to the couch or even the bed. The problem that a few hours of responding to your email hunched over the laptop on a desk or table of the wrong height or from the couch can lead to a few hours of pain from working in positions that seem comfortable until you suddenly realize what you have done to your back and neck.

The LapDawg X4 is a potential solution that works well but has a few caveats. Let us start with the good parts. The LapDawg X4 has a large and solidly constructed metal tray attached to two legs with three joints on each leg that can rotate 360 degrees and lock in at 7.5-degree increments. You make adjustments to the legs by pushing in a button in the joint and selecting the angle of the joint. The fine-grained control gives you a many potential combinations to position the LapDawg to fit your current setting. The aluminum tray has ridges along the back and a rubber wrist guard along the bottom so you do not need to worry about your laptop slipping off. The LapDawg X4 works well as an ergonomic stand for your desk, as a lap desk for a chair, couch, or bed, or as a freestanding small table.

The biggest potential problem with the LapDawg X4 is that while the tray is very solidly constructed, the legs can feel somewhat shaky depending on the configuration and it is not hard to put the LapDawg X4 in a position that may be unstable for a laptop and allow it to flip backwards. The large size makes that it can hold even the most stately of laptops up to about 25 pounds of weight, this also means that it is 23” inches wide you need a substantial amount of space to accommodate the desk so measure your favorite narrow couch or chair first. The LapDawg X4 weighs a bit over 5 pounds itself so don’t plan on tossing into a bag and taking it to the café with you. None of these aspects may be a problem depending on your use.

The LapDawg X4 instruction sheet helpfully lists a number of common leg positions for the LapDawg, although there are many other possible options. I found the configuration I preferred the most was not one of those listed.

Overall, I would recommend the LapDawg X4 as an ergonomic desk stand or a lap desk that can accommodate many possible configurations. With a little practice in adjusting the legs, it is easy to find a configuration that is highly customized for your favorite working position, but you may want to pay attention the first few times to make sure it is stable. The LapDawg X4 costs $89 and comes with a lifetime guarantee.

Inbox Love – A New Conference on Email

Ben Gross — Mon, 14 Feb 2011 21:59:01 +0000

Inbox Love, a new conference on email, will be held on February 25th at the Microsoft Conference Center in Mountain View, California. The speakers and sessions look great. 500 Startups’ (Dave McClure) is producing the conference along with OtherInbox (Joshua Baer) and AwayFind (Jared Goralnick).

I attended and spoke at the pre-event meeting for Inbox Love in December. The attendees and speakers were excellent and it looks like the main event will be even better. I wrote about it in Inbox Love and Recent Innovation in Email.

If you had asked me a few years ago if I thought that in 2011 there would be a new email conference and a whole host of fantastic new email products and services, I would have said no. I’m happy to say that I would have been wrong. Registration for Inbox Love is now open.

Sessions at Inbox Love include:

The Implicit Social Graph
Inbox Infatuation: Will They Still Love Your Product in the Morning?
The Psychology of Behavioral Change: Proven results from 1 million+ emails that delight, engage, and influence users
WHEW! This Email Smells Bad…Has It Expired?
If They Mated: Email, Voice, SMS & The Next Generation of Communication
The Love Connection: Platforms & The Future of Consumer Email
The Love Connection: Platforms & The Future of Business Email
The Integration of Email & Social
Privacy vs. Personality: What’s in an Email Address?
NextGen Email Apps

The list of Speakers at Inbox Love includes:

Joshua Baer - Founder & CEO, OtherInbox
Victoria Bellotti - Principal Scientist & Manager at PARC
Bill Boebel - VP of Strategy, Rackspace
Jeff Bonforte - CEO, Xobni
Manlio Carrelli - CMO, Intermedia
Amy Ellis - Head of Integrations & Partnerships, MailChimp
Miriam Geller - Director of Product Management, Yahoo! Mail
Jared Goralnick - Founder & CEO, AwayFind.com
Auren Hoffman - CEO of Rapleaf
Fletcher Jones - Product Lead, AOL Mail
Pierre Khawand - Founder, People-OnTheGo
Jeff Lawson - Co-Founder & CEO, Twilio
Dan Martell - Co-founder, Flowtown
Dave McClure - Founding Partner, 500 Startups
Paul McDonald - Product Lead, Gmail
Scott McMullan - Google Apps Partner Lead for Google Enterprise
Josh Merchant - Co-Founder & CTO, Lymbix, Inc.
Alex Moore - CEO, Baydin
John Robb - Senior Director — Zimbra products & marketing, VMware
Isaac Saldana - Co-founder & CEO, SendGrid
Tom Sather - Email Deliverability Consultant, Return Path
Mark Schmulen - General Manager, Social Media, Constant Contact, Inc.
Ramit Sethi - Author, “I Will Teach You To Be Rich”
Jonathan B. Spira - CEO & Chief Analyst, Basex
Rahul Vohra - Co-founder & CEO, Rapportive

ForeverSave Prevents Lost Work on the Mac

Ben Gross — Mon, 31 Jan 2011 21:10:17 +0000

It’s happened to all of us. You are busy writing, entering data, or working on a slide deck and all of a sudden something freezes and then the application crashes. If either we recently saved the document all is well, otherwise the inevitable explicative follows. It is 2011 and there is no excuse for not having autosave, but there are still a depressing number of applications that do not automatically save documents. Blaming the user who lost work to an application or operating system crash is blaming the victim. People are far better served by applications that automatically name, save, and version their files without requiring manual intervention. This way users can easily undo or revert to an older version after application crashes, machine hangs, and power outages, no swearing like a sailor necessary.

Tool Force Software’s ForeverSave ($15) largely solves this problem for Mac OS X applications. ForeverSave allows you to configure the application to automatically save documents from many applications including Apple’s iWork, Microsoft Office, and most Adobe products. The configuration process is quick and straightforward. You simply select the applications that you want to enable autosave. There are options to save after a fixed time interval or when switching to another application.

ForeverSave can also automatically create backup copies of your documents. You can set the maximum number of backup copies and a maximum size for the backups overall. One advantage of multiple backup copies is that it is that you can quickly preview old versions of the document with QuickLook. Restoring an old version is a one click operation. One interesting feature is database sharing. This allows you to share all the historical versions of a document, which is useful to show a colleague how a project evolved over time.

If you use any of Apple’s iWork applications including Keynote, Pages, and Numbers, then you absolutely want to use ForeverSave. The applications in iWork are well designed and I use them often, but unfortunately, as of the most recent version iWork ‘09, Apple has not seen fit to include an autosave feature. Each of the applications crash periodically, It also means that you have lost any work form the last time you remembered to manually save. If you have not named and saved the document at all yet, then everything is gone.

When an iWork applications crashes, all remnants of unsaved work is gone. After a recent crash with Keynote, I decided to experiment to see if I could find any traces on my file system. I scanned my temp files and the swap files and found nothing other than the images in the document. This is a terrible oversight and I expect better from some of Apple’s high-profile applications. Judging from the many complaints I found on the Apple discussion boards and elsewhere online, I’m not remotely alone.

Overall I highly recommend ForeverSave, the price is well worth the insurance against lost work. I experience two annoyances when using the application. First, saving is a blocking operation in the iWork applications, so if you have a large document such as a Keynote slide deck with many slides it will force you to wait each time it saves the document. This is technically the fault of iWork and not ForeverSave, but it is still a detractor. The second annoyance is that ForeverSave requires you to name the document the first time. This typically comes up when I start to work on a document and right when I get into a flow, then the save window pops up asking me to name the file the first time so it can save. I would rather the application not interrupt me and simply pick a reasonable name and let me rename it later.

ForeverSave is $15 and has a 30-day trial. ForeverSave Lite is a stripped down version that offers autosaving only, without backups, versions, QuickLook, or database sharing.

2011 CEAS Conference Call for Papers

Ben Gross — Mon, 24 Jan 2011 22:31:27 +0000

CEAS 2011–the Collaboration, Electronic messaging, Anti-Abuse and Spam Conference will be held in Perth in Australia September 1-2, 2011. This will be the 8th annual gathering for the event formerly known as the Conference on Email and Anti-Spam. Curtin University’s Anti Spam Research Lab in the Digital Ecosystems & Business Intelligence Institute will host the conference.

There are nine conference tracks:

Email Spam
Web Spam & Spam 2.0
Spam & Security in Social Networks
Cyber Crime
Spam Economics
Network Security
Information Technology Security
Security Technologies
Security Management

The CEAS call for papers is available as Word and PDF document, although not as HTML. The relevant dates for potential authors are:

Abstract deadline: April 5, 2011
Submission deadline: April 15, 2011
Author notifications: June 15, 2011
Final accepted papers due: Aug 15, 2011

Proceedings including the full text of papers from previous CEAS conferences are available from the ceas.cc site, which has not been updated to include material for the 2011 conference.

Time Machine vs. CrashPlan for Backups

Ben Gross — Mon, 10 Jan 2011 20:55:28 +0000

Trouble in Time Machine Land

In my recent article, A Simple and Effective Backup Strategy for Mac OS X, where I recommended a three part backup system:

a full disk clone,
local incremental backups with Apple’s Time Machine, and
networked incremental backups with CrashPlan.

I found Time Machine problematic for my own setup, for reasons I explain below, so I now use CrashPlan for both local and networked backups.

For most people with configurations that are not highly customized or complicated, Time Machine is a great “set and forget backup” solution. The primary interface is a single on or off toggle switch. Its ease of use can make the difference between having backups and not having backups for many. At the same time, Time Machine has some notable quirks and limitations that can make it far less desirable in some circumstances. In these cases CrashPlan provides a solid alternative for local backups in addition to network backups. CrashPlan also has the advantage that it works equally well on Windows and Linux.

Clones Are Key to Fast Recovery Time

Let me emphasize that maintaining a recent clone is the key for you to rapidly recover your data in the case of a disk failure or theft. Most incremental backup solutions, including Time Machine and CrashPlan, do not backup your entire computer including all the system files and boot records. This means that you must first reinstall your operating system and then restore your files from the incremental backup on to the newly installed operating system.

The process of recovering from a disk failure with a clone is much faster and more efficient since you can connect your cloned disk and boot from it. You computer will be in the same state as it was when you made the clone. You will only have to restore files that have changed since you last made the clone. No other recovery process is nearly as quick recent clone and an incremental backup. The difference is substantial.

Advantages of Time Machine

It’s free, supported by Apple and ships with every copy of Mac OS X
The setup is impressively simple and it generally just works after that
The overall user experience for backup and recovery is substantially better than most alternatives
You can manually mount a Time Machine disk on any computer and copy files from it

Disadvantages of Time Machine

When you restore from a Time Machine disk, the backup is invalidated and you must start your backups anew
Time Machine only backs up changes to your files once an hour, so there is always a potential lag in your backups
If you use FileVault, Time Machine will only backup your home directory when you log out
If you use FileVault, you can only restore your entire home directory (missing out on the great restore interface) unless your home directory is on Mac OS X Server
Time Machine can get confused if you plug more than one Time Machine backup disk into the computer
Moving a backup to a new computer is a complicated process and typically requires editing system files

Personal Observations About Time Machine

The combination of FileVault and Time Machine makes logging out very slow
I found the Time Machine volume occasionally got corrupted and I would have start over
Time Machine would sometimes cause large amounts of disk IO with high memory usage that substantially slow my machine down. This would typically happen after longer periods of not backing up due to travel etc.

Advantages of CrashPlan

Backups are continuous and files are backed up as soon as they change (note while CrashPlan can be used in local mode for free, continuous backups require a subscription to CrashPlan Central)
All backups are encrypted by default
Straightforward to configure multiple local and networked backup destinations

Disadvantages of CrashPlan

You must use the CrashPlan software to restore a backup, it needs to be installed first for recovery
Higher memory usage with 64-bit Java on Snow Leopard (see note below)
User interface is functional but, not nearly as nice as Time Machine, it’s also a bit slow to start up
If you use FileVault, you must be logged as the FileVault user for backups to happen

Personal Observations About CrashPlan

Simple fix improves memory usage
Appears to have much smaller impact on my system resources once memory is reduced
FileVault complicates install process

Notes on Reducing CrashPlan Memory Usage

I found that CrashPlan could use up significant amounts of memory with the 64-bit Java on Snow Leopard. The most recent version of CrashPlan places a 512 MB memory limit on the process, but that is still quite large. I limit my to CrashPlan process to 150 MB and it has not caused any problems, although this is lower than you will generally see recommended and you will want to carefully monitor your logs to look for memory errors if you set it this low. This post CrashPlan using too much memory on Mac OS X from offTheHill explains how to reduce the memory footprint of CrashPlan.

Evaluating the Usefulness of Quora for Email Topics

Ben Gross — Wed, 05 Jan 2011 00:10:11 +0000

Quora is an online question and answer service founded by former Facebook employees that has received high marks for overall quality of questions and responses compared to many of its competitors. Quora originally launched as a private beta early in 2010 and opened to the public in July 2010.

The service has since gained several hundred thousand users; although reports vary between 200 and 500 thousand users. Quora also recently experienced significant performance problems. The service has received additional attention due to founders and executives candidly responding to questions about their company or former company on Quora. Here is a brief look at the state of email related questions on Quora.

Top Level Categories for Email on Quora

Underneath these broad top-level categories, the hierarchy is limited. For example, the only server-based products with their own categories are: Postfix, Qmail, Microsoft Exchange, and Exim. Quora users are free to create their own categories, so the existing ones imply some level of topic interest, at least by users willing and able to create new categories. Some categories such as Email Statistics only have one question. The full hierarchy is available at Email Ontology page on Quora.

Gmail has the largest number of subtopics:

Each item in Quora is actually represented by a unique name so the URL structure is flat similar to Wikipedia. For example:

The quality of the questions and the quality of answers–for questions that receive answers–varies widely. For example, the question “Is there any Linux email client that will work with Exchange 2010?” received seven answers, most of them brief. A more specific question “Can you create bespoke merge tags in MailChimp or other ESPs?” received slightly more specific answers. On the other hand, the author of the question “What is qmail?” could have easily answered his own question with a single query on Google or even a glance at Wikipedia, which has a healthy Qmail entry. The question still received a reasonable, but brief answer.

In general, Quora seems to not be the best place to answer specific technical questions about email products and services, but it may be worth a quick check. Vendors and service providers may also want to consider responding to questions, although most established products hopefully already have a well-supported forum where users can ask and receive answers to technical problems.

Quora is still young and the developers and community will need to actively work to continue keep the quality of questions and answers high. Hopefully, Quora will also develop a more sophisticated search mechanism with filtering controls. I personally find the combined search and navigation box unnecessarily difficult to work with. The AJAX is too complicated and I have to regularly reload the page in order to clear a result. The way it currently steal mouse focus is annoying. Overall I have found Quora an interesting source and I look forward to watching it develop.

A Simple and Effective Backup Strategy for Mac OS X

Ben Gross — Fri, 10 Dec 2010 21:34:41 +0000

Disk is inexpensive compared to the value of your time and data. My personal backup configuration consists of three types of backups. The following combination has proven itself over the last several years and I recommend it. It includes 1) A full disk clone, 2) an incremental backup, and 3) an online backup service. This setup is redundant, quick to configure, needs little maintenance, and allows for rapid recovery of data, even with a catastrophic failure.

Details of the three part backup strategy:

A clone is a replica of your disk. One great feature of Mac OS X is that you can boot directly from a clone. This means if your hard drive dies, you can reboot from a clone on an external drive and be back to work in minutes rather than hours. I recommend SuperDuper ($28) as the user interface is very well done. Carbon Copy Cloner is an excellent alternative that is free to use, although the author encourages donations. Both applications support scheduling backups for a time when your system is not in use. Both applications also support incremental updates to substantially reduce the amount of time needed for subsequent backups. The hard drive for your clone must be as large as the amount of data you wish to back up.
An incremental backup application called Time Machine ships with every copy of Mac OS X that archives any file changes every hour. Time Machine has a unique time-based interface that allows you to easily find and restore previous versions of files. Overall, Time Machine is simple to use and works well unattended, but it does have several detractors. First, if you have a hard disk crash, you must manually reinstall the base operating system from the DVD and then use Time Machine to a restore the rest of your data. This makes time machine most useful in cases of accidental file deletion or data corruption. Time Machine works very well when combined with a clone as you can quickly restore from a clone and use Time Machine to restore any files more recent than the clone version. Time Machine is far less useful on drives with FileVault enabled. I recommend giving Time Machine at least two times as much hard drive space as the amount of data you want to back up.
An online backup service allows you to have offsite backups for cases of theft, natural disaster, or large mugs of coffee. Online services also allow laptop users to continue to make backups in any place that has a network connection. I have used the CrashPlan service for about 18 months and I find the service reasonably priced and reliable. CrashPlan automatically archives file changes in real-time and encrypts all backups. This is nice if you use it on a laptop because it means that you have backups even when you travel. CrashPlan also allows online restores from a web-based interface. The unlimited service is $25 a year for a 10GB service, $50 a year for unlimited service for one computer, and $120 a year for a family unlimited plan for up to ten computers. Multiyear subscriptions are discounted.

CrashPlan has a backup seeding service for $125 where they send you a 1TB drive. You then run the initial backup locally and ship the drive back to CrashPlan. Depending on the size of your disk and the speed of your network connection, the initial backup can easily take weeks. Companion emergency recovery services are also $125. Expedited shipping is extra. CrashPlan also offers a computer-to-computer backup mode. This means you could backup to another machine in your house or to a computer in a friend’s house. The computer-to-computer backup feature is free. The paid version provides real-time versioning with fine-grained control over the versioning settings, stronger encryption, the ability to restore from the web, and the client is ad-free. CrashPlan works with Mac OS X, Microsoft Windows, and Linux operating systems

I last wrote about backup options in We Need Simple Backup Solutions for Complicated Data.

You should follow me on Twitter.

Inbox Love and Recent Innovation in Email

Ben Gross — Tue, 30 Nov 2010 15:41:23 +0000

A Whirlwind Tour of Recent Email Developments

Even casual email industry observers will have noticed an impressive number of new email related announcements. I have not seen as much innovation in email products from many different vendors in a long time. I was fortunate to attend the recent Inbox Love private launch event that included participants from both large companies and startups all working on email projects. I gave a presentation on “Three Myths of Email and Identity” that I’ll talk more about in a later column. The public Inbox Love conference will be in Spring 2011 in the SF Bay Area and the call for speakers is now open.

The event was a refreshing change from the Email is dead, as IM, SMS, social networks, etc. will kill it discussion. New channels always change and fragment communications options, but rarely does a widespread media disappear overnight. Tomas Nonnenmacher’s History of the U.S. Telegraph Industry points out that Western Union did not even divest itself of its telegraph infrastructure until 1988.

Facebook

Without a doubt the announcement of the new Facebook Messaging platform generated the most buzz. The service is still in testing and not open to the public. Two official blog posts from Facebook engineers provide more details. Joel Seligstein’s See the Messages that Matter and Kannan Muthukkaruppan’s The Underlying Technology of Messages are both worth reading. The Facebook Messages main page offers a brief visual tour and the option to request an invitation. Facebook Help Center for Messages should answer most common questions.

Google

Google released a series of new email features including the Gmail Priority Inbox, which segments email into three categories–an automagic category of important and unread messages, a category for starred messages, and a remainder category. The Official Gmail Blog post Email overload? Try Priority Inbox by Doug Aberdeen offers more detail and a video explaining how priority inbox work. Finally, the Gmail Help page for Priority Inbox should answer most questions about the product.

In the mobile realm, Google user experience designer Brett Lider explain how the Gmail web client for mobile Safari acts more like a native application

Gmail for Android team members discuss the updated Gmail app in Android Market. This is a welcome development as it means that Android users no longer have to wait for carrier updates, which can be slow to non-existent to run the latest version of Gmail on Android devices.

The announcement for the Google Apps Marketplace describes how developers can increase the reach by listing products and services on the Google Apps Marketplace. Here is the result for listing for the query “email” on the Google Apps Marketplace since it does not have a category on its own. Finally, while the service was announced in May, many seemed to have missed the release of Google Apps Script, which is a JavaScript-based scripting language for automating Google’s applications in the cloud that includes email services.

Yahoo

The latest Yahoo! Mail Beta that includes a redesigned interface that is faster, more mobile friendly, integrated with Twitter, and includes support for Applications. You can find more details in the Yahoo! Mail overview and Yahoo! Mail features page. Yahoo VP of Engineering, Mike Curtis, describes the new features including the apps in his post Yahoo! Mail Beta technology update More information on Applications in Yahoo! Mail is available in the post Yahoo! Mail is Open for Development on the Yahoo Developer Network.

AOL

AOL announced it’s upcoming Project Phoenix, offers a modern webmail experience which will be a welcome update to users of AOL Mail service. [Project Phoenix still requires an invitation] (http://phoenix.aol.com/), but it should be available to the general public by early next year. Business Insider offers a walkthrough in Here’s What We Think About AOL’s New E-Mail Service.

More Innovation and New Email Startups

MailChimp has been around far too long to be a startup, but it has only recently gained more widespread attention. Their API is full featured and in order to encourage developers to use it they have announced $1 Million Integration Fund .

Postbox builds an impressive number of features on top of the Mozilla Thunderbird code base. The recent major update Postbox 2 adds more options for grouping, including unified accounts, task management, and quick replies.

The organizers of the Inbox Love have email related startups of their own. Jared Goralnick is founder of the AwayFind service and Joshua Baer is cofounder of the OtherInbox service. Both companies offer options email organization and prioritization. AwayFind specializes in prioritization and notifications the service will contact you by text message, IM, or Twitter Direct Message if you receive messages from an important contact. The service can even call you and read your message using text to speech. OtherInbox specializes in prioritizing and filtering email and notifying you of important messages.

Let me know what else I missed.

You should follow me on Twitter.

12 Checklists to Reduce Errors in Email Campaigns

Ben Gross — Tue, 02 Nov 2010 16:58:02 +0000

Why Checklists Matter

Realizing that you made an easily preventable mistake just after sending out your email campaign is incredibly frustrating experience. Errors in email campaigns can reduce deliverability, limit open rates, and confuse customers. Unfortunately, it happens to everyone.

Checklists are a simple and effective way to significantly reduce errors even though they sometimes feel unnecessary or overbearing. Noted surgeon and author Atul Gawande wrote an excellent article for the New Yorker in 2007 titled The Checklist describing the substantial reduction in errors that checklist brought to medicine and piloting airplanes. The article is well worth the read as is Gawande’s 2009 book-length treatment of the topic The Checklist Manifesto: How to Get Things Right includes examples from the restaurant and construction industries.

While checklists may seem critical for tasks where lives are at stake, they’re very useful for many tasks. For example, Jon Udell talks about using checklists for software development and web development.

Gawande notes that the research on checklists has shown that effective checklists focus on brevity and readability and not completeness. Checklists work best when they only important items that are likely to be missed. Gawande says that effective checklists must be tested and refined. He has even produced a Checklist for Checklists .

Checklists for Email Campaigns

Executing a well-done email campaign is a complex endeavor with many subparts. The unique characteristics of both your list and your organization will mean that there is likely no single existing list that will be a perfect fit for you. Here are XXX checklists for you to use as a guide for creating your own checklist. Many of these checklists have substantial overlap, but by looking at multiple lists you are more likely to find one that is a better starting point.

Checklists for Avoiding Common Pitfalls

10-Point Email Quality-Control Checklist from Lyris focuses on potential errors when constructing email messages.

Targeted Email Advertising Checklist from Alex Cohen has a good all-around set of recommendations.

Prelaunch Email Campaign Checklist from the V12 Group collects important items to check before you send your campaign.

TailoredMail Email Campaign Checklist (PDF) is an extensive list of items to check before sending out your campaign.

Before You Hit “Send,” Consult Your email Checklist from ClickZ includes a good set of important points worth considering for your own list.

Annual Email Marketing Strategy Review Checklist from MailerMailer is a nice collection to help you step back and review your email campaign strategy.

Deliverability and CAN-SPAM Checklists

Lyris’ Opt-In Email Marketer’s Checklist for Inbox Delivery (PDF) is a 10 point list to help you ensure that your messages reach your recipients inboxes.

A Daily Checklist For Deliverability 07/07/2010 from MediaPost includes important high-level points you should regularly consider about the deliverability of your campaigns.

phplist Documentation: Tasks to do before you send your first email is an solid checklist of technical points to verify before sending your email.

A CAN-SPAM Checklist from Mickey Chandler is good checklist for CAN-SPAM compliance.

Complying With CAN-SPAM: A 10-Point Checklist for Marketers from ClickZ is from 2004, but still a still a useful list.

Email Failed: A checklist & Analysis on cause of Email Failure from the Bravo Technology Center is a terse list of factors to investigate for email problems not exclusive to email marketing campaigns.

How and Why to Sniff Smartphone Network Traffic

Ben Gross — Wed, 27 Oct 2010 21:36:36 +0000

Smartphone Network Connection Monitoring

Tools for monitoring and modifying connections between web browsers and web servers are essential for debugging, testing, optimizing performance, and assessing vulnerabilities of web-based applications and native applications. Developers, security professionals, and anyone with an interest in gaining insight into the lower levels of web traffic commonly use these tools.

There are many mature options for monitoring connections from desktop machines. Unfortunately, there are fewer tools to monitor connections on smartphones and these tools often require more complex configurations, as the monitoring software must run on a separate device. In this article, I present an overview of tools and methods for monitoring network connections on Smartphones including devices based on Apple’s iOS–iPhone, iPod Touch, iPad), Google’s Android OS, BlackBerry OS, and Symbian. This article focuses on inspecting HTTP and HTTPS traffic, although many of the tools and techniques described work equally well to analyze other protocols.

This article is the first part in a series: The articles in the series include:

An overview of the tools and techniques for monitoring smartphone network connection
Pros, cons, and limitations for monitoring smartphone network connections
Network monitoring for security analysis and self-defense

Why Monitoring is Useful

Potential use cases for monitoring HTTP and HTTPS traffic–the two primary protocols of the Web:

Inspecting network traffic often simplifies debugging AJAX XMLHttpRequest requests, compressed content encoding, and cookies.
Network connection details such as number of HTTP requests, DNS lookups, cache hits are also valuable for optimizing web application performance.
Many tools allow modifying requests and responses to simulate valid and invalid user input when testing applications for vulnerability analysis in addition to monitoring.
Network monitoring is an effective way to verify that a smartphone application securely handles user authentication and identify any inappropriate transmission of personally identifiable information such as unique identifiers and location.
Inspecting and modifying network traffic is essential for security analysis. For example, searching for Cross Site Scripting (XSS), SQL injection, and path traversal vulnerabilities.

Types of Monitoring Tools

Common network monitoring tools come in four major varieties: browser-based development tools, general purpose packet sniffers and network protocol analyzers, specialized HTTP/HTTPS sniffers, and specialized web proxies for debugging and security analysis.

Each type of tool has advantages and disadvantages, but there is no requirement to use a single type and combinations of tools may offer more power and flexibility. This list is in no way comprehensive, there are many specialized and hybrid tools for monitoring connections.

Browser-based development tools such as the WebKit Web Inspector in Safari and Chrome or the Firebug LiveHTTPHeaders extensions for Firefox
General purpose packet sniffers such as the cross-platform Wireshark, Colasoft Capsa Network Analyzer and the venerable command line tcpdump
Specialized HTTP/HTTPS sniffers such as HTTP Scoop on the Mac OS X or IEInspector HTTP Analyzer on Windows
Specialized web proxies used for debugging and security analysis such as the Java-based cross-platform Charles Web Debugging Proxy, Andiparos (an actively developed fork of the Paros Proxy), Burp Proxy and the .NET-based Fiddler2 Web Debugging Proxy for Windows.
Server access logs are also useful for debugging. Think of them a bonus fifth tool.

Two LiveCD Linux distributions contain a large number of tools optimized for penetration testing a subset of which is useful for network connection monitoring. BackTrack Linux is a very well-regarded distribution. AppSecLive the OWASP Live CD Project–soon to be known as the OWASP Web Testing Environment (WTE)–is another respected collection.

See the Top 100 Network Security Tools from SecTools.org provides a larger list.

Configurations for Monitoring

I’ll talk more about the constraints and pros and cons for each option in the second piece of this article, but briefly here are several potential configurations for monitoring.

Simulators allow the simplest configurations where the simulator and the monitoring software run on the same machine and share a common network interface.
Web proxies are a convenient option as all modern browsers supported them and only require a small change in the browser settings rather than a change in the network configuration.
Ad-hoc networks combined with internet connection sharing are one method to gain access to traffic. If the network monitoring host is located between the mobile device and the internet, it will typically require two network interfaces, usually one wired and one wireless.
Network hubs are one method to work around the problems with common switched network configurations.

Limitations for Monitoring

There are significant constraints for monitoring network connections. I’m specially talking about WiFi-based traffic and not cellular traffic. Monitoring cellular traffic is substantially more complicated and requires specialized equipment. In nearly every case, all important web-related traffic will travel over WiFi if the cellular data connection is disabled on the device.

Limited software is one constraint. For example, there is currently no way to run Webkit Web Inspector, Firebug or LiveHTTPHeaders directly on a Smartphone. Limited networking options is adds another constraint as well as added complexity to the monitoring configuration. Typically, smartphones must communicate over wireless connections rather than wired connections, which eliminates some options for monitoring network traffic. Most modern network hardware is switched, which further limits the ability to access the traffic, even when an access point is plugged into a wired network. Additionally, wireless access points protected by WPA/WPA2 encryption employ per-user keys difficulties in sniffing are similar to switched networks.

Finally, monitoring connections encrypted with SSL/TLS also requires more complex configurations. The most straightforward option involves adding a new Certificate Authority to the trusted list in the browser. This effectively creates a man-in-the-middle attack for the browser that allows decryption of the HTTPS traffic. The browser will produce a series of warning messages, but it will be possible to view the encrypted traffic.

Security Enhancements for Google Apps Users

Ben Gross — Tue, 05 Oct 2010 21:56:04 +0000

Recent announcements could improve the security of desktop, mobile, and web-based applications for many Google Apps users and administrators . OAuth support for Google Apps APIs will improve the security for Google Apps administrators since they will be able to authenticate via OAuth. Previously domain administrators needed to sign API calls with their username and password. Supported APIs include: Provisioning API, Email Migration API, Admin Settings API, Calendar Resource API, Email Settings API, and the Audit API.

Lori MacVittie at F5 DevCentral is skeptical that Google’s use of OAuth is substantially more secure than the ClientLogin model since in the end OAuth requires the same username and password combination that ClientLogin does and is only as strong as the administrator’s password. She does agree that the ability to expire OAuth tokens does make it less susceptible to replay attacks and that offering more granular authorization permissions is an improvement.

Google also announced two-factor authentication for individual Google Apps users. This adds a second factor challenge to the login process, which should help to protect users from phishing attacks and other types of abuse. Previous options for two-factor authentication were significantly more complicated to deploy which meant they were effectively only available to enterprise customers. Google offers four options for delivering the second factor.

As a SMS message that will be familiar to many users of online banking
As a voice call, which would also work with a landline phone
As a smartphone-based token called Google Authenticator
As printed one-time use tokens reminiscent of S/KEY password system.

The domain administrator must enable two-factor authentication, after which users may optionally enable the second factor in their own account. Each device and browser requires its own verification for two-step authentication. Google treats two-factor authentication differently in browser-based applications than in mobile and desktop applications. In browser-based applications users input the verification code into a secondary password screen. The user may optionally check the “Remember verification for this computer” box which sets a browser cookie so that verification is only required every thirty days.

In mobile and desktop applications such as Outlook or Thunderbird, there is no option for a secondary password. In these cases, an access code replaces the password. Each application on each device needs a separate access code. As long as the user opts for the application to remember the password or stay signed in, the access is only required the first time. Google says access codes should never be used on a web page only on desktop or mobile applications.

Google Authenticator is a smartphone-based two-factor token generator for Android, iPhone, and Blackberry devices. The software is open source and relies on the standard RFC 4226 - HOTP: An HMAC-Based One-Time Password Algorithm.

Both OAuth authenticated APIs and two-factor authentication is available to all classes of Google Apps uses other than the free Standard edition. Google has said it will eventually offer two-factor authentication to all users of Google Apps.

New Twitter; Apple Announces Ping; Google Instant; Google Priority Inbox; Bing Surpasses Yahoo!

Ben Gross — Thu, 30 Sep 2010 18:15:12 +0000

Twitter received substantial coverage when it announced New Twitter, which includes a substantial redesign, support for viewing embedded media, more recommendations for related content, and expanded in-page profiles when you click on a profile. The redesign was well received, although Twitter chose a conservative rollout strategy for New Twitter, so many users have not yet received the new interface.

Apple released Ping, a social network for music, along with iTunes 10. The service was widely anticipated, but received a mixed initial reception although the service was quickly updated to improve some of the initial faults. Given Apple’s dominant position in digital music position, it will be interesting to see how the service fares.

Two recent Google projects reached the mainstream media. Google Instant is a major evolutionary step over the previous auto complete as you type feature in the Google search box. Google Instant displays matching search results for queries in real-time as you type. The Google Transparency Report launched in April and displayed government requests to remove content from Google services from governments around the world. Google recently added a Transparency Traffic Report that shows which networks around the world block specific Google services. The report includes both current and historical information. At the end of last month, Google announce Gmail Priority Inbox that attempts to automatically sort your most important messages into a top section, followed by your starred messages, and then the remaining messages in a third section.

Yahoo! announced an upcoming Yahoo! Mail beta with a cleaner and faster interface, social network integration and productivity features including one similar to the new Gmail priority inbox.

In the End of the Road for Xmarks, the CEO of the popular service used to synchronize bookmarks across browsers announced on its blog that it was shutting down due to lack of a viable business model even though it had two million users. The post, comments, and related conversations around the net are worth reading as they show that growing a large satisfied user-base is not enough to produce a viable income stream. The impassioned pleas of users saying they were willing to pay caused the company to rethink shutting down and Xmarks is now collecting data on the number of users willing to pay $10 a year for the service. The CEO discusses potential new business models in his latest post Xmarks is Dead. Long Live Xmarks? The service currently has high operating costs, so it will be interesting to see how Xmarks proceeds.

HDCP, short for High-bandwidth Digital Content Protection, is a type of DRM used in many common consumer devices including HD TVs, digital projects, DVD players, and Blu-ray players. Initial reports speculated that someone had either leaked or reverse engineered a master key capable of generating a cryptographic key pair capable of playing any HDCP protected content without a license. Intel, the developer of HDCP, confirmed the authenticity of the key. Ed Felton wrote an informative post on Understanding the HDCP Master Key Leak where he argues that it will make little difference to the average consumer.

Earlier this month, the Nielsen Company announced that Bing had narrowly passed Yahoo! as the second place search engine in the US. Neilson reports that Google’s share of the US search market is 65.1%, Bing–including MSN and Windows Live search–came in second with 13.9%; Yahoo! came in third place with13.1%. Ask and AOL is are in distant fourth and fifth places with 2.1% and 2.0% of the US search market. ComScore reported that users spent slightly more time on Facebook than Google. The report said that out of the 413 million minutes users spent online in August, Facebook came in first place with 41.1 million minutes; Google properties came second with 39.7 million minutes; and Yahoo in a close third place with 37.7 million minutes. What is interesting is that there is no clear leader and the spread between the three major properties is narrow.