When one is scoping out a web project, one of the first requirements that a designer/web programmer will want to know is “what browsers are we supporting?”. The decision is usually led by a quick googling to find a page like the W3C’s which quickly tells you:

Over 30.8% of the browser world belongs to IE (much better than the way things were just a few years ago). Almost 15% of your users are using such an old version of IE that you may be tempted to code using IE6 or 7 as your least common denominator.

Browser usage by Infochimps users

Consider who is visiting your site though. Are your users more net savvy? Are they geeks? Here’s what our visitors use:

About 10% of infochimps.org users use IE, almost a third of the norm.
Half of our IE users use IE8 (a much more capable version of IE) leaving a meager 5% in the IE6/7 realm, which is split half and half (2.5% total IE6 users – again, almost a third of the normal).

Conclusion: Real nerds don’t use Internet Explorer

As far as design philosophy goes, we strive to design our sites (infochimps.org, api.infochimps.com) in a progressive enhancement fashion so that all browsers can be supported well (enough) and accessibility is simple and works. IE6 isn’t number one on our list of things to deal with.

When you have limited resources (like a startup), consider who is actually using your site before spending resources on that group.

http://github.com/infochimps/stronglinks-example
http://github.com/ioda006/lsrc-jekyll

Find the notes in /presentation for stronglinks-example. All slides are done with S5/Operashow and can be viewed with Firefox and Opera by opening the show.html file and pressing F11. Use pageup/pagedown to navigate.

Seeing Data

Beautiful Data: Interactive Visualization of Social Media

What are the different methods in which data can be displayed and what tools are used to create them? What are the benfits and practical uses of presenting data visually? Finally, what are the most exicting and innovative specimens of data visualization erected around social data?

Social Media Data Visualization: Mapping the World’s Conversations

All about Infographics. How are Infographics constructed and what information can they convey beyond that of raw data?

Exploring Data

Data Overload: Probabilistic Computing For Breakthrough Data Analytics

What is probabilistic computing and how does it differ from more common types of programming? How does probabilistic computing fit into other data analysis tools?

Making Sense of Social Media Data

Explains the ins-and-outs of social media monitoring tools, the techniques that work and realistic expectations of what they can deliver.

Managing Data

Big Data for Everyone (No Data Scientists Required)

What makes Big Data so darn big? Topics of discussion range from (the necessity of) non-traditional solutions to handling Big Data, how those solutions fit into existing architecture, and common pitfalls encountered.

A Showdown at the Database Corral

Oh yes, there are a new sheriffs in town. They answer to Casandra, Drivel, and Drupal. Panelists will talk about case scenarios for each, their relation to traditional, distributed, and non-relational databases, in addition to other topics of interest for folks with their head in the clouds.

Data Nerds, Is Big Data Crushing the Web?

How does a business discern differences between Hadoop, bulk raw data and web crawlers as big data solutions? How does the average non-programmer tap into big data’s value? What sorts of tools are available to access big data, and what are their differences? What problems with our current business systems can be fixed to more manageable handle big data? Is it feasible to make big data repositories open source?

Humanizing Data

What the F*** is the Semantic Web

Good question! In this panel geared for everyone with a soupçon of curiosity and a brain, the Semantic Web is defined and discussed. How do web developers become part of it and how what are the business opportunities?

Open Data & What It Means For You

Does the mere thought of open data cause you to quiver in excitement? You’re not alone. More on the open data movement than you could shake a stick at!

Paying with Data: how free services aren’t free

How is your Facebook information being used and how could it be used in the future? How concerned should we all be? Panelists will also discuss current policy on privacy issues online.

We’re going to order propaganda stickers to give out, and we want to get your feedback on which to print.

Favorites? Terrible puns of your own to add? Want us to send you a set? Let us know in the comments!

• Live Fast and Leave a Beautiful Corpus at Infochimps.org
• Where Hot Singles come to Dataset
• Upload Yours.
• Hadoop-de-doo for you
• Dammit, No, the Other NLP
• I’m Consistently Available. Want to see my Partition?
• Intoxication by Miners is OK at infochimps.org
• Fit your Curves at infochimps.org
• Head in the Clouds?
• Expose your Bits at infochimps.org
• Support Vector Machines!
• Free Variables
• Everyone at our Datacenter has a Nice Rack
• Bayesians Against Discrimination
• Map Reduce, Map Reuse, Map Recycle
• PAXOS in our time
• Pro Axiom of Choice
• Big Chimpin’
• We have the most Cunning Linguists
• P = NP
• P != NP

Several of the slogans shamelessly stolen from this protest by CMU Machine Learning researchers, which I love so much it hurts.

By popular demand, we have refreshed our massive corpus of Twitter data. As part of the facelift, some of our API fields have been eliminated, and many more have been added. Trstrank, for instance, will include a new field called Trstquotient, or TQ, which can be used as a spam indicator. (For details on how that works, stay tuned for a forthcoming blog post). The fields we chose to eliminate from Trstrank–followers, following, and statuses–can be readily accessed via Twitter’s API.

Our new datasets will provide the most accurate and up-to-date reflection of a Twitter user’s measure of influence (Trstrank), activity level (Influencer Metrics), and interactions between two given users (Conversations). The datasets that changed the most, Influencer Metrics and Conversations, have lots of new fields.  Influencer Metrics is now a more rigorous way to measure retweets and @ replies, both incoming and outgoing, and Conversations gives a full summary of the interactions between two users.

We’re versioning the new API calls, to prevent the unpleasantness that could accompany a rapid switcheroo, but our old calls will be phased out quickly. We welcome your feedback on this exciting update!

• Filter influencers or non-influencers from any feed of tweets (Influence and/or Trstrank)
• Filter Twitter spam (Trstrank and/or influence)
• Build a word cloud for a Twitter user in any app (Wordbag)
• Target content/ads based on words a user tweets about the most (Wordbag)
• Find the true influence of a Twitter user by combining their Trstrank, ratio of friends/followers, ratio of statuses to retweets in, etc (Trstrank and Influence)
• Find social circles on Twitter, not by followers, but by who is actually talking to each other (Conversation)
• Target content/ads based on IP address (IP→Census)
• A/B test your website/web app based on demographic data (IP→Census)
• Build a site that lists a person’s Twitter followers with columns for trstrank, influence metrics (display them as ratios) and wordbag. (Trstrank, Influence, Wordbag)
• Integrate reputation metrics into your Twitter client to help users decide who and who not to follow and also filter their tweet streams. (Trstrank, Influence, Wordbag)
• Demographic web analytics. Build an app/plugin/etc to analyze web server logs (or log it and analyze remotely with JavaScript) that gives demographic information about a website’s users (IP→Census)

If you’ve got your own idea feel free to post it here or just send it to us!

If you’re attempting to promote something on Twitter, it’s likely that you would want to focus on promoting it amongst the Twitter luminaries. Enter Trstrank, our exciting little measure of Twitter luminescence. Getting your product promoted by someone with a high Trstrank could potentially be marketing gold. The likelihood, however, of someone with a very high Trstrank nurturing your product’s visibility with a steady stream of cooing retweets is slim to, well, none. So how to know where to focus your evangelizing efforts?

Sean wondered the same thing when he set about to promote his report. He created the following visualization of an arbitrarily selected sample of his Twitter friends positioning himself in the center, companies in the inner circle, and contacts associated with those companies in the outer circle. Any contact or company with a Trstrank greater than five is designated by a blue dot; those with a Trstrank between two and five are designated by an orange dot. This gives a useful snapshot of who occupies a “strategic position” in his Twitter universe.

Sean hypothesized that the least likely to engage and retweet his report were both the most top-ranked and most bottom ranked. Eliminating those two tails would yield a swath of active users to target, the orange dots. Ten of Sean’s thirty sample contacts were orange dots. Of those ten users, Sean eliminated seven of them based on personal knowledge he had of them (i.e. he didn’t know them very well or knew they didn’t care about data and data visualization). This left him with three contacts to enlist in his promotional efforts. Sean’s strategy is very savvy, but requires some amount of personal familiarity with contacts, a luxury not every promoter has.

Fortunately, two of our newer API calls, can simulate Sean’s marketing method. Influencer Metrics will show you how likely a user is to retweet a post based on their tweeting history.  Coupling Influencer Metrics with Trstrank would enable a promoter to identify not only the users most likely to engage, but also the most influential of those users. Throw Wordbag into the mix and a promoter could also discover if users in the active, influential target population have a potential interest in their product.

We would love reader feedback about our current API calls. How do you envision them working together? What other kind of calls would be of benefit to you? Let us know your ideas.

1. Sign up for the API
2. When you get your API key, create your chimps dotfile: sudo nano ~/.chimps
3. Put this in your dotfile:

   :query:
         :username: your_api_name
         :key:      you_api_key
   
   

4. Install chimps: sudo gem install chimps. (make sure you have gemcutter as a source otherwise it won’t find the gem: gem sources -a http://gemcutter.org)
5. Run a query! % chimps query soc/net/tw/influence screen_name=infochimps

It should return with something like this:

{"replies_out":13,"account_age":602,"statuses":166,"id":15748351,"replies_in":22,"screen_name":"infochimps"}

That’s it!

Trstrank

Trstrank uses an algorithm similar to Google Page Rank to generate a numerical rank that indicates the amount of influence a particular user has. This is a much more robust way to determine a Twiter user’s influence than by their number of followers alone.

Wordbag

Wordbag enables you to discover what a specific Twitter user finds interesting. After entering the handle of a specific Twitter user, Wordbag generates a list of words unique to that Twitter user.

Influencer Metrics

Influencer Metrics measures the number retweets, mentions, and @replies that a specific Twitter user has. Retweets and mentions can indicate the value the Twitter community gives to the tweets of a specific user. Coupling Trstrank with Influencer Metrics provides a particularly powerful way to gauge the influence of a Twitter user.

The potential applications of our API are limited only by the imagination. We hope market researchers, brazen self-promoters, statisticians, sociologists, cultural anthropologists, linguists, and all the curious Georges out there will find it as compelling as we do.

Looking to the future, our development team will be constantly polishing and updating the API. Follow @infochimps on Twitter for announcements. We received many requests on our private beta for more frequent refreshments of our data and fuller coverage.  Our next update will do just that. We have additional API calls percolating, including one that will allow you to discover close-knit interactions between Twitter users and see the level of interaction between them.

For features and pricing, including our totally free package, the Baboon, click here.

If you want to see Twitter users simply shimmer against a backdrop of a dusky world map, look no further than Ernesto Badillo’s visualization. His map was inspired by the NASA Earth at Night picture. All Twitter users with latitude and longitude coordinates are plotted. With automatic updates from some mobile clients like ÜberTwitter, etchings of some roads, particularly in the U.S., can even be seen. Take a look at Ernesto’s blog post on that page for some details on how he made the visualization.

William Johnson of Chatanooga Data submitted a handful of visualizations, again of Twitter users by location. His visualization provides a way to immediately apprehend the ubiquity of Twitter users with playfully colored dots. These visualizations were made with Tableau.

If you, dear reader, are seeking refuge from the oppressive summer sun in the confines of your cool, well-wired basement, consider making your own viz with data from our massive Twitter scrape and submitting it us. We’ll think you’re awesome.