atbrox

Distributed Tracer Bullet Development

Amund Tveit — Tue, 24 Jan 2012 10:18:42 +0000

Tracer Bullet Development Tracer Bullet Development is finding the major “moving parts” of a software system and start by writing enough code to make those parts interact in a real manner (e.g. with direct API-calls, websocket or REST-APIs), and as the system grows (with actual functionality and not just interaction) keep the “tracer ammunition” flowing [...]

Workshop: Mapreduce’12 – 3rd International Workshop on Mapreduce and its applications)

Amund Tveit — Wed, 30 Nov 2011 08:16:22 +0000

If you are interested in Mapreduce or Hadoop I recommend submitting to or attending the following workshop. The Third International Workshop on MapReduce and its Applications (MAPREDUCE’12) June 18-19, 2012 HPDC’2012, Delft, the Netherlands. http://graal.ens-lyon.fr/mapreduce/ SCOPE ===== Since its introduction in 2004 by Google, MapReduce has become the programming model of choice for processing large [...]

Workshop: Searching for fun

Amund Tveit — Wed, 23 Nov 2011 20:59:59 +0000

If you are interested in search I recommend you to consider submitting a paper to or attending the Searching 4 fun workshop* (I just joined as a program committee member) which is going to be held in Barcelona in April 2012. Call for Papers The topics of the workshop will be evaluation focused and include [...]

Mapreduce & Hadoop Algorithms in Academic Papers (5th update – Nov 2011)

Amund Tveit — Wed, 09 Nov 2011 12:26:27 +0000

The prior update of this posting was in May, and a lot has happened related to Mapreduce and Hadoop since then, e.g. 1) big software companies have started offering hadoop-based software (Microsoft and Oracle), 2) Hadoop-startups have raised record amounts, and 3) nosql-landscape becoming increasingly datawarehouse’ish and sql’ish with the focus on high-level data processing [...]

Mapreduce & Hadoop Algorithms in Academic Papers (4th update – May 2011)

Amund Tveit — Mon, 16 May 2011 08:22:23 +0000

Follow @atbrox It’s been a year since I updated the mapreduce algorithms posting last time, and it has been truly an excellent year for mapreduce and hadoop – the number of commercial vendors supporting it has multiplied, e.g. with 5 announcements at EMC World only last week (Greenplum, Mellanox, Datastax, NetApp, and Snaplogic) and today’s [...]

Mapreduce in Search

Amund Tveit — Sat, 09 Apr 2011 15:52:01 +0000

Wrote about mapreduce in search in a presentation for next week. Mapreduce in Search (more up-to-date pdf version of the presentation) Best regards, Amund Atbrox

Atbrox spin off launches new media search engine

Amund Tveit — Wed, 16 Feb 2011 08:37:15 +0000

Our spin off startup company – Gravemaskinen AS – just launched a new media search engine in cooperation with Journalisten.no (magazine for Norwegian media professionals). Some of the features include: faceted’ish suggest search realtime aggregation of search results for statistics multiple views to support easy navigation and search sentence-granularity search (it is deployed on Amazon [...]

An example of using F# and C# (.net/mono) with Amazon’s Elastic Mapreduce (Hadoop)

Amund Tveit — Sun, 06 Feb 2011 23:13:26 +0000

This posting gives an an example how F# and C# can scale potentially to up to thousands of machines with Mapreduce in order to efficiently process TeraByte (TB) and PetaByte (PB) data amounts. It shows a C# (c sharp) mapper function and a F# (f sharp) reducer function with a description on how to deploy [...]

2nd International Workshop on Mapreduce and its applications

Amund Tveit — Thu, 06 Jan 2011 09:40:54 +0000

If you are interested in Mapreduce (/Hadoop), I would like to recommend participating or submitting your paper to the 2nd International Workshop on Mapreduce and its applications (MAPREDUCE’11). The mapreduce workshop is held in correspondance with the The 20th International ACM Symposium on High-Performance Parallel and Distributed Computing in San Jose, California (June 2011). (I [...]

Programmatic Deployment to Elastic Mapreduce with Boto and Bootstrap Action

Amund Tveit — Fri, 01 Oct 2010 18:23:05 +0000

A while back I wrote about How to combine Elastic Mapreduce/Hadoop with other Amazon Web Services. This posting is a small update to that, showing how to deploy extra packages with Boto for Python. Note that Boto can deploy mappers and reducers in written any language supported by Elastic Mapreduce. In the example below (it [...]