Facebook has the second largest installation of Hadoop (a software platform that lets one easily write and run distributed applications that process vast amounts of data), Yahoo being the first. It is also the creator of Hive, a data warehouse infrastructure built on top of Hadoop.

The following two posts shed some more light on why Facebook chose the Hadoop\Hive path, how they’re doing it and the challenges they’re facing:

Facebook, Hadoop, and Hive on DBMS2 by Curt Monash discusses Facebook’s architecture and motivation.

Facebook decided in 2007 to move what was then a 15 terabyte big-DBMS-vendor data warehouse to Hadoop — augmented by Hive — rather than to an MPP data warehouse DBMS…

The daily pipeline took more than 24 hours to process. Although aware that its big-DBMS-vendor warehouse could probably be tuned much better, Facebook didn’t see that as a path to growing its warehouse more than 100-fold.

Hive – A Petabyte Scale Data Warehouse using Hadoop by Ashish Thusoo from the Data Infrastructure team at Facebook discusses Facebook’s Hive implementation in details.

… using Hadoop was not easy for end users, specially for the ones who were not familiar with map/reduce. End users had to write map/reduce programs for simple tasks like getting raw counts or averages. Hadoop lacked the expressibility of popular query languages like SQL and as a result users ended up spending hours (if not days) to write programs for typical analysis. It was very clear to us that in order to really empower the company to analyze this data more productively, we had to improve the query capabilities of Hadoop. Bringing this data closer to users is what inspired us to build Hive. Our vision was to bring the familiar concepts of tables, columns, partitions and a subset of SQL to the unstructured world of Hadoop, while still maintaining the extensibility and flexibility that Hadoop enjoyed.

Similar Posts:

• Yahoo Releases Its Own Hadoop Distribution
• Introduction to MapReduce for .NET Developers
• Facebook Opens Itself to the Web
• Open Social Networks Platform
• Facebook Fan Page – Add Community Features to Your Blog

Yahoo! is releasing its own distribution of Hadoop:

Hadoop is a distributed file system and parallel execution environment that enables its users to process massive amounts of data.
In response to frequent requests from the Hadoop community, Yahoo! is opening up its investment in Hadoop quality engineering to benefit the larger ecosystem and to increase the pace of innovation around open and collaborative research and development.
The Yahoo! Distribution of Hadoop has been tested and deployed at Yahoo! on the largest Hadoop clusters in the world.

Hadoop is free Java software framework born out of an open-source implementation of Google’s published computing infrastructure and fostered within the Apache Software Foundation.
Yahoo! has been the primary developer and contributor to Apache’s Hadoop.
In 2006, Hadoop founder Doug Cutting joined Yahoo, which provided a dedicated team and resources, to lead the project of developing the open-source software and turn Hadoop into a system that ran at web scale. Today, Yahoo! is running the largest Hadoop cluster in the world, which includes more than 25,000 servers and provides the framework for many Yahoo properties including Yahoo Search, Yahoo Mail, and several content and ad services.

Yahoo says its opening up the source code to Hadoop to “benefit the larger ecosystem increase the pace of innovation around open and collaborative research and development.”.
As Nigel Daley, Quality and Release Engineering Manager at Yahoo! Grid Technologies, summarizes:

Hadoop is helping us solve key science and research problems in hours or days instead of months. It provides us a platform to solve extreme problems requiring massive amounts of data processing. It underpins major revenue-generating systems. Opening our distribution enables a faster pace of innovation for the entire Hadoop ecosystem and broadens the use — and ultimately the quality — of this key platform across the industry.

Similar Posts:

• Facebook, Hadoop and Hive
• Microsoft Gets It All Wrong – Launching The ILDC “Friends Club” For Students
• Sergey Is Leaving Google For Microsoft (Not THAT Sergey…)
• 99 Ways to Become a Better Developer
• Microsoft to Make a Significant Announcement

The Amazon Elastic Compute Cloud (Amazon EC2) allows customers build secure, fault-tolerant applications that can scale up and down with demand, at low cost. One of the core features for achieving this kind of efficiency and fault-tolerant is the ability to acquire and release computing resources in a matter of minutes according to demand.

While Amazon’s EC2 has been great so far in allowing companies to run large, computational-heavy distributed tasks on the background, it has been really lacking on allowing companies to run online services in a manner that’s efficient and reliable.

The reason for this lack of support is basically because there was no way to do load balancing on EC2 machines allowing a service to efficiently scale across multiple EC2 instances.

With the launch of Amazon CloudWatch, Auto Scaling and Amazon Elastic Load Balancing, Amazon is effectively making EC2 a viable host for online services, not just background jobs. Using these services you can not only scale a service across machines for reliability, you can also automatically add and remove computing resources as demand increases\decreases driving your operation costs down.

You can find more information at the detail pages for Amazon CloudWatch, Auto Scaling and Elastic Load Balancing and on the AWS developer weblog. Also, check out Werner Vogel’s blog post for some background on how Amazon is horizontally scaling its services.

Similar Posts:

• Scaling Web Application – Recommended Readings
• Duet: An Enterprise S+S Offering From Microsoft And SAP
• Amazon S3 Storing 29 Billion Objects
• New FolderShare!
• Microsoft to Take Over Yahoo?

The basic model for MapReduce derives from the map and reduce concept in functional languages like Lisp.
In Lisp, a map takes as input a function and a sequence of values and applies the function to each value in the sequence.
A reduce takes as input a sequence of elements and combines all the elements using a binary operation (for example, it can use “+” to sum all the elements in the sequence).

MapReduce, inspired by these concepts, was developed as a method for writing processing algorithms for large amounts of raw data. The amount of data is so large that it can’t be stored on a single machine and must be distributed across many machines in order to be processed in a reasonable time.
In systems with such data distribution, the traditional central processing algorithms are useless as just getting the data to the centralized CPU running the algorithm implies huge network costs and months (!) spent on transferring data from the distributed machines.
Therefore, processing such massive scales of distributed data implies the need for parallel computing allowing us to run the required computation “close” to where the data is located.
MapReduce is an abstraction that allows engineers to write such processing algorithms in a way that is easy to parallelize while hiding the complexities of parallelization, data distribution, fault tolerance etc.

This value proposition for MapReduce is outlined in a Google research paper on the topic:

MapReduce is a programming model and an associated implementation for processing and generating large data sets. Users specify a map function that processes a key/value pair to generate a set of intermediate key/value pairs, and a reduce function that merges all intermediate values associated with the same intermediate key. Many real world tasks are expressible in this model, as shown in the paper.

Programs written in this functional style are automatically parallelized and executed on a large cluster of commodity machines. The run-time system takes care of the details of partitioning the input data, scheduling the program’s execution across a set of machines, handling machine failures, and managing the required inter-machine communication. This allows programmers without any experience with parallel and distributed systems to easily utilize the resources of a large distributed system.

Our implementation of MapReduce runs on a large cluster of commodity machines and is highly scalable: a typical MapReduce computation processes many terabytes of data on thousands of machines. Programmers find the system easy to use: hundreds of MapReduce programs have been implemented and upwards of one thousand MapReduce jobs are executed on Google’s clusters every day.

The MapReduce Programming Model

As explained earlier, the purpose of MapReduce is to abstract parallel algorithms into a map and reduce functions that can then be executed on a large  scale distributed system.
In order to understand this concept better lets look at a concrete map reduce example – consider the problem of counting the number of occurrences of each word in a large collection of documents:

map(String key, String value):
// key: document name
// value: document contents
for each word w in value:
  EmitIntermediate(w, "1"); 

reduce(String key, Iterator values):
// key: a word
// values: a list of counts
int result = 0;
for each v in values:
  result += ParseInt(v);
Emit(AsString(result));

The map function goes over the document text and emits each word with an associated value of “1”.

The reduce functions sums together all the values for each word producing the number of occurrences for that word as a result.

First we go through the mapping phase where we go over the input data and create intermediate values as follows:

• Records from the data source (lines out of files, rows of a database, etc.) are fed into the map function as <key,value> pairs.For example: <filename, file content>
• The map function produces one or more intermediate values along with an output key from the input

After the mapping phase is over, we go through the reduce phase to process the intermediate values:

• After the map phase is over, all the intermediate values for a given output key are combined together into a list and fed to the reduce function.
• The reduce function combines those intermediate values into one or more final values for that same output key

Notice that both the map and the reduce functions run on independent set of input data. Each run of the map function process its own data source and each run of the reduce function processes the values of a different intermediate key.

Therefore both phases can be parallelized with the only bottleneck being the fact that the map phase has to finish for the reduce phase to start.

The underlying system running these method is in takes care of:

• Initialize a set of workers that can run tasks – map or reduce functions.
• Take the input data (in our case, lots of document filenames) and send them to the workers to map
• Streamline values emitted by map function to the worker (or workers) doing the reduce. Note that we don’t have to wait for a certain map run to finish going over the entire file in order to start sending its emitted values to the reducer, so that the system can prepare the data for the reducer while the map function is running
  (In Hadoop – send the map values to the reducer node and andle grouping by key).
• Handle errors – support a reliable, fault tolerant process as workers may fail, network can crush preventing workers from communicating results, etc.
• Provides status and monitoring tools.

A Naive Implementation in C#

Lets see how we can build naive MapReduce implementation in C#.

First, we define a generic class to manage our Map-Reduce process:

public class NaiveMapReduceProgram<K1, V1, K2, V2, V3>

The generic types are used the following way:

• (K1, V1) – key-value types for the input data
• (K2, V2) – key value types for the intermediate results (results of our Map function)
• V3 – The type of the result for the entire Map-Reduce process

Next, we’ll define the delegates of our Map and Reduce functions:

public delegate IEnumerable<KeyValuePair<K2, V2>>   MapFunction(K1 key, V1 value);
public delegate IEnumerable<V3>                     ReduceFunction(K2 key, IEnumerable<V2> values);

private MapFunction _map;
private ReduceFunction _reduce;

public NaiveMapReduceProgram(MapFunction mapFunction, ReduceFunction reduceFunction)
{
    _map = mapFunction;
    _reduce = reduceFunction;
}

(Yes, I realize I could use .NET’s Func<T1,T2,TResult> instead but that would just result in horribly long ugly code…)

Now for the actual program execution. The execution flow is as follows: We take the input values, pass them through the map function to get intermediate values, we group those values by key and pass them to the reduce function to get result values.

So first, lets look at the mapping step:

private IEnumerable<KeyValuePair<K2, V2>> Map(IEnumerable<KeyValuePair<K1, V1>> input)
{
    var q = from pair in input
            from mapped in _map(pair.Key, pair.Value)
            select mapped;

    return q;
}

Now after we got the mapped intermediate values we want to reduce them. The Reduce function expects a key and all its mapped values as input so to do that efficiently we want to group the intermediate values by key first and then call the Reduce function for each key.

The output of this process is a V3 value for each of the intermediate K2 keys:

private IEnumerable<KeyValuePair<K2, V3>> Reduce(IEnumerable<KeyValuePair<K2, V2>> intermediateValues)
{
    // First, group intermediate values by key
    var groups = from pair in intermediateValues
                 group pair.Value by pair.Key into g
                 select g;

    // Reduce on each group
    var reduced = from g in groups
                  let k2 = g.Key
                  from reducedValue in _reduce(k2, g)
                  select new KeyValuePair<K2, V3>(k2, reducedValue);

    return reduced;
}

Now that we have the steps code the execution itself is simply defined as Reduce(Map(input)) :

public IEnumerable<KeyValuePair<K2, V3>> Execute(IEnumerable<KeyValuePair<K1, V1>> input)
{
    return Reduce(Map(input));
}

The full source code and tests can be downloaded from here:

Map-Reduce Word Counting Sample – Revisited

Lets go back to the word-counting pseudo code and write it in C#.

The following Map function gets a key and a text value and emits a <word, 1> key-pair for each word in the text:

public IList<KeyValuePair<string, int>> MapFromMem(string key, string value)
{
    List<KeyValuePair<string, int>> result = new List<KeyValuePair<string, int>>();
    foreach (var word in value.Split(' '))
    {
        result.Add(new KeyValuePair<string, int>(word, 1));
    }
    return result;
}

Having calculated a <word, 1> key-pair for each input source, we can group the results by the word and then our Reduce function can sum the values (which are 1 in this case) for each word:

public IEnumerable<int> Reduce(string key, IEnumerable<int> values)
{
    int sum = 0;
    foreach (int value in values)
    {
        sum += value;
    }

    return new int[1] { sum };
}

Our program code looks like this:

MapReduceProgram<string, string, string, int, int> master = new MapReduceProgram<string, string, string, int, int>(MapFromMem, Reduce);
var result = master.Execute(inputData).ToDictionary(key => key.Key, v => v.Value);

The result dictionary contains a <word, number-of-occurrences> pairs.

Other Examples

Distributed LINQ Queries. One of POCs I’m working on using the above naive, LINQ-based implementation, is running a distributed LINQ query. Imagine you have a system where raw data is distributed across several SQL Servers. We can have our map function run a LINQ-to-SQL query on multiple DataContexts in parallel (the value input for the map function – V1 – can be a DataContext) and then reduce it to a single result set. This is probably a naive\simplified implementation of what the guys at Microsoft’s Dryad team are doing.

Count URL Visits. Consider you have several web servers and you want to produce the amount of visits for each page on your site. You can produce pretty much the same way the word-counting example works. The map function parses a log file and produce a <URL, 1> intermediate value. The reduce function then sums the values for each URL and emits <URL, number of visits>

Distributed Grep. You can run a grep search on a large amount of files by having the map function emits a line if it matches a given pattern. The reduce function in this case is just an identity function that copies the supplied intermediate data to the output.

Map-Reduce in the Real World

The real complexity and sophistication in MapReduce is in the underlying system takes care of running and managing the execution of MapReduce jobs. Real world MapReduce implementations, like Google’s system, Hadoop or Dryad have to go beyond the naive implementation shown here and take care of things like resource monitoring, reliability and fault tolerance (for example, handle cases where nodes running map\reduce jobs crush, or go offline due to network problems).

The following resources are worth checking out:

• Cloudera’s Hadoop Training
• Google Code University – Distributed Systems

Similar Posts:

• The Dark Side of LINQ
• Facebook, Hadoop and Hive
• ASP.NET MVC RSS Feed Action Result
• Developing a Robust Data Driven UI Using WPF – Stock DataModel Sample
• Developing a Robust Data Driven UI Using WPF – The DataModel

Its a rare occasion that I go out of a restaurant (and I go to many) with an absolute feeling of “WOW!”… This Monday was one of these occasions.

On the past couple of week we’ve been working on a new, food related venture (more details on that in the very near future).  Apparently, we raised enough twitter noise to get noticed, and thanks to Maya we’ve been contacted by Channel 10 and invited to visit Maraboo as part of the promotions for the season finale of the Israeli version of Icon Chef featuring the Maraboo team vs. the Hudson Brasseri – you should tune in on Channel10 this Thursday (April 30, 2009) at 21:00.

At the restaurant we met the owners, Haim Amshalom and Chef Yoav Bar
who showed us around the place and introduced us to each and every dish we got. We had a great time…

* On the left Haim Amshalom and on the right Chef Yoav Bar

The fact that were at Maraboo as bloggers, that Maraboo has its own group on Facebook and that its owner is on Twitter made me think about the opportunities the web has to offer restaurants.

The Web is About Openness… Can Restaurants be Open?

The Web is about openness, its about empowering online communities and individuals to create, remix, share and make things themselves.
Restaurants are essentially small communities, or tribes of people with a common interest (in our case – food) a leader (the Chef) and a platform to communicate (the restaurant). They can use the web as a platform to develop a personal relationship with its customers and the facility itself (the restaurant) as a social hub.

Restaurants, like any other business, can use Twitter or a Facebook group etc. to keep in touch with their diners but what’s more interesting is that they can actually use it to become a platform, or a hub, for its tribe members (diners) to interact and their common interests (food).

The Menu as a Wiki. Ok, the Chef builds the menu and we wouldn’t want to change that… that’s the whole point of the restaurant. But what if he could collaborate or include the diners into that process?

Maybe people think the Calamari dish is lacking? or maybe they just hate Calamari…  wouldn’t you want to know?

It can put recipes online and invite diners to make suggestions. Some users might go through the trouble of preparing the dish at home. They might make all sort of adaptations and report back, discuss them online with their fellow diners (For example, a lot of people tried to make the same wings sauce as Dixie’s famous sauce and they were discussing it online). Maybe some of these adaptations are actually worth putting in the menu?

In fact, what if browsing a restaurant’s menu was more like browsing Amazon?
You could see which dishes people like more, what they think of it. You could see what your friends like (or not) or filter dishes by “spec” (like calories intake?).

Restaurants can become the stars. The popularity of kitchen-based reality shows is soaring (heck, we’re here as a promotion for such a show) because there’s a public interests in restaurants, in chefs, in food making.
Chefs could blog about their taste, inspirations, trends they see, cooking practices and tutorials and become local stars (take Gary Vaynerchuk’s for example)

Restaurant as a community meeting place. People in online communities like to meet. Just see all the Tweetup events where communities of people who know each other from talking on Twitter gather to talk offline. As its community members all share a passion for food, a restaurant can organize bakeups- where people could learn about cooking\cook. Maybe even have a community member as Chef for a night…

Final Thoughts and.. Food Photos!

As Seth Godin puts it, managing a tribe is a whole different concept than the old way of just managing a brand using traditional PR:

Tribe management is a whole different way of looking at the world.

It starts with permission, the understanding that the real asset most organizations can build isn’t an amorphous brand but is in fact the privilege of delivering anticipated, personal and relevant messages to people who want to get them.

It adds to that the fact that what people really want is the ability to connect to each other, not to companies. So the permission is used to build a tribe, to build people who want to hear from the company because it helps them connect, it helps them find each other, it gives them a story to tell and something to talk about.

Anyway, I can’t end this post without some photos of some of the amazing dishes we had at Maraboo:

And finally, the entire dinning team

Similar Posts:

• Microsoft Can Clone Twitter?!
• Microsoft to Take Over Yahoo?
• TwitterEthics – Rules for Effective Twittering
• No Hope for Traditional Media Companies?
• Lets Socialize

A bunch of interesting/inspiring topics for the weekend…

Designing “Big Data”

Jeff Veen from Small Batch Inc. gave a 20-minutes talk at the Web2.0 Expo at San Francisco.
During the talk he focuses on some classic examples for information visualization (John Snow pump, Minard’s map, the tube map, and so on), the challenge of making data more accessible and understandable vs. just “decorating” it and the emerging challenge in Web 2.0 to empower users to find and create their own stories using the data.

And on the same topic of dealing with “big data”, check out the AlloSphere. A system developed by scientists and artists at the University of California for exploring huge sets of data as a visual and audible 3D world:

Cool New Computer Interaction Technology

I saw this amazing UI concept watching the TED podcast:

The concept as computers as tiny blocks that can react to each other is just amazing and the possibilities here, especially in education, are endless…

Kiva Robots Invade the Warehouse

If a bunch of tiny computers interacting can change personal computing here’s what it can do in the enterprise – optimize warehouses supply chain:

The servers work in real-time, receiving orders, immediately dispatching robots to bring the required pods to the worker fulfilling the order, and then returning the pods to their storage locations. The robots receive their orders wirelessly, while using cameras to read navigational barcode stickers on the warehouse floor.

Have a great weekend!Similar Posts:

• Facebook, Hadoop and Hive
• Developing a Robust Data Driven UI Using WPF – An Overdue Summary (and full source code)
• The Modu Mobile – Revolution or Evolution?
• Sexy Enterprise Software?
• Video: Data Portability – Connect, Control, Share, Remix

I wrote the stocky application more than a year ago as a research project aimed at proving that using WPF we can separate presentation metadata (XAML) from program logic. The goal was to provide the Duet team at SAP with a document reference sample for using M-V-VM to achieve this separation.

I started documenting the proof-of-concept in a series of posts but unfortunately after leaving SAP my interests (and work) shifted away from WPF and I didn’t find the time to finish the series.

I’ve received numerous requests to release the source code but I couldn’t do so because it was part of a larger infrastructure code I wrote at SAP which basically ads a lot of noise to the sample (an d probably ads legal issues for me sharing it).
Anyway, I took some time off this afternoon to re-write the sample independently so that I could share it:

This, I guess is the long overdue ending for the series:

• Introduction – introduces the concept of M-V-VM and the reasoning behind it.
• The DataModel – describes how to write the Model part of our application.
• Stock DataModel Sample – provides a conrete implementation of a Stock model and its view.. 

However, If you’re interested in M-V-VM in WPF, there are numerous topics worth mentioning that I didn’t get to cover and are definitely worth checking out:

Unit Testing

As I said in the introduction post, one of the most important benefits of seperating the logic code from the presentation (XAML) is that its straightforward to unit test. In fact, my next post following the Stock DataModel Sample was going to be about unit testing – specifically, how to test the DataModel its provider which, because of the use of threading, is a bit tricky.

This post is actually 99% done in the comments of the unit test code that’s in DefaultStockQuoteProviderTest.cs in the  provided source code. So do yourself a favor and go over the code. It’s not long and very well documented…

Using Lambda Expression for DataBinding

Data-binding is pretty much at the heart of the M-V-VM concept and it makes us write Value Converters which is pretty tedious and annoying.
Wouldn’t it be great if we could replace writing lots of IValueConverter classes like this:

<TextBlock Foreground="{Binding Change, Converter={StaticResource StockForegroundConverter}}" … />

[ValueConversion(typeof(double), typeof(Brush))]
public class StockChangeToBrushConverter : IValueConverter
{
    public object Convert(object value, Type targetType, object parameter, CultureInfo culture)
    {
        double change = (double)value;
        if (change == 0) return Brushes.Black;
        return (change < 0) ? Brushes.DarkRed : Brushes.Green;
    }

    public object ConvertBack(object value, Type targetType, object parameter, CultureInfo culture)
    {
        return double.NaN;
    }
}

To just the following XAML statement that embeds the conversion logic:

<TextBlock Foreground="{Binding Change,

Converter={ change=> if (change == 0) return Brushes.Black; return (change < 0) ? Brushes.DarkRed : Brushes.Green; }}" … />

M. Orçun Topdağı wrote an excellent series on using Lambda Expressions for data-binding in WPF to achieve just that:

• WPFix Part 1 (Lambda Converter Extension)
• WPFix Part 2 (Binding Extension)
• WPFix Part 3 (Extension Methods)

Reference Applications and Guidance

I haven’t seen a lot of sample WPF LOB reference applications out there but here are some interesting links for further learning:

• Prism: patterns & practices Composite Application Guidance for WPF and Silverlight site
• M-V-VM Reference Application – A new project that aims to “created reference application for M-V-VM frameworks to use for demonstration purposes, similar in concept to Pet Shop for web frameworks.”

Similar Posts:

• Developing a Robust Data Driven UI Using WPF – Stock DataModel Sample
• Developing a Robust Data Driven UI Using WPF – The DataModel
• Developing a Robust Data Driven UI Using WPF – Introduction
• ASP.NET MVC RSS Feed Action Result
• Short Introduction to Powershell

In a response to Microsoft watcher Todd Bishop’s post saying  Microsoft should buy Twitter, Mary Jo-Foley wrote Microsoft Shouldn’t Buy Twitter saying:

…But I’d argue Microsoft could simply do a Twitter clone — the same way that it has built its own Facebook-notification-like news stream into Windows Live — and reap similar results. In fact, the Softies are hinting they’ve already been experimenting with adding Twitter-like functionality to its business software (possibly via SharePoint). I’d bet the Xbox and maybe the Pink/Danger mobile teams have been looking at doing their own Twitter-like services too.

Seriously?! Microsoft could simply clone Twitter?!

Sure, Microsoft certainly has some brilliant tech folks that can surely implement or clone anything. It also has the resources to do that.
And yet, its mostly following the pack with its online offering pretty stagnant. Last time it tried anything like that was Live Home with its Facebook\FriendFeed like functionality and that’s pretty much dead…
It can certainly clone Twitter, probably even do a better job at it than the original, but will anyone bother using it?

Twitter has a fast growing, huge and vibrant community. Its also a well known brand name that’s getting a huge amount of media attention right now.
It survived its own fail whales, upgrade owls and all sorts of other nasty service downtimes simply because no one else can beat that…
You can clone technology but you can’t clone a community and brand strength…Similar Posts:

• Is Windows Live Still Alive?
• Lets Socialize
• TwitterEthics – Rules for Effective Twittering
• Microsoft to Make a Significant Announcement
• Microsoft to Take Over Yahoo?

The discussion over Google’s latest move into behavioral ad targeting is all over TechMeme. Basically what this means is that Google will start selling users (or more specifically, clusters of users, like football fans for example) in addition to words:

Today we are launching “interest-based” advertising as a beta test on our partner sites and on YouTube. These ads will associate categories of interest – say sports, gardening, cars, pets – with your browser, based on the types of sites you visit and the pages you view. We may then use those interest categories to show you more relevant text and display ads. (…)
So if you visit an online sports store, you may later be shown ads on other websites offering you a discount on running shoes during that store’s upcoming sale.

Google’ is not the first to embrace behavioral targeting as other companies (including Google’s own DoubleClick) were already offering advertisers these features, but it is certainly the biggest.
Behavioral targeting on Google massive network of sites (just think of anyone who’s using Google Analytics, which is pretty much everyone) is certainly a game changing event to the online advertising industry.

The responses online (and ones I usually get talking to people about the topic as we’re doing stuff in this area at Nuconomy) range from simple skepticism of behavioral targeting effectiveness (like Google’s own Matt Cutts…) to Big Brother concerns.

To the latter group, concerned with privacy and worried about its actions online being tracked I have to say – NEWS FLASH! you don’t have privacy on the internet… everything you do is already being tracked, analyzed and can be linked back to you even if stored anonymously (ever heard of Thelma Arnold?), the only question is what do you get out of it?

I hope that with behavioral targeted ads I will see less irrelevant ads offering me low mortgages and seduction courses and more ads geared towards tech gear, maybe even making online ads actually useful (can’t remember the last time I clicked an ad. with time I just learned to automatically ignore these ad banners…). But I think change is not going to hit just the advertising market…

Google’s move can (hopefully) marks the beginning of a personal internet era where sites will customize their entire layout and content based on the preferences, or habits of the browsing users.
My favorite news site will know I care about tech and biz. and never read sports news and will modify its homepage layout based on these preferences, the recommendation widget on my blog will show post recommendation based on the viewers’ recent browsing history rather than based on traffic, and so on…

Behavioral targeting opens the door on a conceptual change, not just in advertising…

Related Resources:

• The Borg’s Cookies Are Delicious, Indeed – Zoli discusses privacy concerns over at Cloud Avenue.
• Google AdSense Starts Behavioral Targeting- Google Blogscoped doesn’t like behavioral targeting…
• Making ads more interesting– Google’s announcement on their blog.
• Behavioral Targeting in Google AdSense 

Similar Posts:

• No Hope for Traditional Media Companies?
• Evil is Subjective
• Google Applications for your Domain – Does it Measure Up to Expectations?
• Microsoft and Yahoo! … Revisited…
• Microsoft to Take Over Yahoo?

I just finished installing Windows 7 Beta on my home machine to find a fish swimming on my desktop:

But not just any fish, its a Siamese fighting fish, also knows a “betta fish” (or just “betta”).
A subtle Microsoft joke? Hope it does a better job selectively breeding this one (and get rid of some mutations… err… SKUs) …

Similar Posts:

• Upgrading My Machine to Visual Studio 2008 RTM
• Uninstalling Previous Versions of Visual Studio 2008
• Is Windows Live Still Alive?
• New Mame Release, Turning Media Center to an Arcade Machine
• Working on my Haduken Skills…

I  was very fortunate to get invited to the 2009 DLD Conference as a participant (Thanks to Yossi Vardi!). This was my first time at DLD and I can definitely say it has been the most amazing conference I have been to so far.

As defined by Steffi Czerny "DLD is interdisciplinary, creating interfaces and connecting people from the most different worlds." the conference’s “New Realities” theme encourages participants to discuss and formulates perspectives on markets following an eventful year, setting the agenda for 2009.

Or as Yossi Vardi defines it:

I told people that of my generation no one will understand instant messaging. And I was told my generation was already dead. But our generation has experiences the new generation does not have: real handshakes and real warmth of the hand. This still has to  move into social networks. And this is what we provide here: This old style feeling.
…
We invite you for 4 things:

• to get food for thought
• to make new friends
• to play
• to laugh

Think Distributed

So what is the new reality we’re living in? the repeating theme in most panels I’ve been to was the same:
We’re going through a fundamental change from centralized control (over content, decision making, …) to a distributed structure.

This change becomes very clear when you go over the following panels (and most other panels too):

• 100 Million Uniques
• New Media Models
• On Leadership
• Cloud Computing

All these panels talk about a new reality where, in order to survive, you have to give up on centralized control and go distributed.
On the 100 Million Uniques and New Media Models we hear about new distributed media networks that distribute information rather than creating and controlling it. On cloud computing we learn about technologies allowing companies to lose control over infrastructure for increased agility and lower costs, and on On Leadership we have the story of Best Buy that transformed its culture from “communicating at employees” to empowering their employees using social media tools.

Distributed Media

On New Media Models we’ve heard from Jeff Jarvis who says that the future of media distributed – aggregating content from a lot of independent sources rather than controlling the creation of content in-house.
On his latest book, “What Would Google Do?” (which I got signed at the event. Thanks Jeff! )  discusses the importance of building a platform for content, handing over control to users to build and distribute content, making your distributed network larger.

Traditional media companies think centralized. They create and control content and then spend a fortune on advertising in order to try and attract us, the consumers, to their content. This worked pretty well for big online media companies, like Yahoo for example, so far.
However, consumer today are relying more and more on social, self organization tools, to collect, sort, filter and rate content. Tools like Digg, Twitter, delicious and Facebook replace the functions that content portals used to provide.

In this new reality media companies need to stop thinking of themselves as an end – a closed content site (or portal) users come to in order to find content – and start distributing themselves.
Google distributes itself. It has its widgets, ads, maps and videos embedded in millions of web pages that it doesn’t own and it is making its profit of this vast distribution network.
Another example for distributed content is Glam. On 100 Million Uniques, Samir Arora, CEO of Glam described his company the following way:

“Glam is a distributed network that recognizes the fact that people go to many sites as opposed to a few, and that is the fundamental change that is happening today. So instead of bringing people to one place, we find out where people go and are there.”

“with every day that was passing, fueled by Google, its easier to find more sites, as opposed to one portal.

Instead of producing women targeted content and competing with all the other women content producers out there, Glam finds the best women content producers out there (some are lone bloggers and other can be bigger media companies) and invites them to join its network. It then sells ads on those sites and shares it revenue with them. It also aggregates the best content of its network to Glam.com, where it sells ads at a higher rate and shares its revenues too.
Glam helps sites on its network by sharing technology and content, and delivering traffic (and advertisers) to its member sites.

Distributed Leadership

Changing from centralized control to a distributed structure is not limited to the media and advertising world.
On the On Leadership panel we see how Best Buy made a strategic decision to distributing control to its employees allowing them to self organize and interact using social Web 2.0 tools.
By changing the company culture  “Less control from the top, more taking responsibility” the role of the CEO changes from  to defining a common goal, not way to get there, and relying the companies human capital to do what it takes to get there.
So some control over what’s going on is lost, but according to Best Buy CEO Brad Anderson, “this stuff builds energy. if people have self accountability and can do something that they helped created and love they got more energy. what a customer would get when he gets into that store is that he could tell whether that store has got energy and engaged employees serving him or not”.

So if there’s one thing I have to take from my  time at DLD 2009 its this: give up control, think distributed.

More on DLD:

• No Hope for Traditional Media Companies?
• Creating an Attractive Internet Company – It’s All About Emotions

Recommended session videos:

• 100 Million Uniques
• Reflections on a Crisis
• Predictably Irrational
• On Leadership
• New Media Models
• Software

Similar Posts:

• No Hope for Traditional Media Companies?
• To Which Social Network Site Do You Pay to Use and Why?
• Creating an Attractive Internet Company – It’s All About Emotions
• Microsoft to Take Over Yahoo?
• Is Windows Live Still Alive?

The Internet is a media platform based on content from traditional media companies (Times Magazine, etc.) as well as content produced by its users – blogs, forums and other social communication platforms.

This vast new world of content is taking the lead from traditional media. Newspapers, Magazines and TV Channels are all loosing their audience in favor of the internet. Those traditional media companies who do develop strong internet presence are still having troubles as income from online advertising does not cover the decrease in income from traditional advertising and subscription fees.

The New Media Models (video) panel, on last week’s DLD conference, tries to deal with the question of business models that media companies can use to profit on the web.

When asked about what kind of new media outlet they’d start today, non of the panel’s participants would start a print newspaper or a magazine.

“I wouldn’t start a newspaper. There might be a place for a magazine to sit on my coffee table, but not for a NewsWeek or a BusinessWeek or a daily newspaper I think its absurd… I understand why the do it, revenues on print are so great vs. online but it has to go way” said Michael Arrington. According to Arrington we’re going to be consuming our news and other content online or on digital devices and once a certain threshold is reached it’ll no longer be profitable to print. “It doesn’t make any sense for news to be on paper because of its just the cost structure” he summarizes.

Jeff Jarvis said he would start a distributed content network, like Glam. According to Jeff not owning and controlling the data is what allowed Glam to literally explode to more than 110 Million unique users in 3 years. While content owners have to spend a fortune advertising to bring people in, distributed networks just go to where the people are. People today reach content via rating sites like DIGG or Twitter messages and no longer require central content portals to collect, sort, filter and rate content them. Jeff says that media companies need to start asking “How can we build platforms on which others succeed?”, they have to become platforms for content distributed around the web (like YouTube for example) rather than producing and controlling their own content.

On that same note, Arrington added that traditional media sites, who’s cost structure includes all kinds of expenses that do not produce content – like programmers, office space – can’t compete with an army of bloggers who blog from their home using their laptop and free software.

Carolyn McCall, who is the CEO of Guardian Media Group (representing the “traditional” media companies) confirmed the fact that income from the printing business is going down while internet income, even for a huge company like the Guardian Group, do not compensate for these losses. However, she also mentions that 25 million users use the Guardian’s web and that its income is 300 million dollars a year and that both numbers continue growing.

The panelist could not explain why advertising budget that are taken from the print versions of the media do not move in their entirety to the online advertising world, and they could also not find a definite business model to run media company online (even Jeff’s example for a distributed network – Glam – is still not profitable and taking VC money) but they all agree that print is phasing out and that there’s a need for a new model for online media and journalism.

Similar Posts:

• Give Up Control, Think Distributed – DLD 2009 Summary
• Microsoft to Take Over Yahoo?
• Google’s New Behavioral Ad Targeting Should be Excellent for All
• Creating an Attractive Internet Company – It’s All About Emotions
• Microsoft and Yahoo! … Revisited…

How do you create an internet company\product that can get the attention of more than 100 million unique viewers a month?

That’s the tough question that Yossi Vardi’s was trying to find an answer to on his panel at this year’s DLD conference – 100,000 Million Uniques (video) – together with Glam’s co-founder Samir Arora, YouTube’s co-founder and CEO Chad Hurley, CEO of the Mozilla Foundation Mitchell Baker and Toby Coppel who is a VP at Yahoo!.

The answer, according to Yossi and the panel speakers, who all run companies with over 100 million users, is that having a good product is not enough; there has to be an emotional connection between the product and its users.

After discussing the process of starting, marketing and improving their products the panel’s conclusion was that users engagement is the result of an emotional involvement between the users and the product and others users and a feeling of participating in creation of something new.

A good example for that is Yahoo’s Q&A service that, according to Coppel, has more than 140 million users a month. Although most users are passive and only read the questions and answers, 5%-7% of the users write answers, and they do so without getting paid – they share their knowledge with the world.
According to Coppel, the emotional connection to a product is achieved by providing a platform to self organize allowing people to create and share knowledge and experiences and find other like minded people.

Baker explained that Firefox’s success is based on the sense of mission – to build a piece of the internet that is a public assert – which turns out to be an emotional goal for a lot of people.

And what about YouTube? Chad Hurley explains its success on the focus on creating a simple-as-possible user experience and allowing people to distribute content by embedding videos  – “We try to associate our easy to use service with our brand – YouTube – and to allow people to take that experience, take that video code to embed and place on their own websites and blogs so that people can experience it there as well and drive traffic back to our service. Beyond creating a service that adds value people need to connect emotionally to the brand that you’re creating”.

To demonstrate the importance of emotion, Yossi Vardi showed two YouTube videos of the aria Nessum Dorma. The first video, sang by Pavarotti only received about 9 million views while the second video, sang by Paul Potts, a hobbyist opera singer, received well over 40 million views.

Vardi later asked Hurley why the second video was so popular. “Well he’s good” was Hurley’s answer.

Similar Posts:

• Give Up Control, Think Distributed – DLD 2009 Summary
• Microsoft Updates Its Windows Live Services
• No Hope for Traditional Media Companies?
• Comcast Acquires Plaxo
• Are You Designing for Bigfoot?

Guy wrote a post about rendering an RSS feed on ASP.NET MVC using custom feed model classes and a view that renders the feed XML.

There’s a better (shorter) way for achieving the same result while leveraging on the Syndication mechanism built into .NET’s WCF.
WCF exposes the SyndicationFeed, SyndicationItem, SyndicationPerson classes which represent our data model.
In order to render this model WCF also exposes the Atom10FeedFormatter, and RSS20FeedFormatter classes that can render the feed to a stream, so all we need to do is integrate that into the ASP.NET MVC pipeline.

The ASP.NET MVC framework introduces a concept of returning an ActionResult instance as the result of Controller Actions.
This ActionResult object indicates the result from an action (a view to render, a URL to redirect to, another action/route to execute, etc).

ASP.NET MVC ships with several Action Results:

• ContentResult – Simply writes the returned data to the response.
• EmptyResult – Returns an empty response.
• HttpUnauthorizedResult – Returns Http 401 code for non authorized access.
• JsonResult – Serializes the response to Json.
• RedirectResult – Redirects to another Url.
• RedirectToRouteResult – Redirects to another controller action.
• ViewResultBase (abstract) – Renders an HTML content as a result.
  • PartialViewResult (inherits from ViewResultBase) – Renders a partial HTML response.
• BinaryResult (abstract) – Returns a binary response.
  • BinaryStreamResult (inherits from BinaryResult) – Writes a binary stream as a result.

So basically, to return a feed result all we need to do is define our own ActionResult implementation by deriving from ActionResult:

public abstract class ActionResult
{
    protected ActionResult();

    public abstract void ExecuteResult(ControllerContext context);
}

All we need to do is override the ExecuteResult method and write our data model to the output http stream using RSS20FeedFormatter:

public class RssActionResult : ActionResult
{
    public SyndicationFeed Feed { get; set; }

    public override void ExecuteResult(ControllerContext context)
    {
        context.HttpContext.Response.ContentType = "application/rss+xml";

        Rss20FeedFormatter rssFormatter = new Rss20FeedFormatter(Feed);
        using (XmlWriter writer = XmlWriter.Create(context.HttpContext.Response.Output))
        {
            rssFormatter.WriteTo(writer);
        }
    }
}

Now we can simply return RssActionResult as a result of our controller’s action.

Here’s a simple example:

public ActionResult Feed()
{
    SyndicationFeed feed =
        new SyndicationFeed("Test Feed",
                            "This is a test feed",
                            new Uri("http://Contoso/testfeed"),
                            "TestFeedID",
                            DateTime.Now);

    SyndicationItem item =
        new SyndicationItem("Test Item",
                            "This is the content for Test Item",
                            new Uri("http://Contoso/ItemOne"),
                            "TestItemID",
                            DateTime.Now);

    List<SyndicationItem> items = new List<SyndicationItem>();
    items.Add(item);
    feed.Items = items;

    return new RssActionResult() { Feed = feed };
}

… and that’s it!

A more elegant solution that leverages existing framework capabilities.

Related Posts

• RSS Feed with the new ASP.NET MVC Framework (Brad Abrams)
• ASP.NET MVC RSS Feed Action Result (Guy Burstein)
• RSS Feeds in ASP.NET MVC – StackOverflow

Similar Posts:

• Developing a Robust Data Driven UI Using WPF – The DataModel
• Lets Socialize
• Is Windows Live Still Alive?
• Developing a Robust Data Driven UI Using WPF – Stock DataModel Sample
• Migrating from dasBlog to Wordpress

Originally published on Cloud Avenue.

About a month ago, Microsoft rolled out its previously announced 3rd wave of Windows Live Services refresh.
The purpose of the release was to position the Live Services as the central hub for everything you do online – the new Live Home shows input from your various services (Hotmail, SkyDrive, etc.) as well as an activity stream composed of your friends’ activities on both Live Services as well as other external services such as Twitter, Flickr and blogs…

What initially seemed like a promising new start for Microsoft, leveraging on its already existing Live Messenger social network now seems, a month or so after its rollout is pretty much dead. Most of the people I know (including myself) that tried using the new Live Home quickly gave it up as its simply as there’s simply nothing to do there – with an anemic design and an activity feed that does not allow any interaction, Microsoft’s new homepage is simply a “Read-only Social Network”.

Microsoft missed out on what makes a social site successful – social interaction! duh!

It should have encouraged users to interact using its platform by allowing rating / commenting / sharing / replying / etc. on feed items.
By not doing so Microsoft is actually making users leave its homepage platform to use other services (Twitter, FriendFeed, etc.) when they actually want to do something with the content – rendering its platform pretty useless.

All that is left now is to wait for the next wave, expected at the end 2009 Q4, and hope for a more mature product that can… well..  Live.Similar Posts:

• Microsoft Updates Its Windows Live Services
• Microsoft Can Clone Twitter?!
• To Which Social Network Site Do You Pay to Use and Why?
• Microsoft to Take Over Yahoo?
• Microsoft+Yahoo – Some Thoughts on Possible Implications

  It’s the end of the year, and like most bloggers I decided to take a look at my blog’s performance over the last year…

My Top Posts (According to Google Analytics)

Here’s are my top 10 posts from 2008, as ranked by Google Analytics:

1. The Dark Side of LINQ
2. 99 Ways to Become a Better Developer
3. Wordpress – 10 Tips and Recommendations
4. Scaling Web Applications – Recommended Readings
5. Developing a Robust Data Driven UI Using WPF – The DataModel
6. Developing a Robust Data Driven UI Using WPF – Introduction
7. Microsoft’s Next Killer OS is… SharePoint?
8. WPF Screen Saver Template for Visual Studio 2008
9. Google Applications for your Domain – Does it Measure Up to Expectations?
10. How Do You Define "Good Code"?

Personal Favorites

The following are a couple of my personal, somewhat overlooked, favorites:

• Looking For New Adventures – On May of this year I left my (pretty cool) job with the Duet team at SAP to face the unknown…
• Google Chrome is a Failure… Surprised? – Originally published on Cloud Avenue and triggered an interesting discussion worth going through.
• Are You Designing for Bigfoot?
• Is Google Replacing My OS Again?! which was followed by On Google’s Chrome and The Future of Cloud Computing.
• Introducing Kampyle – The Next Generation of Online Feedback. Just because I got to be the first to write about my friends company and I think this post written a lot better than the many posts that followed on TechCrunch etc.

That’s it. All wrapped up and ready for 2009!

Similar Posts:

• Google Chrome is a Failure… Surprised?
• Cloud Avenue
• On Google’s Chrome and The Future of Cloud Computing
• Microsoft’s Next Killer OS is… SharePoint?
• Amazon S3 Storing 29 Billion Objects

I encountered this post on my weekend reading. 91 Surefire Ways to Become an Event Greater Developer contain a comprehensive guide linking to all sort of blog posts providing insights on improving your skills as a developer.

While the list is very long and sometimes debatable it does have some interesting pointers. If you do nothing else, delve into item #8: Learn Programming by Not Programming referring to the following post by Jeff Atwood.

The topic in question is why some developers outperform their peers regardless of their accumulated experience:

But the dirty little secret of the software development industry is that this is also true even for people who can program: there’s a vast divide between good developers and mediocre developers.

A mediocre developer can program his or her heart out for four years, but that won’t magically transform them into a good developer. And the good developers always seem to have a natural knack for the stuff from the very beginning.

The answer lies in the quotes taken from Bill Gates remarks:

“The older I get, the more I believe that the only way to become a better programmer is by not programming. You have to come up for air, put down the compiler for a moment, and take stock of what you’re really doing. Code is important, but it’s a small part of the overall process.”

“To truly become a better programmer, you have to to cultivate passion for everything else that goes on around the programming.”

“The nature of these jobs is not just closing your door and doing coding, and it’s easy to get that fact out. The greatest missing skill is somebody who’s both good at understanding the engineering and who has good relationships with the hard-core engineers, and bridges that to working with the customers and the marketing and things like that.”

Eric Sink makes the distinction even clearer in You Need Developers, Not Programmers drawing a distinction between Programmers who are only excited about writing code and basically only care about doing that, and Developers who contribute to the software product in many ways.

The Great Programmer\Hacker Stereotype

You all know that guy (hell, most of us were that guy when we just started out, I know I was) – he has great technical skills, likes writing code and can spend hours within his IDE writing code that’ll make most of us scratch our head. Yet, he views the world only in one dimension – code. Business? that’s for the managers to figure out. Sales\Marketing? annoyances for others to take care of. Documentation? but the code is so obvious…Builds? Deployment? Configuration? …

Passion for code is a great quality. But as a specialist its all too easily digging yourself deeper and deeper into a skill you’ve already proven yourself to be capable at when you’d be better of using the time to cultivate other skills that are part of the process of making software – rendering yourself obsolete over time…

The great hacker is a one trick pony – he writes great code but that’s about it…
Most of these guys end up working alone as consultants or freelancers where they don t have to care about that other stuff, or they end up as programmers at some big firms where there’s more room for specialists doing specific jobs (Architects to architecture, PMs do project management, Programmers code…).
On the other hand, those who truly like making software, open up to the other aspects of software development.
When that change in mindset happens, that’s when you can truly grow exponentially…

So what do I do?

Ok, I guess you got the point… But how do you get started?  Here are my own 5 cents on the topic…

Read, Read and Read Some More…

We’re in an industry that is moving forward at a fast pace. Technology becomes obsolete every year and a half or so and as developers we have to constantly struggle to keep up. Books are not only great to help you keep up but also to expand your knowledge to other fields.
There are plenty of interesting books and blogs about, well, pretty much everything.
Here are some recommendations to get you started:

Oh and one word about programming books: the best ones are timeless, transcending choice of language, IDE and platform.
I try to stay away from them thick, heavy, language\platform specific references – most of them go out of date after a year or so anyway and most of the information there could be easily obtained elsewhere (online – Google, the product’s docs, blogs…)

Most programming big are just a waste of your time (and money…)

Contribute to an Open Source Project

Back in the days of Delphi I was involved in Project JEDI dedicated to exposing different APIs (especially the Win32 API) to Delphi developers.
I learned a lot working with the JEDI code base, documentation, samples and other team members.
Later when it was time to get drafted to the Israeli Army (we all have to do it at 18 here) the experience, credit and code samples help me land a (very) exclusive position as a programmer. Who knows where I’d be today if I didn’t qualify and had to serve as a combatant…

Contributing to an open source project is a great way to gain experience, learn and get better.
There are no job interviews to pass, degree requirements or commitment to working hours or schedule required – you can just join in and start submitting patches or contribute in ways other than code (submit bugs, docs, support, …).

You can learn a lot just from studying the code and interacting with your peers…

Contributing to open source shows dedication and passion – its a walking talking resume.

Get a mentor

Find yourself a mentor or mentors who can teach you about different aspects of the business. I’ve had several at SAP and talking with them proved to be an invaluable asset (If you’re reading, thanks! )

It doesn’t have to be official mentoring which is part of the person’s goals or job description. Many of your peers are experts in their field and they’ll be happy to show you around if you just show some interest…

Become a Mentor

Great developer are eager to learn… and teach. Can you pass you passion and knowledge to others?

You can also…

• Open a blog about your experience, opinions, etc.
• Start answering questions at stackoverflow.com and collect achievements

Land an Internship

Try getting an internship in a different role. When I was in SAP they had a special program allowing employees to apply for a ~6 month position somewhere within the company. The reason behind it was to get employees familiar with different aspects of the company. Maybe product management, marketing or sales in not really your first choice of profession but why not try it for a couple of month without the risk of going through a career change? How cool is that? I’m sure many large corporations has something similar and even if not, it can’t hurt if you come up with such an interesting offer to your boss…

Own a Product Area

Get ownership on some part of the product your team is working on. Weather a specific component or a vertical (like Security) you should be in charge of getting it done – from getting the definition done with the product\sales\business team, through UX, development, QA, etc…
There’s nothing better than learning about the process of software development through experiencing the entire cycle…

Innovate

Start something new. When working on Duet we’ve had many issues getting the thing deployed. So I made a tool for (myself mainly) our QA and RIG (regional implementation group – the guys who work with customers) to help diagnose problems. This later became the official Duet Support Tool and got its own dedicated development time. Is your product, development environment perfect? I’m sure not… find a need a feel the gap…

Why? If by owning a product area you learned about the entire development cycle, here you’ll learn about defining and “selling” to the team…

Bonus Reading…

Another link worth visiting is the one about the Metrosexual Developer. Funny and true…

Related:

• So you want to be a great developer?

Similar Posts:

• Quest for Glory – So You Want To Be A Great Developer?
• Are You Designing for Bigfoot?
• How Do You Define “Good Code”?
• Yahoo Releases Its Own Hadoop Distribution
• Sergey Is Leaving Google For Microsoft (Not THAT Sergey…)

We’ll be at the WordCamp Israel 2008 convention tomorrow showing off some of the latest Nuconomy developments (and of course, our WordPress plugin).

Here’s Niv surveying last year’s visitors:

See you there!

Similar Posts:

• Migrating from dasBlog to Wordpress
• TechEd Eilat 2008 Blogging Thoughts – It’s About the People
• Introduction to LINQ
• Cloud Envy
• Microsoft and Yahoo! … Revisited…

If you like the scrolling functionality as implemented in the iPhone (and Zune etc.) you’ll be happy to know its part of the Windows 7 operating system and implemented for anything with a scrollbar.

More Windows 7 goodies on Rafael Rivera’s blog…

Similar Posts:

• Is Google Replacing My OS Again?!
• Facebook Opens Itself to the Web
• My Takes From the Silverlight Firestarter Event
• Windows Live Services – It’s Still About Windows
• What Possible Harm Can One Insane Mutant Tentacle Do?

(Cross posted from CloudAve)

Microsoft announced today its rollout plans for the 3rd wave of Windows Live services.

The goal of this latest release wave, according to company officials, is to simplify the use of the offered services and unify the user’s entire online experience into the Windows Live interface.
Microsoft is planning to rollout the new services, currently in beta, to the public within the 1-2 months timeframe.

Windows Live Goes Social

One of Microsoft’s main emphasis with the current wave of services is on social networking between users using its services.

Microsoft finally figured out that its Live Messenger with about 268 million users worldwide, is by far the most popular instant messaging software in the world, is actually a social networks. With the new release, your Live Messenger contacts are now your Friends and you can see aggregated information about their activities on the net.

Very much like Plaxo, FriendFeed etc. Microsoft allows users to bring into their profile content they create in all sorts of services on the web (Live Services, Flickr, LinkedIn, blogs and RSS feeds, …) and share it with their friends and colleagues.
When users add photos, write reviews, and update their profiles directly on Live.com, that content will be put into their activity stream as well.
This activity stream is exposed in all sort of ways throughout Microsoft’s services interface.

For example, Microsoft’s new Live Home portal shows the latest events in your social network. When emailing a friend or chatting on Messenger you’re also able to interact with that friend’s activity stream and more…

Not just for private consumers…

I’ve been told that all these new service updates will not skip Windows Live Domains used by universities and organizations to create a personalized version of Microsoft’s services.
If that really the case, having all these new social capabilities as part of its domain offering can be amazing for collaboration and communication inside the organization.
While Google doesn’t seem to care about its Google Applications for Your Domains customers its good to see that Microsoft is going forward with Live Domains.
This latest update may just be the final straw I need to make the switch to Live Domains…

Where’s Live Mesh?!

It will be really interested to see where Live Mesh comes into the picture in regards to all of these Live services.
Live Mesh should be the glue bridging between Microsoft’s online services and its offline applications and devices (S+S) allowing users to sync all their content- contacts, photos, events, favorites, etc. – across devices and services.
Unfortunately, there’s no clear answer for that…

During the launch we’ve only heard about Live Sync allowing users to sync photos across computers. Some sources say its an incarnation of FolderShare and in any case it doesn’t seem to be based on Live Mesh technology.
With Live Mesh being one of Microsoft’s core platform offering its really hard to understand why we need to have Live Sync too…

Other notes…

• All the services are released simultaneously in all countries and in 48 (!) languages.
• Windows Live Skydrive size limit has changed from 5GB to 25GB
• Windows Live Hotmail looks and feels a lot better to use.
• I’ve uploaded all the screenshots of the new services to my SkyDrive:

Similar Posts:

• Is Windows Live Still Alive?
• Office Web Applications
• Microsoft+Yahoo – Some Thoughts on Possible Implications
• Windows Live Services – It’s Still About Windows
• New FolderShare!

(Originally posted at Cloud Avenue)

This year’s Microsoft Profesional Developers Conference is full of announcements and surprises. The next big announcement besides Windows Azure (and Windows 7?) is the new “Office Web Applications” live service. The Office team will be delivering the five most popular Office applications as light weight browser based versions that include Word, Excel, PowerPoint, and OneNote.

Here are some of the demo screenshots available:

The applications will be offered in both a simple HTML/AJAX version and a rich-client Silverlight version.
Office Web Applications are not planned to replace Microsoft’s traditional desktop offering but rather complete it, together with Mobile Office for mobile devices, allowing users to seamlessly work on their documents across all environments.

Providing such a reach collaboration environment isn’t a simple task as you can see in the following interview of Antoine Leblond, Senior VP of Office Productivity Apps and Chris Bryant, General Program Manager:

Although its not meant to replace its Desktop Office offering, one of Microsoft’s biggest cash cows, one has got to wonder about the risk these new services to cannibalize their big desktop brother’s profits. Windows and Office, which are Microsoft’s core business, are likely to stay its core moneymakers for at least the next 2-3 years, maybe even longer.
This move clearly shows that Microsoft is starting to think beyond that and along with its other platform announcements (Azure, Live Mesh…) we can clearly see a trend away from desktop software to rich clients installed from the web….

Office Web Applications will be released to a limited set of partners and customers at the end of this year. The release date will closely align with Office 14 and Windows 7 which will be sometime in late 2009 or early 2010.
Microsoft plans to make Office Web Applications available as a service through its Live platform supporting both an ad-funded and a paid-subscription models.
Business users that require an on-premise will be able to do so through Sharepoint via its traditional volume licensing program.

Similar Posts:

• Microsoft Updates Its Windows Live Services
• Windows Live Services – It’s Still About Windows
• Duet: An Enterprise S+S Offering From Microsoft And SAP
• Microsoft+Yahoo – Some Thoughts on Possible Implications
• Microsoft Can Clone Twitter?!

(Originally posted at Cloud Avenue)

Windows Live™Microsoft’s Windows Live ID team just announced their support for OpenID calling it a “de facto standard Web protocol for user authentication.”

Beginning today, Windows Live™ ID is publicly committing to support the OpenID digital identity framework with the announcement of the public availability of a Community Technology Preview (CTP) of the Windows Live ID OpenID Provider.

You will soon be able to use your Windows Live ID account to sign in to any OpenID Web site!

What does it means for users?

OpenID allows users to maintain their identity information (Name, E-Mail, address, etc.) on a single provider and use that information to register and login to any website that supports OpenID. This relieves the user from having to fill out registration form and maintaining multiple different user names and passwords and profiles on different sites add provides a simplified online experience while increasing security.

Over 400 million LiveID users will soon be able to use their LiveID to do just that – login and provide identity information to any site supporting OpenID without the hassles of filling out registration forms and saving user\password information and with the user experience common to all OpenId sites (or, maybe even common to their familiar LiveID user interface?)

The wide adoption of OpenID led by Yahoo and Microsoft provides the required push for site owners to support OpenID providing the same simple and familiar login interface everywhere…

What does it mean for web developers?

With a simple integration effort that shouldn’t take more than a couple of minutes, site owners can relieve themselves from taking care of authentication and registration process while providing their users with a simple familiar interface for signing up and using their services.
OpenID provides an easy and secure mechanism for authenticating and registering users, and with additional online services (like JanRain’s RPX) site owners can handover the entire care of handling their user information to the cloud – cheaper, faster, more secure.

For now, the LiveID team is testing their system’s OpenID Provider which is at a CTP (Community Technology Preview) stage. Widespread support is planned for “sometime in 2009″.

[Update: Screencast Overview]

Similar Posts:

• Microsoft’s Next Killer OS is… SharePoint?
• Duet: An Enterprise S+S Offering From Microsoft And SAP
• HEROES Happen {here}
• Microsoft Updates Its Windows Live Services
• Introducing Kampyle – The Next Generation of Online Feedback

Last month Google released its Chrome browser to the public and as usual it made a lot of PR noise (and a comic book) and got lots of favorable reviews

Google released its Chrome browser to the world about a month ago. It made a lot of PR noise, a comic book, and squeezed some outrageously favorable remarks from critics.

“When combined with Gears, which allows for offline access, Chrome is nothing less than a full on desktop operating system that will compete head on with Windows. “

Michael Arrington in “Meet Chrome, Google’s Windows Killer” (TechCrunch)

A month later, is Google Chrome even close to the the expectations set on its launch?
Read about it Cloud Avenue…

Update October 21th, 2008:

Be sure to read the discussion on the comments section at CloudAve and Krishnan’s response post…

Related stories:

• On Google Chrome and The Future of Cloud Computing
• Is Google Replacing My OS Again?!

Similar Posts:

• A Year’s Worth of Popular Posts
• On Google’s Chrome and The Future of Cloud Computing
• Is Google Replacing My OS Again?!
• Cloud Avenue
• Cloud Envy

The hero of our story is Michael Arrington of TechCrunch.
The background for the following discussion is a post made by Dare Obasanjo referring to TechCrunch as FuckedCompany 2.0. A response on TechCrunch was soon to follow, blaming Microsoft as a company for the things said.

(You can read the full details  here and here)

The discussion then moved to Twitter where it deteriorated pretty fast:

Regardless of the topic and which side is wrong or right, discussion should reach this kind of level…

While Dare’s blog may have an impact on Microsoft’s brand, its no question that whatever Michael does impacts the TechCrunch brand. The above discussion doesn’t do well to TechCrunch…

The of the story? Never (ever!) write when you’re upset.
Or to be more exact, take the night to sleep it off before you publish it. If you still think your text is ok on the next morning, then by all means publish it.

Remember that text (e-mail, blog post, twit, etc.) is a terrible medium for communicating emotion. The reader can’t see your facial expression or hear your vocal intonation. Therefore, any negative emotion that is expressed in the text is probably going to be perceived several times stronger – much more than intended – probably just causing damage instead of getting your point across.

When I was at SAP it wasn’t uncommon for me to get really upset and write long, angry emails through the night. Most of these never saw their way outside of my drafts folder. I would wake up the day after and figure out that things aren’t that bad, that there’s a better way of handling it, or simply that I have to pick my battles and that there’s more important stuff to spend my time on…

I’m sure Michael’s reactions are just a result of frustration and the heat of the moment. In fact, Michael edited the post and removed the controversial paragraph the day after.
Everything’s brighter on the morning after…

(P.S., if you just can’t hold it until the next morning, at least take a moment and listen to yourself. You’ll get a different perspective doing a second reading. I used to have a rule in my Outlook to elay delivery on any email I send by 2 minutes. It helps….)

Similar Posts:

• Blogging Commitment…
• Facebook Fan Page – Add Community Features to Your Blog
• Short Introduction to Powershell
• New Blog Feature – Audio Alternative
• Google Chrome is a Failure… Surprised?

Omer (our gracious host) just announced it on his blog.
I’ve never actually attended one of these before (I just happened to be abroad on the last dinners) so I’m expecting to meet everyone there…

The location is yet undecided (depends on you people) and you can RSVP at the event’s Facebook page.
Go on and spread the word…

Here are a couple of links to help you remember:

• Microsoft Outlook
• Windows Live Calendar
• Apple iCal
• Yahoo! Calendar
• Google Calendar

See you there!

* Yes I stole the picture from Scott’s blog…
** http://events.live.com is actually useful! Kudos to Microsoft….

Similar Posts:

• Anxiously Waiting for the MacWorld2008 Keynotes… (Coverage Links Inside)
• Microsoft+Yahoo – Some Thoughts on Possible Implications
• Windows Live Services – It’s Still About Windows
• Microsoft Updates Its Windows Live Services
• Microsoft to Take Over Yahoo?