Eyetools Eyetracking Research

Small decreases in viewing can decrease the probability of being clicked by more than 50%

2008-02-01T11:06:50-08:00

For a long time, proponents of eye-tracking have said that the amount of viewing a link receives directly effects its likelihood of being clicked. Well, it turns out that this is particularly true in the case of search results. Recently, Eyetools and Sendtec released a study showing that a decreased viewing on a search results page has a huge impact on click-through conversions. This is true for both paid and organic listings.

For example, the data shows that if overall viewing of a link falls from 80% to 60%, the initial probability that the user will select the link decreases by over 50%! This helps to explain why even small drops in page position for organic search links has such a significant impact on a site's conversion rate.

In addition to emphasizing the need for ads and organic listings to have high page positions, this result also means optimizing link performance is critical since not everyone can be a top organic or adwords listing.

These results may seem obvious in hind-sight, but I admit that I was very surprised to see just how big the price a page element can pay if it's not seen. I've included the excerpt below in the hopes that it will open a dialogue about the effect of increased viewing for other kinds of web pages.

Click here to read the full report on Sentec's site.

----------------------- REPORT EXCERPT -------------------------

The graph shows an important correlation between increased link viewing and the probability of being clicked. [...] The page elements which received the most clicks were those seen by the most users. As user viewing decreased, so did the number of clicks. [... Our data shows that] decreases in viewing will have a disproportionately large negative impact on click-through.

A number of other studies have explored various factors which influence a user’s decision to click including link text, description, and perceived link relevance. Our study shows that percent user viewing can be an excellent predictor of user click behavior for online searches. Our study supports the logic that users must first see a link before they can make selections based on text descriptions or relevance. There are many factors which contribute to whether or not a user decides to select a link, but all things considered, eye tracking data is a reliable and efficient way of understanding why people do and do not click.

It is important to note that this data is specific to search results and should not be used in conversation about standard web pages. Eyetracking has proven to be very helpful in directing redesigns of web pages, landing pages, and emails with great increases in conversion rates, but this data presented here is specific to search result pages and should not be generalized to other pages.

Article by Teresa Hernandez - Eyetools, Inc.

Eyetracking the Google Checkout Button: it does not increase viewing significantly, but... - study by Eyetools / SendTec

2008-01-04T10:10:10-08:00

If you're hoping that adding Google Checkout to your search result will boost viewing of your ad by making it stand out on the page, it won't much. However, it does seem to increase clicking by those that do see it, so that's probably all you care about!

The Eyetools/SendTec Google Checkout Button Study covers the details, and InternetRetailer reviewed the results here (though ironically they didn't include a link to the study, and there is no place to leave any comments, so feel free to leave comments here).

Most interesting to me personally was the strong correlation between clicking and viewing/looking, which I'll blog about tomorrow.

Once you've read the study, give us a call to discuss how we can help optimize the conversion rates of your webpages, landing pages, and emails.

Yahoo Search Assist uses Eyetools eyetracking to optimize design based on eyes and where people look

2007-10-03T11:02:31-07:00

You can check out the CBS news video at http://cbs5.com/video/?id=27290@kpix.dayport.com (alternately, try http://cbs5.com/video/ and search for "yahoo search" since sometime the video doesn't load)

About 1 minute into the video, Yahoo shows an eyetracking heatmap generated by Eyetools software and talks about how Yahoo used eyetracking data/heatmaps to optimize the Search Assist design. They're calling it "the biggest consumer improvement to its search engine... ever".

(Begin self promotion: contact us if you'd like to optimize your webpages, landing pages, and emails. We've helped tons of large and small companies, we can help you.)

Common email layouts: B2C electronics template

2007-09-17T11:18:36-07:00

Click to enlarge

Click to enlarge

We test a lot of emails at Eyetools... newsletters, B2C, B2B, membership correspondence, etc. One of the more common layouts we see used by large retailers is a print-advertisement style product layout. In general, these templates never test particularly well. We have been using one of these emails as our simple report example for a while now. I thought the report content might be of interest to blog readers, so here it is. If there are questions regarding the results, please let me know.

The PDF of this sample report can be downloaded here .

Note: This is a brand modified sample The email was received through a Fortune500 retail company’s opt-in email list. The branding was removed, but basic layout and graphical elements were retained. The analysis has been kept simple, but shows the benefit of even a quick eye tracking study.

____________________________________________________

Eyetools Sample Email Report

Overview

Number of participants: 17
Demographic: General
Average viewing time: 14.6 sec
Number of people who clicked: 1

Diagnosis

This email performed at a suboptimal level. The majority of viewing was concentrated on the text of the top two sections (“24” and “CP Challenge”)

The layout of this email does not guide viewers eyes effectively through the entire email. The most dramatic improvements in viewing would likely be seen if the layout of the main content area were restructured.

Improved copy in the top 33% of the page will improve read through in these sections and may increase scrolling behavior. Copy improvements in the lower 66% of the page will have little or no effect on read through.

Critical Messaging

The words and images highlighted in the red/yellow areas define the "window of opportunity" this email has to grab its readers. Everything outside of that "window" was not looked at by most people (and if they don't read it, they can't be affected by it ).

If the critical message isn't being read or isn't clear, then focus initially on rewriting the areas with the highest concentrations of reading (the red, then orange, then yellow areas).

Diagnosis

The message read by most people (at least 60%) was:

Company Logo

“24 Days of HD… Instant… Last Chance”

“Are you ready … the CP challenge … with… 1/29”

“Watch”

The majority of viewers did not get a cohesive message which included a specific sales pitch or call to action. If this page layout is maintained, improved copywriting is vital to improving read through in each of the top section of the page.

Did They Scroll?

The red lines show where each person
stopped scrolling. It is a myth that everything has to be above the fold, but data has shown that clutter and bad design will greatly reduce scrolling and visual hotspots below the fold.

Diagnosis

Most people are scrolling, which is good. This means that this email has the potential to do even better.

However, the 33% that stopped scrolling early in the email, did so before reaching the individual sale item listings. The top 33% of this email is comprised of 4 major horizontal elements, each with a “banner ad” composition. Viewers skimmed the ads, becoming less interested, and less patient at each subsequent section. Much of this result is due to poor copywriting (See “Critical Messaging”).

In the page structure at the top of this email, viewing is helped by the fact that each section heading is aligned on approximately the same vertical axis. However, as soon as the 3 column format is introduced, common viewing areas decrease dramatically.

Improving the structure and copy in the top section of this email will likely result in increased scrolling by a larger percentage of viewers.

Identifying Design vs. Text/Copy Problems

The green and blue areas highlight those areas read by people who engaged the email more. Because the blue areas indicate where viewers read content quickly, the placement of important text becomes increasingly crucial, particularly in areas below the “fold ” (the yellow dotted line).

Broadly speaking, if a critical area does not have a strong hotspot (orange/red) on it then The design is not guiding the users’ eyes effectively. If, however, a hotspot exists and users are starting to read the text but do not get to the critical messaging, then the area has a copy/text problem.

Diagnosis

Poor read through in the top section of this email is due to poor copy. The heading are high contrast and catch the viewer as they scan the page. However, the first 2-3 words or each headline are relatively uninformative (i.e. “Are you ready”, “Watch the”).

A 3 or more column layout is generally suboptimal for viewing, especially in an email. In this email 80% of participants ignored the right most product column completely. When viewing this email, participants selected one of the 3 vertical columns and skimmed downward. This proved problematic for sale items spanning 2 columns.
In the lower page structure of this email, the product pictures most effectively caught the eye of participants. The outlines around each product primarily disrupted visual flow by creating mini “banner ads”. When viewers see many small distinct units, they are more apt to view one well, and skip several others (even along the same vertical or horizontal axis).

The “Tax Center” section near the bottom of the email was most effective due to it’s large, informative header. This element performed surprisingly well.

User Feedback

User feedback was not collected on this email because it was run only for sample purposes.

Article by Teresa Hernandez - Eyetools, Inc.

But what does it all mean? Understanding eye-tracking results (Part 5)

2007-09-10T12:52:47-07:00

Part V: Time and the Heatmap

Series topics:

Part 1: Misinterpreting the data (intro article)

Part 2: What can you learn from eye tracking data?

Part 3: What is a heatmap... really?

Part 4: What is a scan path?

Part 5: Time and the heatmap

In my previous post, I mentioned that heatmaps do not have a time component. Several people have asked me to discuss this topic in a little more detail, so here we go.

Important point #1:

A heatmap represents which content was seen by a group of participants. A heatmap helps to answer the questions “Where did users look?” and “Where didn’t users look?”

Important point #2:

If you are analyzing a heatmap, you are momentarily saying “Ok, in this instant we don’t care how long people looked at things, we just want to know what they saw.”

A heatmap does not answer the questions:

• How long did someone look at my page or page element?
• Did users look away and look back?

To further clarify these points, here’s a general overview of how a heatmap is created (click illustrations for a larger view):

Step 1: Collect data

A single participant views a web page. We record her eye movements as she browses. This gives us data which can be represented in a gaze replay animation.

Now imagine that the animation is composed of a stack of stills, just like a flip book. Each page of our eye tracking “flipbook” contains the X,Y, and Time coordinates of a single fixation.

Step 2: Collapse individual data sets along the t-dimension

Keep imaging our eyetracking data as a flipbook (3D data structure). Now we will collapse the stack along the time axis. In its most basic form, the calculation will take the area of a web page and note every location where the participant fixated. By collapsing the time dimension, we remove it from all further calculations (poof!)

This means that someone who fixated the center of a page for 100ms will end up with the same fixation summary as someone who stared at the center of the page for an extended period of time.

Of course, the algorithm for doing this computation is more complex than the example I just presented. Any heatmapping algorithm should take into account peripheral vision, microsaccades, blinks, fixation duration, “bad data”, ocular drift, dynamic page behavior, etc. For now let’s continue with the simplified example.

Steps #1 and #2 are completed for, oh, say 15 people total. This gives us 15 individual fixation summary plots.

Step #3: Compute an average viewing value for each pixel of the webpage

Again the algorithm which handles this step is more complex than what is presented here, but the basic idea is…

For every pixel of a web page, the system asks “how many people saw this pixel?” If 10 people saw the pixel out of a group of 15, then the algorithm says “66% percent of people saw this pixel… color it yellow on the plot.”

This averaging algorithm outputs a heatmap showing what percentage of participants saw each page element. Handling the data in this way keeps any single individual from biasing heatmap percentages. For example, imagine that 14 people only looked at the center of a page, and 1 person looked at the entire area of the page. Even though 1 participant viewed a much larger area than anyone else (and probably spend a goodly amount of time doing it), she still only represents 6.7% of the 15 person group. The resulting heatmap would then show that 100% of people fixated the center of the screen, and less than 10% looked elsewhere.

Other questions that have come up:

If you make a heatmap from only the first 10 seconds of viewing, doesn’t that add a time component to the heatmap?
The answer is no. The method for computing a heatmap is the same no matter how large the time sample used. When you slice for specific time intervals, you are just selecting a specific group of fixations to include in the calculation. The resulting heatmap still has no time component.
Are heatmaps created from time slices more valid or informative than those created from full experiment sessions?
I suppose that depends on the kind of information you want to get from the plot. If you want to see where people looked in the first 10 seconds, a time slice heatmap is appropriate. If you are trying to understand an order for page element viewing, a heatmap is probably the wrong analysis tool. If you want to see where people are looking over their entire experience with the page, a full session heatmap is the way to go.

This is the last planned installment of our “But what does it all mean?” series. However, the discussion is still open, so if anyone is interested in other topics, just let me know.

Article by Teresa Hernandez - Eyetools, Inc.
Illustrations by Boyd Richard - Eyetools, Inc.

But what does it all mean? Understanding eye-tracking results (Part 4)

2007-09-06T09:51:49-07:00

Part IV: What is a scan path?

Series topics:

Part 1: Misinterpreting the data (intro article)

Part 2: What can you learn from eye tracking data?

Part 3: What is a heatmap... really?

Part 4: What is a scan path?

Part 5: Time and the heatmap

I believe I referred to “scan paths” or “fixation patterns” in earlier entries. Understanding scan paths are critical to interpreting eye movement results.

A scan path is a sequence of eye fixations made when someone samples a visual scene. Put simply, a scan path is the path our eyes follow when looking at an image.

One scan path image shows the sequence of fixations made by a single user. Please note that individual fixation patterns are very noisy. However, if you look at a number of these traces, patterns can emerge. What we look for in individual scan paths are “orderly viewing patterns”. In other words, we try to determine whether or not a person’s order of fixation follows a logical flow through a page.

Sample email heatmap (15 participants) and scan path.

At Eyetools, we produce scan path images which look like the image to the right. A key to this can be found on our website.

Qualitative analysis of scan path patterns is critical to any (usability targeted) eye-tracking study. Scan paths can be especially useful when presenting to design, marketing, and usability groups. They very effectively illustrate how individual users are navigating the page. However, when doing your basic analysis, experience and a working knowledge of eye movement/scene search literature will get you the most reliable read from these results.

There are many ways to discuss gaze traces.

Here are just a few examples of the imagery I've found works well when explaining traces:

Think of view flow as a stream. Are users flowing smoothly and unhindered through page content? Are things like ads or section breaks helping to guide the eye, or is the design placing a big boulder in the stream forcing users to detour around a section?

Is there a "spaghetti effect"? Do many individual scan path images look as though someone dropped a handful of spaghetti on the page? (splat!) If users are searching a page at random, they are probably lost and aren't internalizing the message your page is trying to convey (at least not in the most efficient manner).

Does viewing suffer from a "pendulum effect"? Do viewers use a page element as an anchor point and oscillate back and forth in multiple directions? (Think Foucault's Pendulum) This pattern can result in decreased read-though of content, and has a number of other implications. However, the severity of this problem really depends on the individual page content, design/client priorities, etc.

From this point on, any number of other metrics can be considered for data analysis. The data you choose to examine more closely all depends on what you want to learn from your study.

Continuing the Discussion: Methods and More

A note on software:

At Eyetools, we use in-house software to analyze our data. This has allowed us to develop tools that many commercial software systems don't readily provide. I'm not entirely familiar with the limitations of commercial and open source tools, but I assume that a large portion of stage 1 (heatmap analysis) and stage 2 (qualitative scan path analysis) is very common place.

But regardless of what kind of analysis algorithms you use (commercial, in-house, open source, etc.) it's important for the experimenter to have a solid understanding of eye movement terminology, experimental methodologies, and eye tracking algorithms. After all, it helps to know (1) what you are actually measuring with an eyetracker, and (2) what the measurements mean, and (3) what the limitations of your hardware and software are. (Well, that's true in any field isn't it?)

A note on methodology:

Task instructions and participant preparation (priming) are important concerns in any behavioral or survey style study. Eye-tracking is no different. Rather than discuss methods at length, I’ll just pop in some pointers to other discussions and resources.

• [pdf] Granka, L and Rodden, K (2006). Incorporating Eyetracking into User Studies at Google. ACM Conference on Human Factors in Computing Systems.
• [blog] Matteo Penzo's Introduction to Eyetracking: Seeing Through Your Users’ Eyes
• Suman, S and Bradburn, NM (1983). Asking Questions. San Francisco: Jossey-Bass.

Article by Teresa Hernandez - Eyetools, Inc.

But what does it all mean? Understanding eye-tracking results (Part 3)

2007-09-04T08:28:00-07:00

Part III: What is a heatmap… really?

Series topics:

Part 1: Misinterpreting the data (intro article)
Part 2: What can you learn from eye tracking data?
Part 3: What is a heatmap... really?
Part 4: What is a scan path?
Part 5: Time and the heatmap

A heatmap can be defined several different ways, but as they say, all roads lead to Rome. I find the 2 most useful ways of describing a heatmap are:

1 – A heatmap is an aggregate representation showing what areas a group of people fixated when viewing a webpage or email. The image shows where the sample group looked or didn’t look. Well produced heatmaps should also take into account a reasonable percentage of peripheral vision.

And

2 – A heatmap is a probability map which tells you what page content users are most likely to see. This is only true when the number of individual sessions used to create the heatmap is large enough. At Eyetools, we recommend 15 people in most cases. This number is based on what we have found gets our clients reliable results and the best cost-benefit ratio (bang for their buck).

Brand modified sample email. 17 participants.

Heatmaps are striking images, and very informative analysis tools. However, they are just the tip of the iceberg when performing a proper analysis of eye movement data. This is why companies who specialize in eye-tracking research have begun popping up.

What can’t you learn from a single heatmap?

• View order. Are users scanning the page in the most efficient way possible? Are they forming a coherent message or are they lost? Sometimes a heatmap can be covered in "hot spots" but read through was very low. More analysis is needed.

• Copy vs. Layout Problems. Heatmaps can help experimenters determine whether a page’s layout or copy is responsible for decreased viewing. However, further analysis is needed to make a complete diagnosis.

• How to improve page performance. This is really knowledge that can only be gained through experience. Viewing patterns can be affected by a number of different factors. Heatmaps can help you to understand if there is a problem, but not how to specifically go about making changes. (That’s why we're here. Please excuse the shameless plug.)

• Variability. By definition heatmaps do not have a measure of variability (error bar) associated with them. I have a few thoughts, and (some rather interesting findings) about the variability in heatmaps and other eye-tracking metrics, but that is another discussion all together. If anyone is particularly interested in discussing analysis at this level, let me know.

• Time Components. Heatmaps do not have a time component. Time spent looking at a page element, or the page as a whole, is not represented at the heatmap level.

Article by Teresa Hernandez - Eyetools, Inc.

But what does it all mean? Understanding eye-tracking results (Part 2)

2007-08-30T12:40:38-07:00

Part II: What can you learn from eye-tracking data?

Series topics:

Part 1: Misinterpreting the data (intro article)
Part 2: What can you learn from eye tracking data?
Part 3: What is a heatmap... really?
Part 4: What is a scan path?
Part 5: Time and the heatmap

People often ask me what exactly they can learn from eye tracking. I have a short version answer which is:

We track:

• Where people look
• Where people click
• What people ignore
• And we discover why they decide to click ...or not click.

Why does it work?

• Your eyes are hardwired into your brain and the eyes cannot lie.
• Eyes can’t be "put down" like a mouse between clicks.
• Eyes + clicks + subjective questions give a comprehensive view into the user experience.

This explanation is pretty common, but in reality, you can gain much more insight into the user experience from these kinds of studies. Some advantages of eye tracking studies include:

• Biometric measurements are more accurate than user feedback. User feedback is invaluable, but notoriously unreliable. Feedback regarding feelings, opinions, etc. must be acquired through survey methods. However, measuring natural behavior gives a much more accurate picture of a user’s immediate experience than asking them after the task is complete.

• Eye-tracking data can be used to accurately predict user feedback. This is true for questions regarding ease of use, ease of navigation, etc. All of these items also affect user confidence in the site and company.

• Site navigation patterns can be mapped. For instance, we can map out common navigation paths from a homepage to an interior page, and can begin to understand why some are being used more than others.

• Results are representative of a “natural work environment”. In other words, eye tracking does not require that a moderator be in the room with the user. Obviously the studies are done in a controlled environment, but not having other people in the room makes the experience very comfortable for users.

• Viewing order of pages and page elements can be established. We begin to understand what information is most likely to be seen/missed by users, and in what order. For example, are users viewing a “Free Trial” offer 1st or 15th when seeing the page? Now you can know.

• DHTML elements can be tracked separately. The visual effectiveness and frequency of use of DHTML elements can be studied.

• Short iterative testing can also be implemented. Because we can test prototypes (yes, even jpeg mock-ups), short eye tracking tests can be used to modify designs quickly. This kind of testing is not a standard use of eye-tracking, but is proving to be very effective.

• Page element placement, copy, etc effects can be ranked. Should I change my header text? Move a menu to the right rail? Change the icon size or background? Certain layout changes can be ranked as to how much effect they will have on viewing patterns.

One point to keep in mind is that eye-tracking, like all other usability tests, is not going to provide all of the answers by itself. Eye-tracking is a valuable and powerful tool when implemented alone. But if you want the best over all picture, use it in conjunction with other usability tests, and as a part of an iterative process.

Does eye tracking measure visual attention?

Yes, eye tracking can estimate the areas of an interface which receive visual attention. The “bouncing around” of the eye trace shown in the video is created by a series of fast eye movements called saccades. When your brain is planning an eye movement, it shifts covert attention to the eye’s destination [ 1]. The attentional shift and saccade movement have been shown to be inseparable [ 2 ]. And, of course, once you fixate something, your visual system starts processing the image.

Does this mean that we remember 100% of everything we fixated on a screen? Definitely not. Our brains can suppress images, or use the visual signal to inform any number of low level cognitive functions. Does it mean that what we fixated has had an opportunity to directly affect our experience with an interface? Absolutely.

Gaze trace information helps us to understand the areas of a page which most helped to form a user's visual experience with the site or email.

References:

Here's an EXELLENT introduction to eye tracking and usability:
Matteo Penzo's Introduction to Eyetracking: Seeing Through Your Users’ Eyes

[1] Shipp S. (2004) The brain circuitry of attention. Trends Cogn Sci. 8, 223-30.
[2] Peterson MS, Kramer AF, Irwin DE. (2004) Covert shifts of attention precede involuntary eye movements. Percept Psychophys. 66, 398-405.
[ref] Liversedge SP, Findlay JM. (2000) Saccadic eye movements and cognition. Trends Cogn Sci. 4, 6-14.

Article by Teresa Hernandez - Eyetools, Inc.

But what does it all mean? Understanding eye-tracking results (Part 1)

2007-08-28T12:52:26-07:00

Part I: Misinterpreting the data

Series topics:

Part 1: Misinterpreting the data (intro article)
Part 2: What can you learn from eye tracking data?
Part 3: What is a heatmap... really?
Part 4: What is a scan path?
Part 5: Time and the heatmap

In 2000, the Poynter Institute released their first study analyzing how users view online news websites. Yet, 7 years after eye-tracking made this first major impression on the usability and marketing industries, there still seems to be a lot of confusion over what eye-tracking data can actually tell you about how users interact with your site.

Vague descriptions of methodologies and misinterpretation of eye-tracking data has lead to skepticism about the validity of eye-tracking in usability and marketing research.

Getting answers to common questions

In this next series of blog entries, I thought I’d take a shot at dispelling some small fraction of the confusion surrounding eye-tracking research. Over the next few weeks I’ll address some recurring questions I get about our research, and the optimal use of eye-tracking studies.

Questions like:

• What is a heatmap… really?
• How to read a scan path… and what is a scan path?
• How do you get the most out of eye-tracking analysis? (What many commercial software packages won’t tell you)
• Basic eye movement terminology and why is it important when interpreting results?

Bad web design is not a good thing.

Just to start us off, I thought I’d share one of my favorite misinterpretations of eye-tracking data. This originally appeared in a blog entry last year:

I think web surfing is a hunting activity. The eye is looking for anamolies, for things that don't belong. (That might be why the word anomaly, spelled wrong in the previous sentence, got your focus). […] One of the takeaways is that bad web design might actually be a good thing! Slightly bad design isn't familiar. It's off. It demands attention. (Very bad design demands the 'back' button, of course).

What I learned from eyetracking -- Seth Godin

I have a love/hate relationship with Seth Godin’s article. I love it because it is a perfect cautionary tale about why we should take the time to stop and understand data. Quick assumptions (especially based on eye-movement recordings) can lead to some surprising conclusions. This erroneous interpretation has gotten quite a bit of attention, and has even been mentioned in meetings I’ve had with several designers.

So just a few notes to get us started:

• Bad web design does not encourage viewer attention. It discourages the user from making an effort to understand web content, and only succeeds in getting users lost and frustrated.

• Novel interface design does change looking patterns. However, as long as a website or email is well designed and intuitive, users will learn to navigate it quickly.

• Individual search patterns should almost never be considered alone. The video is interesting and fun to watch, but cannot by itself give useful information about how a broad range of people view the site.

• Individual gaze plot data is always noisy. This is because we normally move our eye 3 times a second. A group of gaze plots must be examined to find patterns in page viewing.

Useful References:

Poynter Studies
2005 Enquiro, Eyetools, Did-It Study -- Google

Article by Teresa Hernandez - Eyetools, Inc.

Eyetracking Circuit City's email template

2007-07-18T22:04:06-07:00

This is the first installment of several that focuses on:

Many companies’ email templates aren’t working and they don’t know it.
Companies can know before they launch a campaign that there is a problem.
Once companies know there is a problem, they can start to fix it.

So, we’re starting today with a Circuit City email, and I’ll making these assumptions for today’s discussion:

People can’t click on what they don’t see, so…
It’s better to have more products seen than less.
It’s better to have your lead promo and branding seen than not.
Circuit City is a good store (I shop there!), so we’re talking about their email, not them.

So, let’s begin!

What if you knew before you launched that…

“What most people see” eyemaps (eyetracking heatmaps) visualize what more than 60% of people focused on. It’s important that most people see your main message.

> The majority of products listed will NOT be seen by most people
> Branding will be missed by over half of the readers
> Tagline won’t be read by 80% of people
> Value Proposition will be missed by 80% of people
> Call To Action will be missed by 90%
> “Free shipping” offer (which is highlighted in red) will be missed by half

...would this be an “effective” email you would want to launch? (or would you want to fix it before you launch?)

Circuit City’s email template suffers from low viewing due to template design flaws. The viewing percentages will vary somewhat month to month as they promote different products, but without a design change their overall viewing will be pretty consistently like this.

So the question is, given the low viewing of their products, how much money is this company wasting each month in lost sales opportunity?

Test your own material | About Eyetools

Designer Advisory Board -- call for participation

2007-03-16T13:49:00-07:00

Frankly, it's not fully fair that clients ask designers to improve the client's metrics, to improve conversion rates, and increase their revenue WITHOUT the designer having some form of feedback mechanism that can be used to optimize design BEFORE it is launched to the public.

This is clearly a different way of looking at the situation. But I think it is appropriate.

I know as a fact that designers can produce more effective material when they are provided direct, objective feedback on the effect of their design decisions (typically ranging from 42% to 300% increases in conversion rate for simple designs, and up to 2000% increases for more involved web pages) than when they are instead forced to just rely on A/B split tests using click-based metrics. Getting feedback from launching a new design and watching click-throughs go up, down, or not do much of anything is really too late and isn't very informative (so 15 different things were changed in the redesign... which one was responsible for the clicks going up or down???)

We work with a lot of agencies and design firms, and definitely want to work with more, but we've seen a number of end-clients shoot down the design firm's recommendation to make use of eyetracking feedback because the client instead expects the designers to just do a great job no matter what.

What do you think?

This is clearly the beginning of a large and open-ended discussion, and it's not a simple one either.

This is a standing invitation for designers to contact me (Greg Edwards, CEO and Founder, 916.792.4538) to discuss what you think about design, metrics, eyetracking, heatmapping, etc. Ultimately, I'd like to start a larger discussion forum on the topic, but I'd like to start it simple and grow it from there.

I look forward to starting a discussion with you. Truly, feel free to contact me, and let's see where this leads to.

Greg Edwards, CEO and Founder, 916.792.4538

Version 2: Google "Golden Triangle" Eyetracking Search report

2006-11-09T22:42:34-08:00

Enquiro uses Eyetools technology, is a good company, and... they've poured over eyetracking data collected on Yahoo, MSN, and Google to produce a report that you can buy here, which updates the information on Search Results that we put together with them originally. Enjoy!

Eyetools in Wall Street Journal: Benefits of Heatmap testing for IBM/Ogilvy/Cisco

2006-07-17T11:51:59-07:00

We're in the Wall Street Journal! (Page B7, and online) Article excerpts:

"Firms Like IBM Are Using Eye-Tracking Technology To Help Redesign Messages"

"IBM says that since starting to use heatmapping in email tests early last year, it has made some simple changes in email design that have led to major improvements in responses from customers. ... click-through rates jumped 60%"

The WSJ article talks about using heatmapping/eyetracking to improve emails. IBM and Cisco did their testing via Ogilvy, who offers our heatmapping/eyetracking testing.

"Cisco, which did a round of email-newsletter (Eyetools) testing last week, says it has found a way to increase the odds of consumers reading more of an email."

From "WSJ.com - Marketers Give Email Another Look", July 17, 2006.

Eyetools in AdAge (about Ogilvy using our eyetracking for its email clients)

2005-07-06T13:14:00-07:00

AdAge wrote about Ogilvy optimizing emails with heatmaps and eyetracking.

This is an Eyetools 'heatmap' of the hottest spots of attention on one email. Click to see larger eyetracking image.

Ogilvy's director of email campaigns, Jeanniey Mullen sees strategic benefit in adding objective feedback/testing into their design process -- they want to always improve the quality delivered to their end-clients.

Ogilvy picked Eyetools as their email testing supplier because of our speed and experience in the space. (Ignore me as I pat myself on the back :-)

Google eyetracking study of Search Results -- on sale

2005-07-05T13:48:00-07:00

You can buy the report quickly and easily.

This report analyzes how different Google ranking and positions increase visibility and click-throughs, and it is finally available for sale! (read SearchEngineWatch's summary).

A lot of work went into this study. The findings are interesting and numerous. Enquiro does really good work, and we're proud to have partnered with them on this study.

Testing & optimizing email campaigns

2005-05-23T12:38:00-07:00

Interest in eyetracking heatmaps on email and e-newsletters seems to be increasing. So far the results have been intriguing -- we've been helping several very large companies communicate their message more quickly and directly to their existing clients.

Branding Effectiveness: Sports Illustrated & FootAction

2005-05-20T08:58:45-07:00

If your goal is branding, you'd better make sure they see the brand!

A full write-up of this example (which is initially a little heavy on the Eyetools self-promotion since this was a corporate piece), follows...

Eyetools is uniquely suited to efficiently assess the probability if an advertisement’s design will successfully enhance branding by measuring what people actually look at in an advertisement. Here we compare two examples to measure the logo’s ability to impact the viewer and thereby lift the brand.

An example: Which Branding is Better?

If you look at these two examples from print advertising, we can make a dramatic comparison between their respective effectiveness. They were shown to the same group of people. They are both sports related. Their creative objectives are similar. They both seek to capture action and energy in their imagery. And yet, their performance is dramatically different.

Good Branding

In the hockey example, the viewers glance at the player to left, and then the group collectively glances to the Sports Illustrated logo on the goalie’s right leg with sufficient concentration to confirm that the majority of the group saw the logo and saw it as one of the initial elements to draw the group’s attention. If an advertisement can grab only a second or two of a person’s attention as it flies by on a bill board or is flipped past in a magazine, ensuring that the viewer notices the name or logo of the advertiser is a basic requirement of success for that ad. To top it off, the complete subtlety of the placement of the Sports Illustrated logo is sublime. By all accounts, this ad demonstrates superb ability to lift the brand of Sports Illustrated.

Bad Branding

By contrast, the ad on the bottom is not so successful. While similarly inspired, the ad below fails to direct visual traffic as successfully at the Sports Illustrated ad. First, the gaze of the group is drawn into the central image. By splitting the image into quadrants with an overlaid Zone of Interest on the hotspot in the center, we can see that the group predominantly glances around the image (1-4), finally settling on the region highlighted by the hotspot (5). Only then does the group chance a glance in the direction of the logo, but even then, fails to look directly on the logo (6), an as a result the maximum exposure they get to the brand is "FOOT". Not only are the concentrations of viewing lower than on the Sports Illustrated ad, but this company — FOOTACTION — does not have a logo that stands out in one’s peripheral vision, as would an Intel or a Pepsi logo.

To add insult to injury, of those of the group who glance from logo over to the tag line that runs up the left side of the image, only one person actually attempts to read the message. The rest of those who look to that image give the line one or two glances then quit — not enough to read a sentence running vertically as this one is.

-Colin Johnson