Many ecommerce sites resell products from manufacturers will often use the product descriptions provided by the manufacturer. Hence, an abundance of duplicate content.

Top 6 Duplicate Content Mistakes:
1. Circular Navigation - multiple paths though a website.
2. Print-Friendly Pages - Fix: block search engine’s from printer friendly pages.
3. Inconsistent Linking
4. Product Only Pages - with nothing differentiating them from other pages.
5. Transparent Serving
6. Bad Cloaking

There are various ways to check for Duplicate Content. You can do a manual check, and/or use tools to check for dupe content. There are a ton of fee-based SEO tools out there that bundle a duplicate content tool into their suite of tools. However for this post, I’m just going to stick with just the free tools.

Free Tools

Copyscape will check to see if any other site contains the same text as your page. This is great to see all the other ecommerce sites that have the same product description.

Yahoo Explorer is a great free tool to find duplicate content. Make sure you see the results for Pages. Then, Export results to TSV. Open in Excel.

The spreadsheet will contain the TITLE tag, URL, SIZE, and FORMAT. Sort the data by descending or ascending for the Title tag. This will enable you to quickly scan the document for batches of duplicate content.

Xenu Link Sleuth is a popular free tool. This is an application download. Besides providing the same data as Yahoo Explorer, the Xenu Link Sleuth can detect broken links. Then, export to Excel. Sort data as needed.

Google Webmaster Tools. Go to Diagnostics, HTML suggestions, Duplicate title tags - next screen is a list, with a hyperlink to “Download this table”.

Additional Reading:
How to find your website Duplicate Content Issues
How to Remedy Duplicate Content
Google Dupe Content
Site Explorer is a First Step
Duplicate Content Issues

Photo credit: kajojak

Related posts:

1. Keyword Analysis - Details Explained
2. The Need for Security in SEO
3. Text Navigation that Renders as an Image

I’ve been doing a specific series of manual tasks for several years because there just aren’t any tools that do the job. But, now with all the Mashups, and API’s available, I can finally create my own tool. Needless to say, I’m not willing to reveal my idea publically yet.

The target audience is for professional SEO Consultants, Ad agencies, and on the client-side. What is a comfortable price you’re willing to pay for a new, solid SEO tool?

When I say new, I don’t just mean another tool that checks Title tags, Meta data, H1’s etc. There are already tons of free SEO tools available. I’m talking about paying for a tool that doesn’t already exist.

This tool I have in mind will help the SEO Consultant demonstrate his/her effectiveness.

Is $4.99 recurring monthly easy payment to make?
How about a one-time $49.99 per year?
Does $24.99 per year make it easier to sign-up?
Do you only use free tools?
Any other pricing models make sense?

If it helps your success, and helps you retain clients are these realistic pricing models?

I don’t know the answer to this. Think of this post as a fist stab at some market research. Nothing official. Just to give me an idea. Comments are always much appreciated! I also created a Poll.

Photo credit: Keystone IT

No related posts.

That question led me to explore a few of Google’s own keyword tools. I began by using Google Insights and sorting the data by All Search Terms/United States/Last 12 Months:

This provided me with an answer. But, I wanted to dive a little deeper.

Next I looked at Google Insights for the last 12 months for the term “lyrics in the category Entertainment > Music > Lyrics & Tabs.

Since Google Insights doesn’t provide actual search volume, I used the Google Keyword Tool to look at the monthly keyword volume:

Next I looked at Google Zeitgeist, which shows all of these searches which “had the largest volume on Google.com in the U.S.” within their respective categories:

I would think Zeitgeist and the Google Insights that show “Search Terms Related to Lyrics” to be the same. However, there are some discrepancies. For example, “Taylor Swift lyrics” is shown to be the 2nd most searched term related to lyrics. But, she doesnt show up at all in Zeitgeist.

Anyway, it makes sense that Lyrics is the #1 searched term, because more people are digitally downloading their music now, instead of buying physical CDs. And, since MP3’s don’t include lyrics, people must be searching for them. I guess it’d be safe to assume as digital downloads increase, so will the amount of searches for “lyrics” and related phrases.

Related posts:

1. Evaluating Reliability of 4 Keyword Tools
2. Keyword Analysis - Details Explained
3. How to Research Your Keyword Context

You can also measure “share of voice“. In Search Marketing, it’s more accurately called “share of searches”. A straightforward method of calculating the formula is using the monthly [Visits/Universe of Searches], expressed as a percentage.

Naturally, you need keyword data you can trust. It needs to be as accurate as possible. There are a lot of keyword tools out there. Some free. Some subscription-based. So, I decided to compare the term “lyrics” from four popular keyword tools.

Wordtracker:
They state on their site that “All search terms are collected from the major metacrawlers - Dogpile and Metacrawler.” That covers only 2% market of US and UK. Also, the keyword data generated is daily search volume. So, we need to multiply that by 30 to calculate the monthly seardch volume. In this case, the term “lyrics” was searched 407,340 times in a month. I’m not convinced this is the most accurate data.

Keyword Discovery:
KD does not use actual search volume. They state on their website: “The search counts that we provide are best used as a comparison to other search terms in our database. You should treat Keyword Discovery’s search counts as a rank, not actual total search volume.” Furthermore, Keyword Discovery gets it’s data from a few hundred small search engines.

Google Keyword Tool:
The Google Keyword Tool provides you with an actual number of search volume. They state on their website “Global Monthly Search Volume: This column shows the approximate average monthly number of search queries matching each keyword. This statistic applies to searches performed on Google and the search network over a recent 12-month period.”.

Microsoft adcenter Keyword Tool:
The adcenter keyword tool takes from search queries directly from the engine. They state on their site: “The data in the keyword research tools is based on historical performance data from Microsoft adCenter and from historical search queries (exact match type) on Bing and other MSN properties”.

Additionally, adcenter’s adlab has a group of keyword research tools that are definitely worth exploring.

Search Engine Market Share:
If you’re using the Google Tool or the adcenter keyword tool, you’ll need to make a quick calculation to get the “universe of searches”. In order to calculate the amount of the “universe of searches”, we need to know search engine market share:

To calculate a reliable number for “universe of searches” I think it’s best to just use Google Keyword Tool, and multiply that by the amount they are deficient in market share. Depending on the market research you use can alter the amount of search volume also.

For example, if MSN had a market share of 5%, then we’d multiply the number by 20 to get the “universe of searches”. That calculates to 2,717,220.

If Google has 70% market share, then multiply the Keyword number from their tool by 1.30 to calculate the “universe of search volume” for any given keyword.

Conclusion:
The Google and adcenter tools are free, and the keyword data comes directly from them. I think that’s as reliable as it’s gonna get for now. In my opinion, Wordtracker and Keyword Discovery are NOT as accurate data.

After all this………Do you trust Google’s Keyword Tool? Yes/No?

Related posts:

1. Keyword Analysis - Details Explained
2. The Top Searched Term on Google
3. How to Research Your Keyword Context

Ideally, the URL structures should be static, and reveal what the page is about. A simple and clear URL structure is much easier for both search engine spiders and human beings.

Static URL’s that contain keywords will often rank better than dynamic URL’s that don’t contain any keywords. Additionally, the keywords in URL can enhance CTR, and will be bolded in SERPs.

Another problem with dynamic pages is load time. A dynamically generated URL comes from web pages that are generated from scripts, which put together page content from a database or multiple files “on the fly” by a server, when a user asks to see a webpage.

Dynamic URLs contain search engine unfriendly parameters like question mark (”?”), &, $, =, +, and % etc. In case you’re wondering what a static URL looks like, below are 2 examples. One is of a static url & the other is a dynamic url:

Static URL: www.domain.com/videos/video-name.html
Dynamic URL: http://www.domain.com/videos/html/topic.asp?BV_UseBVCookie=Yes&articletID=r000450&parentCat=vid7

If you are in the process of comparing content management systems, this is definitely something to keep in mind.

Some search engine crawlers, such as Google’s, will index dynamically-generated pages, but others will not index pages when they see those symbols, especially the question mark. Some search engines will only index a dynamically-generated page that is linked from a static page. Which means, the search engine will not follow links from dynamically-generated pages.

If you are going to have dynamic pages on your web site, it is important NOT to have session ID’s presented to the search engines.

Session IDs:
Session IDs are another big issue when it comes to URL structure. Session variables are unique strings of text in a URL that are generated each time a user visits a site. This means that every time a search engine crawlers visits the site, it gets a new session ID.

Session variables cause the same page to appear with constantly changing URLs. This runs the risk of getting pages flagged or penalized for duplicate content since the same content appears on different URLs.

A URL rewrite can change the dynamic URLs to make them more search engine and user readable. This means that a webserver can be configured to have a dynamic URL appear as a static HTML page.

Additional issues that dynamic pages create, even if they appear in the URLs as static pages, is that they are often slower-loading than plain HTML pages. This is because of the data processing required by the server to put them together on the fly. The slow “page-load” time can affect keyword ranking and possibly even indexing. Especially, if the spider decides to move on because the page took too long to load.

Reasons Why Session IDs are bad for SEO:
1) The Spider always finds a different URL. It can’t find the URL with the original session id. This new url which contains a different session id, appears as a duplicate page, and Google assigns zero importance. Then, the Googlebot goes looking to crawl the original page, and gets an error message.

2) Everyone linking to your page will be linking to a different URL. All the Inbound links will be different because everyone has separate session id’s. This is undesirable. You need links to get a page to rank.

The solution to those messy dynamic URL’s is to use a URL Rewrite, and search engine friendly 301 Redirects.

URL Directory structure:
Directory structure refers to how directories are set up on servers. “Directory depth” is the number of directories in a URL. When your website content and files are grouped into a directory structure, your URL will reflect this structure.

For example:
www.MyDomain.com has a directory depth of 0
www.MyDomain.com/category has a directory depth of 1 (category is a directory)
www.MyDomain.com/category/product has a directory depth of 2 (category is a directory, and product is a subdirectory)

Regarding “Directory depth”, there typically aren’t any indexing issues. But, some algorithms could discount the weight given to pages that are multiple levels down in a Web site’s directory structure. Some search engines consider the pages closest to the root directory the more important pages on your site.

Relevant directory names are helpful for both search engines and human users since they provide an idea about the content of the URL. It’s a best practice to use keywords in the URL structure in the form of directory names and subdirectories to optimize your website.

Additional Reading:
Why Session ID’s And Search Engines Don’t Get Along
SEO Best Practices for URL Structure
A Better URL Structure for SEO
Supercharge Your URLs For Maximum SEO Impact
User and Search Friendly URL Design for Multi-Language Websites
Dynamic URLs In The Eyes Of A Search Engine
URL Rewriting: Increase Organic Traffic By Using Dynamic URLs That Look Static

Photo Credit: schill

Related posts:

1. Importance of Content Quantity
2. SEO Methodology

Search engines prefer sites which are easy for them to navigate and retrieve information related to the site’s topical information, and consequently rank them higher for the site keywords. Therefore it is very important for the site to have a simple navigation structure that is easy for the spiders to crawl.

There are many types of navigation structure that can make it search engine-friendly or not.

Simple text-based navigation is the most search engine-friendly. Apart from being easily followed by spiders, text-based navigation gives an opportunity to include the keywords in the page content. The keywords included in the navigation are valued by all search engines.

However, it is not always possible to incorporate text navigation in the site because of design/aesthetic reasons. Even if the navigation cannot be text-based, the best practices listed below should be followed to make sure that the site navigation is search engine-friendly.

JavaScript based navigation: Search engine crawlers can read JavaScript but cannot parse it; hence, they are unable to follow the links embedded in the JavaScript code. Usage of JavaScript based linking would not allow the crawlers to follow the links and crawl/index the sites completely. If the navigation has to be JavaScript based, it should be made sure that in case the scripts are blocked by user settings, they should still be able to navigate through the site. It’s recommended to use the html noscript tag.

Flash navigation: Flash is not parsed by search engine crawlers in normal circumstances (unless the text/HTML alternative is provided or unless the flash movie is using deep linking to all the content). The reason for search engines being unable to read flash code is that flash is published in the .swf format which does not contain the code (code is embedded in .fla files) which are not published on the pages. This means that in order for search engines to read the flash embedded content and navigation, they will have to decompile the flash movie, which is not done by search engines at this point. It’s recommended using SWFObject to replace flash video on a webpage, so you can include text.

Image based navigation: Often, the site design requires the navigation to be in form of images. Search engines can follow the image links (as long as they are not JavaScript based) but using image based navigation takes away the ability to create keyword targeted navigation. Quite often while embedding rollover or other interactive images for navigation, JavaScript is used for linking. It should be made sure that the links behind the images are not JavaScript based.

It’s recommended to use the Alt attribute whenever an image-based navigation must be used.

Sliding/DHTML menus: If the site structure and architecture requires the use of rollover menus. Most often, the sliding menus are implemented on the sites using pure JavaScript for interactivity and functionality of the navigational links. The best practice is to use the CSS/JS hybrid navigation to make sure that the links embedded in the navigation are readable and followed by search engines. In case JavaScript has to be used, it should be made sure that the JavaScript code is placed in external files instead of page code.

Using a drop-down or pull-down menu helps you save on screen space when you have a lot of material that needs to be displayed on your pages, or a complicated multi-level navigational structure. In general it is recommended to use XHTML and CSS style sheets to present drop-down or pull-down menu navigation so that the search engines will still see the href links when indexing your Web page. If you must use drop-down or pull-down menus using JavaScript or a CGI script as your main navigational format, remember to include a secondary form of navigation to allow search engine spiders to follow links to the sections of the web site easily. Eg: footer text links.

Regardless of the navigation structure, both a Webpage sitemap and an XML sitemap should be created.

Suggested Reading:
Advantages and Disadvantages of Different Types of Navigation
Hierarchical, Site-wide, and Locally-determined Navigation
How to Determine a Website’s Navigation Structure
Navigation Menu Versus In-Content Links
Drop-Down or Pull-Down Menus
The 8 Types of Navigation Pages
Creating a navigation structure for both usability & SEO
SEO: Breadcrumb Trail Boosts Rankings
SEO Basics: Text Navigation Links vs. Image Links

Photo Credit: walt_s

Related posts:

1. Text Navigation that Renders as an Image
2. Link Building Optimization
3. Finding Duplicate Content with Free Tools

My frequency of blog posting is usually approximately once every 7 days. I think it’s safe to assume that every SEO Consultant that gets busier with client work, blogs less. This usually happens in waves, and it affects the frequency of his/her blog posting.

Darren Rowse wrote a great post answering these questions. He sums it up by saying it doesn’t matter as long as the posts are consistent & quality:

My main advice on posting frequency is to be consistent and keep the quality of your posts as high as possible. There are successful blogs who post 20 times a day and others that are lucky to post 20 times a year - any level of post CAN work.

In Darren’s post, something that wasn’t addressed is whether or not the frequency of posting affects the amount of RSS subscribers you have?

I’ve thought about installing the “What Would Seth Godin Do” plugin that says, “If you’re new here, you may want to subscribe to my RSS feed. Thanks for visiting!”

Is that plugin too obnoxious? Does it interfere with the user experience? In my case, I’ve put the RSS Subscribe button on the right sidebar. It’s there. Yep, I’d love to have more RSS subscribers. But, I don’t want to be annoying about asking. I can’t help but wonder if the sidebar button is enough of a request to ask people to subscribe? Probably not. But ya know, people will subscribe if that’s the way they like to consume content.

Bloggers that have accomplished acquiring a lot of RSS subscribers describe in 10 or 11 ways, how to find new RSS subscribers.

As I get busier and blog less, I console myself by thinking it’s okay not to blog so frequently, because the priorities ARE client work. Not blogging.

To attempt to answer the question of whether or not the frequency of blog posting affects your RSS subscribers, I gotta believe that it does; As long as you’re writing quality content.

And, you’re pages will get indexed and, you’ll be found thru search engines & if you promote your blog using social media you’ll increase the chances even more of picking up more blog subscribers.

I find blogging is like playing sports. Some days you just can’t be beat. While other days you’re lucky just to be in the game. I’ll try my best to keep writing quality content.

Rest assured that if you don’t see a post from me within a week, that I’m certainly thinking about what to post, and working hard on the priority stuff.

Photo credit: Mexicanwave

Related posts:

1. Get in Front of your Audience Without Search Engines
2. How to Use Twitter Only A Few Minutes Everyday