I assume it happened via sql injection that I hope had been resolved in WordPress 2.5.1

I assume it got in via sql injection that the new version has solved.

Google’s cache and the pages themselves seem “clean” - no mention of various drugs and such and no “bad” links. So I am unsure what is the benefit to the hackers. In any case I used this as an opportunity to upgrade to WP 2.5.1.

Hopefully the problem will go away when Google & Yahoo reindex.

Overall the traffic to the site has been growing as a result of additional content, but I have periods that the traffic dries to practically zero only to rebound again. Its not that the pages are not indexed - they are, but for some reason during the “dry spells” they are buried deep in the search results. Take a look at this report from google analytics:

As you can see every so often the traffic drops significantly - usually for a few days, but in December this lasted for about two weeks. In these periods the site “practically” vanishes from search results (though as I mentioned the pages are all indexed and can be found if searching for them specifically).

No particular keyword contributes more than 1% of total traffic to the site, but I do track a couple of keywords which warn me of this phenomena : “song list” is usually ranked in the #2 or #3 spot , but during the Google “mood swing” it is not in the 1st 1000 results.

If you visit Google’s webmaster central forums. Many complain about a drop in their ranking for a particular keyword from top page to “buried”. The response from the participants (mostly conjectures, since most of Google’s methods are not public) is that something is “wrong” with the site: bad linking, non valid markup, bad practices etc….

This does not seem to apply to song-list.net, since (a) I do not change anything substantial on the site apart from adding content and (b) If I have done something “bad” in Google’s eyes then the ranking/traffic would not rebound back.

Even if Google continuously tweaks the search algorithm continuously why would it cause such enormous fluctuations. I can understand that the ranking for a particular keyword could fluctuate considerably , but not all keyword would fluctuate.

Anyone care to postulate what is happening ?

I’ve done a fairly dirty conversion to rails. The original used the Wordpress internal code to call the mailer so I’ve added a controller to call ActionMailer, the same controller is responsible for the non-javascript page. As usual most of the time went into layout and CSS issues

Maybe sometime I’ll clean it up and re-release it as a rails generator, but we’ll see if I get to it - I am drowning with lots of things to do.

I track both the artist pages and the total site pages (they are mostly individual track pages) that are indexed by both engines. Here is today’s report:

• Google: 2,130 artist pages out of 89,900 total
• Yahoo: 457 artist pages out of 2,852 total

As you can see Google has indexed 30 times more pages than Yahoo ! It is easy to see that also from the logs - Google’s Bot is extremely aggressive - it spiders the site all day - last week it hit 20,000 pages in one day. Yahoo Slurps at a more casual rate - a few hundred to a thousand pages - dependent on its mood ;-).

One would think that Google would dominate the traffic, but this is not the case. Here are a few keyword hits from both engines:

Yahoo:

list of 50 cent songs
celine dion list of songs
list of ray charles song
list of eric clapton songs
list of jay z songs
lil jon songs

Google:

www.song play.com
theclarksisters
HECTOR LAVOE.COM
morcheeba songlist
“soft by boney james”
le notti di cabiria rota listen
“song of delilah”
THEHAPPYGOODMAN
Songlist Farewell Angelina
cunla song wikipedia
lil boosie distant lover

The Yahoo traffic comes primarily from searchers that are looking for song lists and the site ranks well for these searches as I would hope. Google’s traffic is coming from particular word combinations that match certain pages very well even if they are hidden in the supplemental index. I hope that the main artist pages will get indexed in the main index and ranked reasonably so I will get the same kind of hits from Google that I am getting from Yahoo. I am sure many people are searching for ” [artist name] song list”, but the site does not pop up in the first few pages.

http://www.song-list.net/mp3/itunes/949650/949525

The MP3 action then redirects to the appropriate music library (in this case itunes). I keep all the neccesary information in the url so the controller doesn’t need to do a database call. I’ve seen some shopping sites do the same only the real link is transmitted via a key - requiring a DB call, and taking much more time.
Now I can see in the logs which music libraries get clicked more often (answer: so far it is Rhapsody).

I’ve started a new job, so I have a limited amount of time to enhance the site and collect more data. At the moment I am trying to get the current content indexed a bit better by google and yahoo. This has been challenging - more in a future post.