Tailrank Blocks PayPerPost Bloggers

Today Tailrank had the unfortunate task of blocking a few weblogs from Tailrank's index due to link spamming.

These were PayPerPost bloggers linking to Sproose which purchased a PayPerPost campaign to astroturf their release.

We have no problem with bloggers selling ads and trying to make money but this type of linking behavior is essentially spam.

We're willing to reinstate these blogs if they'll migrate to using rel="nofollow" for future PayPerPost sponsored posts. For example, nearly all links in this post use rel="nofollow" to avoid confusing memetrackers and search engines.

Sproose is also blocked and we're willing to reinstate them as well if they'll stop running PayPerPost campaigns without insisting on a nofollow link. Spam is a top priority for a search engine and for them to resort to link spam to advertise their product is a bit hypocritical.

The spammed post will remain in our index for historical purposes but the ranking is reset and won't show up on any of our archive pages.

To date, we've been very trusting when adding weblogs to our index. This has paid off because we haven't attracted the spam that is problematic with other services. In fact, this is only one of a handful of spam posts we've had to deal with in the last year since our launch.

PayPerPost has received a great deal of criticism in the press for their lack of ethics. What I find most disturbing is the fact that PayPerPost is willing to hurt the search rankings of bloggers by not communicating the problems (spam) with selling links.

Tailrank isn't the only large site with this policy. MSN search has also promised to block websites that sell links. They're sending off email messages notifying them that they've been dropped from their index:

Your site is acquiring links through posting to or exchanging links with sites unrelated to your site content. Techniques which attempt to acquire unrelated spam links in order to increase ranking are considered spam and your site has been excluded from our index as results. Please contact us once you've removed these links and we will reevaluate.

The only party I find at fault here is PayPerPost. We'd really love to reinstate these bloggers and add them back to our index and welcome them home with open arms. I assume they simply weren't aware of the problems with selling this type of link spam.

Updated Tailrank Release - No new windows and better splash message

Alright guys. We have a new Tailrank release out the door. I usually don't blog about all the changes but I wanted to make a few notes.

When you click on an external link we now open the link in the same window. We get mixed reactions here but it seems that a lot of people want it to open up in the same window. I think this might be the default moving forward and we'll add a pref to allow people to change it so the page opens in a new window.

We also have a new splash message system which you can see in blue (almost cerulean btw) at the top right. The first time you visit Tailrank you're given a "What is Tailrank?" message but after that we give you random tips and tricks.

Tailrank in Top Ten Fastest Sites

We just rolled out some performance updates the other night and it looks like they've worked out very well! Tailrank is now in the top ten fastest sites over on grabperf. We're even faster than Google News!

What's really interesting is that I think I can get another significant performance boost out of the system which might allow us to take on the #1 position. I've got my eyes on you Technorati Mobile! ;)

Actually, I should get Tailrank Mobile on there. I'm sure it would take #1 slot right away.

Tailrank Indexes More Weblogs

If you've noticed more traffic on your blog recently it might be because Tailrank is now indexing more weblogs. We've deployed a new crawler and this week alone we've added 15k new blogs!

What's really amazing about this system is that we're adding new weblogs according to our proprietary ranking algorithms. This means that we should totally skip spam blogs altogether and weblogs will be added based on their ranking. This way Tailrank is always indexing the top weblogs (which have the most influence).

The goal of course is to add even more of the long tail into our index until we're indexing the whole blogosphere. We're in the process of deploying new hardware and working towards Taillrank 2.0 which should allow this to happen.

We'll be talking about this more and more in the coming weeks and we have a few surprises in the pipeline which should be pretty interesting.

Update:

Actually it wasn't a week. It was four days. We're also planning on cranking up the volume here in a few days so we'll be adding weblogs at an even faster rate!

RSS Improvements

We have a new release out with a bunch of small fixes. One of which improves the quality of our RSS feeds.

Now the feed uses elements which render better in client side RSS aggregators. Here's a screenshot from NetNewsWire:

Tailrank wins Time.com's Top 50 Coolest Sites

Time.com (in their infinite wisdom) seems to think Tailrank is one of the top 50 coolest websites on the Internet! I couldn't agree more!

Tailrank culls the day's top stories from thousands of blogs (both liberal and conservative) and news sites; the posts that are linked to the most and discussed the most bubble to the top. (Technology and General News are covered under separate tabs.) Registered users can create their own customized filter; there's a mobile version too and an RSS feed.

Pretty sweet I must say. We placed in the News and Information section along with Digg.

I also note that my friends at Phonescoop and Pandora were anointed with coolness!

Tailrank Site Specific Memetracker Support

GigaOm shipped a new look and feel today (which is pretty sweet if you ask me) and they created a new tool near the top of the page named "Most Popular Stories" which shows the hottest posts on the site at any given time.

Here's a preview.

Did you know you could do this with Tailrank for your site? You can and its fairly easy. Just search for the URL of your blog (in this case http://gigaom.com) and we'll show you the most popular posts sorted by time. Here's what gigaom.com would look like.

There''s an associated RSS feed for this guy and you can just use one of the widgets that hosts RSS. Either that or you can click the " Add this page to your blog!" link in the left sidebar to include the content via javascript.

Apple Advertises on Tailrank

Apple is running a cool ad on the new Mac Pro on Tailrank (thanks for my friends at FM)

I soooooo want one!

Tailrank in FeedDemon?

Nick Bradbury writes about the coming personal memetracking in FeedDemon.

But I'm in the middle of another coding frenzy right now, and this time I'm going to open the kimono by talking about a "memetracker" feature I'm considering for a future version of FeedDemon (fdmeme.png). I enjoy memetrackers like Tailrank and Techmeme because they let me know what people are talking about, but I'd like to have a memetracker that looks only in feeds I'm subscribed to in FeedDemon. Not only would this inform me about popular topics, but it would also let me read multiple posts about the same topic at once so I don't have to read them one-at-a-time as I come across them.

Nick, I'd love to talk about some way Tailrank could help out FeedDemon here. We have a set of APIs which you could use (and they're all RESTian). You could use our memetracking technology directly or use it to augment your own within FeedDemon.

Ping me if you want to talk!

Reading the Full Thread within Tailrank

We shipped a new feature within Tailrank last week which I want to talk about.

It is now possible to view the full thread around a meme right within Tailrank. This can save you a lot of time and you can read stories just like you were in your favorite aggregator.

All you have to do is click the "X links in thread (read now)" permalink within Tailrank which will take you to a dedicated page.

You can see the link on every story on the main page.

This will then take you to a permalink page with every main post for the story.

Here's an example. Note the full post for the "stop the ACLU" entry.

I also wanted to note that whether or not we include the full-text of a post is controlled by the publisher. We only include the full-text of a post if the publisher uses a full-text RSS feed. If not we still use a summary.

New Tailrank Architecture Now Live

For the last month we've been working hard on a new architecture for Tailrank's backend. I'm happy to say that yesterday we deployed the first wave of updates and the new system is online and firing on all cylinders.

What I'm really excited about is that this will provide us with a great deal of flexibility moving forward in terms of ranking and spidering of the blogosphere.

Most of these upgrades are under the surface and not visible as user features. The new infrastructure should now allow us to innovate more on features in the main product so stay tuned for new and cool functionality!

Marketing Monger Interview on Tailrank

Early this week I was lucky enough to participate in a podcast interview with Eric Mattson of the Marketing Monger

In my last post I said I wasn't going to do any more podcasts until next week but, thanks to a truly bizarre series of events that kept me in Stockholm on Saturday, I managed to connect with Kevin Burton of Tailrank for my 40th podcast.

We talked about RSS, Tailrank, blog marketing and a bunch of other fun topics.

I'm spending this month working from Thailand on a new version of Tailrank and I talk a bit about what's going into the next version.

We conducted podcast using Skype over a 4Mbit satellite link and I was a bit nervous that the call would drop but everything worked great.

A podcast over Skype via satellite between Thailand and Sweden about a virtual company based in San Francisco. The World is Flat.

Link to mp3