Tailrank 2.5 Now Available

Not only are we announcing Spinn3r 2.0 today but we're announcing that a new version of Tailrank is being released as well.

If you've been a regular reader of Tailrank over the last few months you might have noticed a number of incremental improvements. Tailrank 2.5 is far more evolutionary than revolutionary.

We've spent a lot of time focusing accuracy of Tailrank's core internal algorithms. What works for one blog or even 1M of blogs in our index tends to fail from time to time when working on 12M blogs.

In this release you'll also see:

MUCH Larger index

Tailrank uses Spinn3r 2.0 as it's core crawling platform. Spinn3r 2.0 is now indexing 12M weblogs which means that Tailrank has a much larger index as well.

This makes Tailrank a lot more democratic (as well as the largest memetracker). You don't have to be an A-list blogger anymore. Now you just have to say something insightful and intelligent and you'll be included in the discussion.

Improved Document Clustering

We've improved upon the design of our clustering algorithms so they can process much more data than before. In fact, we're now clustering within a sixty day window so that if newly published stories cover a meme which happens in the past it will be published within the correct meme.

Spam Prevention

As usual we've spent a lot of time on spam prevention.

A great deal of this work has been done within Spinn3r but there's another layer on top of Tailrank which handles other types of spam which are fatal for memetrackers but not for regular web crawlers.

Improved Accuracy

A lot of time and effort has been spent improving our summary extraction, post categorization (tech, politics, etc), and title extraction.

This seems like a smaller issue but it really helps Tailrank seem professional and seriously improves the readability of the product.

What's Next for Tailrank?

We're hard at work on Tailrank 3.0. This will unify technology present in Tailrank with the Spinn3r backend which is now more advanced in a number of areas.

Tailrank 3.0 will be a big release for us. Just as big as Tailrank 2.0 which we launched nearly a year ago.