Category Archives: WordPress.com

WordPress.com — the hosted platform, features, and updates.

New Servers

We’re looking to expand into a third datacenter for WordPress.com and related Automattic stuff. I’ve been asking around for quotes, but it occurred to me I should blog what we’re looking for because someone reading might be able to provide what we need, or know someone who could. One line summary of what we’re looking for: 22 boxes, AMD 3800 or similar, cheapest HD, 1-2gb of RAM, Debian AMD64 (this is important), private and public 100mbps network. I’d be happy to post more info in the comments if anyone wants it. A per-server monthly price including space and bandwidth is what we’re looking for.

Our Tail

Someone had asked me about traffic patterns on WordPress.com the other day and whether or not they followed a "long tail." I knew the answer was yes, and I guestimated the numbers from memory at around 80% outside the top 10 blogs. It's actually a little more acute: 92.63% of the traffic to WordPress.com is for blogs outside of the top 25. (About 8.4 million pageviews in the past week.) This is from Google Analytics, so doesn't include RSS or anything like that.

Shuttle

Khaled has drawn back the curtain on Shuttle. It’s a fantastic set of work by an exceptional group of people (Khaled, Michael Heilemann, Joen Asmussen, Chris J Davis, Joshua Sigar, Bryan Veloso). There are some pretty significant shifts in there so it’ll be integrated incrementally rather than overnight, and I also plan to test out things on WordPress.com first and watch usage to make sure none of our assumptions are too far off, but I think it’s safe to say that this is a pretty significant milestone for WordPress and we have some exciting months ahead of us. Everyone should thank the Shuttle team. (Note: There will be some ongoing design work as well, especially as new features are added to WordPress. If you’re a kick-ass designer who can juggle code as well as Photoshop, drop me a line.)

Typepad Switches Atom

I think that Typepad may have just switched it’s Atom feeds from .3 to 1.0. How do I know? Because two blogs I read just popped up with 10 new entries (none were new) and each one was broken in Bloglines. (Which is the single largest aggregator in the world, at least according to WordPress.com feed stats.) Here is Seth Godin’s as viewed by the feed validator. This is a bold move, but I certainly wouldn’t want to be their support department tomorrow. This could also just be my misunderstanding, as some feeds like this one from Marginal Revolutions (one of my favorite blogs) seems to be on Atom 0.2.

WordPress CrazyEgg

CrazyEgg is a pretty cool service that tells you where people are clicking on your web page. By far, the coolest feature is the “heatmap” doppler view of your page, which they overlay over a snapshot taken when you start the click tracking session. I’ve been running it for a few days on the front page of WordPress.com, here is a screenshot of the results. Next I’m going to try it on our signup form. And wouldn’t it be cool for the WP write page?

A Little Funding

The best thing that can ever happen to a web service is to have passionate users. Users that notice and email you the second there’s a database problem, users that really push the limits of what you can provide, and users that are phenomally successful and bring thousands of others to your doors.

As a service provider, you have a strong responsibility to these folks. They’re putting their life online with you, they deserve nothing less than 100% uptime. They tell all their friends to try you out, they deserve for the experience of the hundred thousandth user to be as great as the tenth. WordPress.com is serving 4.2 million hits a day on a handful of boxes. Akismet has gotten to the point where it’s blocking so many spams every second that any fraction of downtime is very noticable to users. (Like we had this morning.)

At Automattic we’ve always taken this very seriously, and from the bootstrap beginning I planned for it to be sustainable and frugal in the long term. Of course since I moved to San Francisco I’ve talked to dozens of really high-quality investors who were interested in what we were doing, but the bubble model of giant valuations and ultra-rapid growth never really appealed to me.

The growth of WordPress.com and Akismet has outpaced anyone’s expectations. Recently, I made the decision to sell a minority stake in the company to a few select partners who I think are going to bring a lot of value to the business far beyond mere dollars. This isn’t going to change how the business is run, or the people involved with it, but it will allow us to take better advantage of the opportunities before us and also for us to keep our promise to every one of you to maintain a fast, stable, and innovative platform in the long term.

Automattic isn’t going to get fancy SoMA offices, throw huge parties at SxSW, or “get big fast.” We took a small amount of capital to put things that were already growing fast in a stable position, so from month to month you’re not robbing Peter to pay Paul. We’re going to use the money to pre-emptively address scaling issues before they happen, and continue to share everything we can back to the community, like all of the code behind WP.com in WordPress MU, the spellchecking feature we sponsored, free Akismet for 99.9% of users, and a few other goodies we still have up our sleeve. In terms of hiring, we’re still going to grow very deliberately in line with our revenues and focus on the very best and brightest (and BBQ-loving), like Podz.

We’re going to publish more technical details about everything later, and this is already longer than I hoped — I’m sure you folks have some questions. I’m going to do something a little different and turn the comment section here into a FAQ. If you have a question, please post it below. If you want to say “congrats!” or “that sucks!” do it on this entry instead to keep the question and answer flow clean. If a question warrants a long enough answer I might turn it into a separate blog post.

Open Source Legal Docs

Not technically open source, because I don't know which license is best for regular text, but I just put a Creative Commons Sharealike license on the WordPress.com terms of service and Automattic privacy policy. People were stealing them anyway, might as well make it legit. 🙂 Feel free to grab bits and pieces and search/replace your company/project in. If you want to throw us a link as a thank you, I'd be flattered.

Invalid Atom

“Next time someone tells you Atom 0.3 is invalid because the validator says so, point them to this page. The validator is full of it, because it doesn’t reflect reality.” If Robert had comments, I would say “I never suggested Bloglines was “best-effort software development” (though I do love it and use it myself) but merely that it has an overwhelming market share. We’ve been tracking feed stats on WordPress.com and Bloglines and Newsgator online both dominate. The Web Standards project never casts stones from an ivory tower, they’ve always advocated practical standards for pratical benefits. Ben’s comment was akin to someone saying that the site sucked because it used XHTML 1.0 instead of 1.1, or if the validator decided to instantly “deprecate” all sites using HTML 3.2, 4.0, and XHTML 1.0 when 1.1 came out.”

WordPress and Lyceum

I just read that Boing Boing has blogged about a new WordPress-based system called Lycueum. The iBiblio project first contacted me it seems about two years ago, so I applaud them for finally getting a release out. From my examination of the code, it seems it’s exactly what WordPress MU is except they’ve modified every SQL statement (what a pain!) to use a monolithic table structure. We tested this approach for MU, but found it was too expensive to scale past a certain point. With monolithic structures you hit a wall based on your hardware. In MU users are divided and can be partitioned easily, for example on WordPress.com we have the users partitioned between 4096 databases, which allows you to scale very cheaply and efficiently to hundreds of thousands and even millions of users and extremely high levels of traffic. It’s unfortunate the Lyceum folks came to different conclusions and decided to focus their efforts on a fork rather than on the core codebase, especially as the massive changes going into WP 2.1 are going to be difficult to merge, but I still wish them the best and I’ll be watching the project closely and picking up anything interesting they do and bringing it back to WP. (Such is the beauty of Open Source. :)) If nothing else, it highlights that the MU site needs a little TLC.

Free Sun Server

I put in an application for a free Sun server to try out for either WordPress.com or Ping-o-Matic, depending on when/if it arrives. Everything we’ve done on WP.com has been Dell thus far, and honestly they’ve been pretty good with the exception of one box that they’re going to replace soon. Our biggest DB server (a Dell 6850) does north of 300 queries per second, but it weighs as much as me and uses a crazy amount of power, which is expensive. Of course as more and more of our infrastructure becomes distributed, high performance boxes don’t matter as much.