dsandler.org/wp

Recently, I’ve spent quite a bit of time thinking about _microblogging_, exemplified of course by the very popular [Twitter](http://twitter.com) service. While I finish preparing a technical report describing the [FETHR](http://brdfdr.com) system we’ve developed[^2], I thought I’d take a few minutes to discuss why I find this topic compelling.

[^2]: The work is also currently under submission to a competitive conference; a technical report is useful in this case to gain additional feedback from the broader microblogging community and to spur experimentation in the wild.

The microblog is something of an odd bird, defying easy classification or even explanation (as evidenced by the many [attempts](http://www.commoncraft.com/Twitter) to articulate its purpose and properties).
[Originally](http://flickr.com/photos/jackdorsey/182613360/) [conceived](http://www.pbs.org/mediashift/2007/05/twitter-founders-thrive-on-micro-blogging-constraints137.html) as a way for strongly-connected friends[^3] to keep track of one another’s whereabouts and present activities using SMS, it’s become a kind of ultra-lightweight conversational tool that doesn’t map exactly onto any existing publishing or communication system.
Twitter’s single prompt—“What are you doing????—is almost vestigial at this point; it is evolving into a *micropublishing* platform, and as such has become an important and interesting topic of research.

[^3]: Presumably those in urban areas where “I’m at the coffeehouse??? is an actionable piece of data. Some still use Twitter for this kind of lazy real-world rendezvous, but most have adopted a more blog-like approach to the system. One of the noteworthy things about microblogging is that it supports all these modes of interaction simultaneously.

Microblogging has already had impact. We can speculate—from the amount of [news](http://www.cnn.com/2008/TECH/04/25/twitter.buck/index.html) and [media](http://news.bbc.co.uk/1/hi/technology/7287536.stm) [coverage](http://money.cnn.com/2008/08/06/technology/true_meaning_of_twitter_lashinsky.fortune/) that the phenomenon has [earned](http://topics.nytimes.com/top/reference/timestopics/subjects/t/twitter/index.html)[^201]—that it is poised to take its place next to the blog as a prominent method of publishing and interacting online.
Many now rely on services like Twitter for business and personal interaction; beyond the “ambient awareness” of physically distant friends and neighbors, microblogging now finds use in business networking, [customer service](http://twitter.com/griffintech), [national politics](http://twitter.com/BarackObama), [journalism](http://venturebeat.com/2008/09/08/new-cnn-show-pushes-the-limits-of-twitter-literally/), and general lazyweb[^1]-style requests. Microblogging has unquestionably become a part of the everyday lives of active users, and in extreme situations—such as the recent Sichuan earthquake—it can literally be a lifeline.[^200]
Encouraging and improving these services is therefore an important and valuable goal.

[^201]: The _New York Times_ seems particularly smitten.

[^200]: Could Twitter actually save lives? Andy Carvin [speculates](http://www.andycarvin.com/archives/2007/03/can_twitter_save_lives.html) that with a few sophisticated group features it might be a tool for mobilizing relief efforts. The work I’m doing would help to enable this.

[^1]: **la•zy•web** *n.* The collected wisdom of millions of internet users, mythical solver of problems cosmic and quotidian. First supplicated by name in 2005 or thereabouts by [@jwz](http://twitter.com/jwz).

As a computer scientist, I’m interested in microblogging systems in part because of their unique properties.
They are remarkably spam-free, mostly due to the way in which users explicitly select those senders whose messages they wish to see (by “following??? them).
The many subscription links between microbloggers forms an interesting social graph: can we put this network to use in some way?[^99]
Microblogging is also an unusual mode of communication, falling somewhere between blogs, chat, IM and BBSes in terms of how, when, and to whom messages are distributed.
Even the way users consume messages is peculiar: a constant stream of updates commingling their own messages with those from their friends, ensuring that no two users have the same view of the system.[^98]

[^98]: In this way it might be said to be most similar to Facebook’s News Feed, introduced to early controversy, due in large part to the dramatically—for some, shockingly—increased importance and persistence of formerly ephemeral bits of Facebook data like the personal status.

[^99]: Some examples taken from the FETHR paper: abuse/spam detection; recommendations/introductions; and, of course, update distribution.

Microblogging is every bit as compelling as research because of its **limitations**—specifically, the limitations of the flagship microblog service, Twitter.
First, it is a large but entirely *centralized* system; there are currently a few million registered user accounts[^100], of which maybe half a million are active[^101]. How much larger can it get?
The folks at Twitter are, by all accounts, barely keeping up with their own success; in fact, scaling problems have been at various times the subject of much public frustration.
As a result, Twitter is also *fragile;* its users are all unavoidably bound to Twitter’s robustness and reliability.
When Twitter goes down, service is completely interrupted for everyone.
It is a *closed* system, by which I do not necessarily mean that the source code is not available, but rather, the ways in which the system *functions* are not up for debate or (easy) amendment by the community.[^86]
Twitter, Inc. is a dictator, albeit a benevolent one, and while users may wish to switch to another service—and there are plenty of Twitter-alikes to choose from, many promising more advanced features or better reliability—powerful [network effects](http://en.wikipedia.org/wiki/Network_effect) prevent users from leaving. After all, everyone you know is already on Twitter, and they’re *not* on, for example, Pownce.[^87]

[^87]: Not least because it’s been bought and [shut down](http://blog.pownce.com/2008/12/01/goodbye-pownce-hello-six-apart/).

[^86]:
The [Twitter API](http://twitter.com/help/api) allows third parties to develop software that talks to the existing Twitter service, including desktop clients, search engines, and, yes, research code such as my own. What’s not possible at this point is to change the way Twitter works; for example, external developers can’t turn off Twitter’s use of TinyURL to shorten URLs (causing an unfortunate fate-sharing between Twitter and TinyURL, which has suffered its own reliability problems). More to the point, the Twitter microblogging network is isolated: there’s no way for a third party to offer Twitter users the ability to follow users of other systems or vice versa.

[^100]: According to [TwitDir](http://twitdir.com), which is having load issues as I write this; TwitterFacts [reports](http://twitterfacts.blogspot.com/2008/10/barackobama-followers.html) TwitDir’s estimation of the Twitter community as of October to be just over 3 million.

[^101]: Based on our measurements during a three-week period in September, during which we observed 4,917,042 public messages from 472,735 users.

The potential is certainly there for Twitter to become, as its founders style it, a [“communication utility???](http://blog.twitter.com/2008/06/welcoming-bijan-and-jeff.html); whether or not Twitter can actually achieve this aim depends in large part on its technical evolution. That’s where my recent work fits in the microblogging timeline; watch this space.

[Crossposted from the toastycode blog. —ds]

The day after Thanksgiving, November 28, has been declared National Day of Listening by the StoryCorps oral history project and NPR (among others).
The idea: With family in town, bellies full, and (hopefully) a little time off work, we might all take an hour to sit down and tell each other stories.
An essential part of the NDoL is to record those stories, because they probably don’t already exist on blogs or email or Twitter—particularly if the storyteller isn’t of the Internet generation.

We realized this is a perfect use for TapeDeck, our fast, fun, and foolproof audio recording software for Mac OS X. So this week we’re taking 20% off the price of TapeDeck with the hope that you’ll use it to capture your family’s stories this Friday.
Just download TapeDeck and press the big red REC button to get started.
By purchasing a registration you’ll remove TapeDeck’s time limits (so you can record for as long as you like); do so before Sunday, November 30 to get the discounted price.

We sincerely hope this helps you and your family start and preserve your own oral traditions. Happy Thanksgiving!   —Dan & Chris

A quick note about my Twitter experience this morning:

I went to post a remark about this article from yesterday’s New York Times on the computer science gender gap (particularly how this graph shows how the tech boom utterly failed to inspire young women) and found that Twitter was down:

Actually, that’s a lie; at first, I didn’t notice anything, because this is what I see when I use Twitter:

This is a screenshot of Birdfeeder, a prototype implementation of a distributed and secure microblogging protocol called FETHR, which operates independently of (but connects to) Twitter.
I posted my comment to a personal instance of Birdfeeder, which happily accepted it, digitally signed it, entangled it with other messages in my timeline, and forwarded it on to my FETHR subscribers—one of which is a Twitter gateway, which takes care of forwarding my messages on to my Twitterstream.
It’s also responsible for sending me messages from people I follow, so (as you can see from the screenshot) I never have to leave my Birdfeeder interface—and therefore can occasionally miss minor Twitter glitches. (Or, as in this case, major hour-long outages. Nothing yet on the status blog, either, so it must really be all-hands-on-deck over at Twitter HQ. Update: Over an hour in, there’s a small note on the status blog.)

When Twitter eventually comes back up, the gateway will busy itself with the task of forwarding along my queued messages and fetching news from my Twitter subscriptions. I can continue to tweet in the meantime and even page back through my entire history and the archived messages of my friends. This is the fundamental benefit of decentralized micropublishing: independent providers may experience local failures without bringing the whole damn thing to a screeching halt.

So, in something of a twist on the usual, Twitter is down for everyone—but not me.

This is fun and exciting new research (currently under submission) and I hope to push out a technical report version soon so that others may begin to evaluate and improve the system design. Hit me at dsandler@ (or @dsandler, once Twitter wakes up again) if you can’t wait and would like to know more.

Photo credit: Doug Mills / The New York Times

It occurred to me that, in the unlikely event that I start blogging in earnest again, nobody will want to read any of it with the site in this state.

So I’m firing up my first draft of a long, long, long-awaited dsandler.org refresh. At first glance it probably looks like just another tightly-tracked Helvetica design; while I do believe that that particular Max Miedinger Old Style look is timeless, I’m actually going for something a little different. Font nerds with Avenir (or Gotham, a slightly boxier substitute) installed will see more of what I’m going for: something a little more open and friendly. [Update: See a screenshot of the Avenir version.]

Feedback is welcome in the comments or shouted to @dsandler.

Twitter feedback

al3x @dsandler I’d click it.

boredzo @dsandler Much improved; thank you.

dangerdave @dsandler v. pretty. But the Avenir family is expensive: I can’t afford Sandler Platinum.

davidrperry @dsandler new layout = elegant & clean. I did get a kick out of the temp version, though!

So, this is a great experiment in undesign; I’ve gotten great comments both here and on Twitter [@cbowns @boredzo @cromulence @uliwitness @brettp].

But I’ve got a few actual blog posts in the queue, and if I want anyone to attempt to read them, I need to put this damn thing back together. So keep an eye out for a return to readability, but for today enjoy an even-more-eye-assaulting Halloween color scheme.