This afternoon we experienced a brief outage, during which about half
our users seemed to lose their subscriptions. This can happen when
one of the many complex systems that power Google Reader experiences a
glitch. We work hard to avoid problems of any kind, but occasionally
something like this happens. The good news is that no data was actually
lost, it was just temporarily inaccessible. Google's systems store data
redundantly to minimize the chance of anything becoming permanently lost.
We were able to identify, diagnose, and fix today's outage within an
hour, which is the kind of response time that we strive for. We'll
continue give quick status updates to problems like this in the future
so users who have trusted us with their data can feel comfortable
doing so.
Sometimes we come across Reader-related things that are interesting enough that we'd like to post about them on our blog, but at the same time too small to base
a whole post around. Enough of these tidbits have piled up to build a whole
meal, so we thought we'd just share them with you, one link at a time.
Video Appetizers
Reader is centered around subscribing to feeds, but it's not always easy to explain to others what feeds are, who makes them, and why you'd want to subscribe to them. Worse yet, sometimes they're "feeds" and sometimes they're "RSS" -- and what is this "Atom" thing anyway? This RSS in Plain English video does a good job of explaining all that, in a very unique style.
Also on the topic of videos, Chris made a short clip showing all the places he's used his offline Reader. If you or anyone you know would like to know just why you'd Google Gears-enable an application, this showcases it pretty well:
Many folks like our gadget, but sometimes wish even more of Reader's features could be accessed from within iGoogle. With Michael Bolin's Your
Page Here gadget, you can embed all of Reader (or any other page, for that matter) as its own tab within your iGoogle page.
For all you Facebook users, Mario Romero has created a Reader application that allows you to embed your shared items into Facebook profile. It's a bit finick-y (you have to type in your 20-digit Reader ID), but it shows how open platforms (Reader's and Facebook's) can be used together without needing permission from either party.
Fun Desserts
We've posted
before about add-ons that others have made for Reader, but they've generally
been of a functional nature (like notifiers and browser buttons). The
Google Reader Theme that Jon Hicks made is entirely unlike that in that it doesn't add any functionality, it just makes Reader look very different (some might say Mac-like). A fresh face for Reader can be a lot of fun, and we were happy to see just how seamless Jon managed to make it.
Finally, if Reader is just too serious for you and you'd like to view your feeds through a lolcat perspective, Ian McKellar's LOL Feeds may be the thing for you.
Things you can't bring with you on an airplane: Bottled water. Organic shampoo. Google Reader.
I'm happy to announce that our team has fixed one of these problems. Although we find the business of mini bottled water intriguing (and cute!), we've decided to stick to our core business: feeding your reading habit.
As of today, you can use Google Reader offline. Now you can access your favorite feeds in the Golden Gate Park, on the chinatown express, or even traveling 35,000 ft above the Atlantic.
To do this, we've used the newly released Google Gears, a browser plugin that enables offline web applications. Once you've installed Google Gears, you can download your latest 2,000 items so they're available even when you don't have an internet connection. To get started, simply click the "Offline" link in the top right of Google Reader.
A small note of warning: the current version of Google Gears is a developer release. Given this, you may notice a few kinks here and there, but we'll be working hard to iron those out over the coming months. As always, we welcome your feedback and suggestions as we look to make Google Reader better every day.
Earlier this year, I acquired a Nintendo Wii. As I was recovering from Wii elbow, I began to explore the capabilities of the Opera-based Internet Channel. It occurred that Reader may be a lot of fun on the Wii, especially with many photo and video feeds.
Some weekend hacking confirmed my suspicions, and the rest of the team also seemed to think it'd be a neat side project. As somehavediscovered, we recently flipped the switch on this feature. If you'd like to try it out, simply visit reader.google.com on your Wii (you may find it even easier to just do a Google search for "reader"). Keep in mind that this is something very experimental, the labs of Google Labs if you will.
If you're curious to see what it looks like, here's a recording:
You'll also notice that Reader on the Wii takes advantage of the famous Wiimote:
up/down: scroll up/down
right/left: next/previous item
1 button: show subscriptions
2 button: show links
When showing subscriptions:
up/down: previous/next subscription
right: select current subscription
left: close
-/+: collapse/expand folder
If you'd like to try the Reader interface in a regular browser, visit www.google.com/reader/wii to go into Wii mode. The Wiimote buttons all have keyboard equivalents (e.g. the "1" key for the 1 button).
Now that this is done, I've heard that the Commodore 64 has a web browser...
It's fun to share interesting items with your friends and coworkers. Google Reader has a "Share" button and a public page to go along with it, and some people have been putting that to great use. Once you start sharing, others can subscribe to your shared items and see what you see (when you want them to).
This works great for your feed-savvy friends. But, what if you want to share something you find in Reader with someone who doesn't use a feed reader at all?
To the rescue comes a greatly improved email feature we're releasing today. Even Marge Simpson has email, so interesting feed items you come across can now reach almost anyone.
Now, clicking the "Email" link at the bottom of an item gives you the ability to:
send email from within Reader -- no more second window for sending email.
send the entire item as it appears in Reader, including formatting and images.
use your Gmail address book (if you have one) to add contacts with auto-complete.
So, there you have it. Now you can share the great content from your feeds with anyone. Give it a try and let us know how you like it.
Based on the comments that the gadget is receiving at the directory, we've made quite a few improvements to it:
A "mark all as read" link so you can more easily catch up
Unread counts for your reading list and tags
Better support for themes
The ability to sort items oldest-first
If you'd like to see other features in the Reader gadget, just add another comment. And if you haven't added it to your homepage yet, you can do so with this button:
As Google Reader has grown, so has its engineering team. As the newest member of the Reader team, I am excited to be working with all of the great people who spend their days making the world a better place for reading feeds. I originally started working on Reader as an intern during the summer of 2006. That experience was a ton of fun and a great way to learn. Working as an intern also allowed me to work with people who are some of the best in the tech industry. After that experience I was very happy to come on full-time. For those of you who are interested in looking into the internship program you can find information here: Internship Information. Google is always looking for the best and brightest engineers. Who knows, you might even get to work on Reader.
During a recent planning session, we realized we had never taken a group picture. So I whipped out my Canon Digital Rebel and the result is below. From left to right, in order, we have: me (Brad), Mihai, Susan, Kevin, Steve, Nick, Chris, Ben and Justin.
So now there is evidence that we were all in the same room at least once.
When building a product, your top priority should always be the needs of your users. Here on the Google Reader team, we pride ourselves in being responsive to the complaints and feature requests of those who read feeds using our service. Today, though, we're announcing a feature for a different group: the publishers of those feeds.
Publishers have been asking us to report the number of users that are subscribed to their feeds in Google Reader. This is something we've been wanting to do for a while, but with all the products that use feeds at Google, corralling the data in one place was like herding cats. So herd we did, and as of today, our crawler reports the number of Google users subscribed to the feed. The count includes subscribers from Google Reader and the Google Personalized Homepage, and in the future may include other Google products that support feeds.
If you have access to your server logs, you can see the count directly in the HTTP header of our requests (read more in our FAQ). For an easier solution, you can use a web analytics service such as FeedBurner to get a detailed breakdown of your subscribers from a variety of feed readers (it may take a day or two for our stats to show up in their interface, so don't worry if they're not there yet).
While you're at it, you may want to take a look at the new Google Reader for Publishers page. It has some helpful tips to ensure the best experience for your subscribers. Among other things, it explains feed best practices, common implementation pitfalls, and various ways to promote your feeds.
We intend to develop more features for feed publishers, so let us know what would be most useful to you.
Reader has always been about sharing your favorite items. One of the more fun things you can do with them is put them on your blog. That way your readers can see what you've been finding interesting, even if you don't have the time to do full posts.
Until now, putting your shared items in your blog required some technical chops, since you needed to copy and paste some code into your template. We'd always wanted to make this easier, so we worked with our friends on the Blogger team. As a result, the entire process now only takes a few clicks for Blogger users*.
All you have to do is click the "Add to Blogger" button on the put a clip on your site page in Reader (found in Settings). Now anytime you share something, your blog's readers will know about it too. It's more fun than a blogroll and always up to date.
* Just to be clear, this only works if you've upgraded to the new version of Blogger. We switched the Reader blog to it a few weeks ago, and it's been working out great (no more waiting for publishing to finish).
We have another small update to Reader regarding video. Reader should now show videos from YouTube and Google Video (and a few other sites) that you have embedded in your blog posts and articles. Some advice on how not to go about filming a feature announcement is included below. (Shot at Sundance Film Festival, too late for awards submission.)
We didn't want this to be just a Google thing, however, so we also currently support videos from other sites like MySpace, Jumpcut, Grouper, IFILM, Metacafe, Revver, Vimeo, vSocial, and games from Monsters and Critics. If your favorite site isn't listed, please tell us in the Reader group and we'll look into adding support, if possible.
One of the most useful aspects of feed readers is how easy they make it to keep track of industry news. Which in my case means using Google Reader to read about... Google Reader. For example, I subscribe to the Google Blogsearch for "Google Reader" (which has a feed) so I know whenever someone writes about our product.
In the TV show 24, everything is not as it seems. Similarly, not everything that can be done with Reader is visible at first glance. I thought I'd share some gems that were unearthed with the help of the Blogsearch feed.
Mitch Keeler has posted a great guide of various external tools that people have written for Google Reader, including notifiers, greasemonkey scripts and more.
For those of you with Wordpress blogs, Mike Crute has written a Wordpress plugin to add his shared items to his template.
John Tokash is developing Reader Mini, an interface optimized for Nokia Internet Tablets.
The Google Reader team tries to read all the feedback that gets posted on blogs, and has also been known to reply in comments. This is a great way for us to get a feel for what's important to you, so keep writing up your thoughts and feature suggestions. There's also our Google Group if you'd like to report more specific issues.
I've always been a big fan of charts, tables and other ways of analyzing and visualizing data. On my own blog I will often plotthings just to get a handle on them. Even here I've posted someanalyses that I've done of the data that the Reader team has on hand. It's therefore no surprise that my favorite blog of 2006 is Data Mining.
With this in mind, I've always wondered how I could apply this interest to Reader's feature set. It then occurred to me that there were plenty of things that could be dug up about the items that a person reads and the feeds they are subscribed to. Perhaps some feeds post very often but don't actually get read, so they may as well be removed. Conversely, other sites may not have updated in ages, so they're just taking up room in the list of subscriptions.
Playing around with these ideas, I created a simple Reader "trends" page, inspired by Google Trends as well as the Search History Trends page. After showing it to the rest of the Reader team and a few other interested Googlers, I began to gather feedback and implemented it. Most helpful was when Jeff and Doug rolled up their sleeves and applied some of the same thinking that went into Measure Map to this new Reader page. This went beyond just making things pretty; they helped make things easier to digest and understand.
The result is the Reader Trends page, accessed via a link from the "Home" page. For example, it lets me see the spike in read items two days ago (the result of my New Year's resolution of staying on top of my 322 subscriptions). There are also my subscriptions sorted by various criteria, so I can see which I'm having trouble keeping up with. Each subscription has a unsubscribe icon next to it, which I've used for those that I decided were not worth keeping around.
If you have any New Year's resolutions about time management or are a chart geek like me, trends should be useful and fun. You may discover things about your reading habits that you didn't know.
As a backend engineer, one of my favorite features of Google Reader is its ability to track the history of a feed over time. Reader takes a snapshot of feeds periodically and saves the content, so you can see posts that are days or weeks old. It's a neat way to read the web; in a way, it lets you look back in time. Combined with Reader's ability to track what you have and haven't read, you can safely jet off to Tahiti for a few weeks and never miss a post.
Ideally, though, you'd like to catch up on those posts in the order they were written. That's why we're releasing one of our mostrequestedfeatures: sorting by oldest-first. Now you can read those Lost episode summaries in the right order after you've shook the sand out of your shoes. It's available in the view settings menu, so you can select it only for the feeds or folders you prefer.
Careful observers will note that we've also added sort by auto to view settings. This nifty feature mixes feeds together according to posting frequency, so items from rarely-updated feeds (your friend's blog) show up higher than items from frequently-updated feeds like The New York Times. Look for this feature to evolve over time as we try to find other ways of highlighting the most interesting content in your feeds. Enjoy!
As an engineer, one of the things that warms my heart is when users of my product become invested enough in it to want to extend it. I was very happy to see that Reader has begun to attract all sorts of hacks and add-ons that tweak the application to better suit the usage patterns of particular people. It's hard to make an interface that is everything to everyone, and add-ons like these are our best hope of making Reader the ideal feed aggregator for the largest number of people.
Here are a few add-ons that we've discovered recently:
Google Reader Notifier (Mac): This open-source application adds a menu-bar icon which keeps track of new items within your entire reading list or just for a particular tag (the latter is useful for people like me that are subscribed to a lot of feeds and want to know only when the important ones are updated). Troels Bay, the author, has been revving the application on a regular basis, and it's getting better and better.
Gordita: Reader has one-click starring and sharing of items, but you may want to do the same to pages outside of Reader. Gordita lets you create a bookmarklet that allows you to copy Reader items that interest you to del.icio.us, along with all the other items you've bookmarked over the Web.
Google Reader Optimized: This set of user styles maximizes the reading area. When you want to sit down and power through hundreds of items, you may find this compact, stripped-down interface preferable.
Controlling Google Reader with a Cell Phone : This add-on may be a bit out there, but in a nutshell it allows you to control Reader with your Bluetooth cellphone. Perhaps if used in combination with the full-screen style above, you can build your own Reader 10-foot user interface.
Also, some of you may have had trouble accessing your Reader account this morning. There was some flakiness at one of our datacenters , but the problem was resolved within an hour. Sorry for the inconvenience -- you can rest assured that we're constantly working to improve our reliability and performance.
Being an engineer isn't always about working on fun new features -- sometimes there are bugs that need to be fixed before anything else can happen. This is especially important in an application like Reader; if you use something every day, even small bugs can start to get very annoying. Here's what's been keeping the team busy this past week:
The shared items clip that you can embed on your site will not interfere with other JavaScript that may be running (sorry about that, Stephanie).
A confirmation message is now shown when coming in from the "Add to Google" page (this includes the feed subscribe functionality built into Firefox 2).
Searching for feeds using keywords now works in Opera.
The scrolling position is now always reset when moving between feeds or folders (meaning items won't inadvertently be marked as read if you're using scroll tracking in expanded view).
The "none" color scheme for publisher clips now works (no more creative workarounds required).
The email that we supply for sending shared tags to friends now contains the right link.
Using the "next" bookmarklet correctly marks all items as read when displaying an entire blog. (We had been overly aggressive here, and marking items as read into the future as well!)
Items from different feeds or folders are no longer mixed together when clicking between them quickly.
Keyboard shortcuts in Internet Explorer should continue to work after using "gt" or "gu" (the tag and subscription selectors).
We also snuck in a small feature with this release: when you subscribe to a feed, you'll get an "Add to a folder..." drop-down. This way, you can move that feed to a folder right there and then, without having to go to the settings screen.
It's been a very exciting week since we did our big Reader update. It's good to see that peoplehavebeenlikingourwork. At the same time, we know there's still lots to do, which is why we've been busy fixing bugs and tweaking things in response to user feedback. Today we did a small release, a .0.1 of sorts. Here are some of the things that changed:
Pick your start page: You can now select which page you'd like to see when you first log in to Reader ("Home", "All items", or any folder or tag). Simply go to settings and on the Preferences tab pick which one you'd like to see.
Hiding the left side: If you'd like to get the list of subscriptions on the left out of the way so you can focus on what you're reading, you can just hit the u key (press it again to go back to the regular view).
Refreshing: We've added a small "Refresh" link at the bottom of the list of subscriptions, so you can easily refresh them to see if there are new items. Better yet, they will automatically refresh every few minutes, so you shouldn't even have to click the link. When an unread count has changed, it will flash yellow for a split-second to help you find it. This yellow fade made our Web 2.0 meter that we have in our office move up a tick.
Space is smart again: The space key now intelligently goes from item to item and from page to page (for longer items), just like it used to in the old interface.
In addition to all this, we've also fixed a few bugs. Your feedback in the discussion group has been very helpful in helping us prioritize, so please keep posting there (even if we don't reply to every single message, we are reading all of your comments).
Posted by Ben Darnell, Software Engineer
As of today, Google Reader has a new look — and even more important, a lot of new features that we think you'll like. We've listened to your feedback, done usability research, and examined all the ways that people consume content on the web, from feed readers to email clients. With a clean interface and some JavaScript wizardry, we think we've built an application that accommodates a wide range of reading styles while being fun and easy to use.
So what's new? First, we've added some things you've been asking for, such as unread counts and "mark all as read." Folder-based navigation makes it easier to organize your subscriptions, and the new expanded view lets you quickly scan over several items at once. And we've made sharing much easier - with a single click of the "shared" icon, you can publish an interesting item on your public sharing page for your friends to see. So give the new Reader a try. We hope you like it!
And what about the old interface? Well, things might look different, but we made sure the new interface enabled the reading style of current Reader users. For example, clicking "All items" and choosing "List view" should make the experience feel quite familiar. But since it's possible that we've overlooked your favorite feature from version 1, you still have the option (in "Settings") to switch back to the old interface for the time being. If you do, please let us know why so we can improve the new version to better suit your needs.
One last thing: Chris made a video for the launch. We think it's fun:
Feeds can be used for more than just text; they can embed pictures, podcasts and video. There are even more esoteric bits of data that can be attached to feeds, like the geographic location that a post is about, the number of comments it has received and that (legal) license its contents are available under. To make all of this information easily parseable by computers, it is usually available as additional items and attributes in XML namespaces. For example, the Media RSS namespace is used to add more information about videos and pictures, like dimensions, duration and a thumbnail.
This usually isn't of direct interest to end users, it's just matter of which namespaced extensions a feed reader supports, and the more the merrier. However, since there are quite a few ones out there, developers must make trade-offs and decisions. One easy way to prioritize extension support is to see which ones are used more often.
I wrote a small MapReduce program to go over our BigTable and get the top 50 namespaces based on the number of feeds that use them. This means that we only looked at feeds that have at least one subscriber, i.e. the "feeds that matter." Note that the default namespaces for syndication feed formats (e.g. http://www.w3.org/2005/Atom for Atom 1.0) are excluded, since I was interested only in extensions to the elements that are already expected to be in a feed.
We thought this information might be of interest to others, the way our analysis of XML errors and web authoring statistics have been. If I have missed anything, or if you have any feedback, a message in our discussion group or a link to this blog post is the best way to reach us.
Here's some recent changes we've made to Reader that we thought you'd like to know about:
Reading list ordering defaults: Your reading list can be sorted in different ways (by date or "automatically", which shows you more relevant items first). Additionally, it can have read items hidden or always visible. Until this week, the default combination was to sort automatically and show read items. Unfortunately, this meant that new items did not necessarily end up at the top, which was confusing to some users. We've therefore changed the defaults to sort by date and hide read items. If you prefer a different combination, these settings can be controlled by the links at the bottom of your reading list (pictured on the right).
Related subscriptions menu: When we made the recent improvements to reading by subscription or label, we neglected one use case, which was to see a list of subscriptions that have a particular label. Based on feedback from our users, we've added a new menu, "Related subscriptions," that shows up when selecting a label or a subscription that has labels.
Starring in the mobile interface: Our mobile interface is handy for when you're on the go, but occasionally you can come across an item that you would like to re-read when you're back at your computer. Until now, the mobile interface provided no way to flag an item so you could find it later. Now all items that you read have a "Add star" link at the bottom of the page, so you can easily add it to your starred items.
Bugfixes: As usual, with each release we try to polish Reader by fixing bugs here and there. Some recent ones that we've squashed include: better Safari support on the settings page and when marking items as read, better support for non-audio enclosures and better support for relative URLs in entries.
A lot of these changes were made in response to user feedback and bug reports. The best way to make yourself heard is to post in our discussion group.