Dion Hinchcliffe's Web 2.0 Blog
Web 2.0 University

Blog Feed

Subscribe By E-Mail

Enter your email address:

Delivered by FeedBurner



Web 2.0 Expo San Francisco 2008 Speaker

Enterprise 2.0 Conference 2008 Speaker

Web 2.0 Strategies 2008 Speaker

    follow me

    Dion's Facebook Status

    Recent Readers

    Web 2.0 Ajax SOA Power Panel

    Web 2.0, Ajax and SOA Power Panel with Dion Hinchcliffe and Jeremy Geelan
    Click above to watch a SYS-CON Power Panel discussion on Web 2.0, Ajax, and SOA with Dion Hinchcliffe, Jeremy Geelan, and other industry notables including SOA Web Services Journal Editor-in-Chief, Sean Rhody. Taped on Dec 7th, 2005 from the Reuter's TV studio in Times Square.

     

    Public Calendar

    RSS is the Web 2.0 "Pipe"

    posted Friday, 11 November 2005
    Problematically, RSS is still not quite a household word yet, and even the software industry is just beginning to realize the importance of this workhorse syndication format. Though at this point it's already clear RSS will be the key enabler of Web 2.0 and Software As a Service. It will do this both as a notification system and as the actual glue that will eventually hold many Web 2.0 services and mash-ups together.

    Dave Winer famously created the current incarnation of RSS but its implications are still rippling through the industry. The folks that can fully appreciate RSS will reap corresponding rewards. Microsoft CTO's Ray Ozzie is a good example of the folks that "get" the significance of RSS. I love the quote from his much-discussed leaked memo this week and I haven't been able to stop using it for the last day: "[RSS] is filling a role as ‘the UNIX pipe of the internet’ as people use it to connect data and systems in unanticipated ways."

    And we can't forget that RSS feeds, storage, synchronization will be a
    central new feature of the next version of Windows.

    So expect to see RSS on every blog, every Web 2.0 service, web site, and piece of desktop software going forward. If you can't find the feed, you can be sure whatever it is won't last long.

    And for the fully buzzword compliant and for the record, I do fundamentally believe REST/RSS is the new EAI. And the glue of first choice for lightweight SOA as well. And I'm actively starting to see some folks drop their traditional Web services and go RSS wholesale.


    Of course, the real problem right now is that most people on the Web still don't have any idea what RSS is. At best, the average Web user might understand that RSS forms some kind of information "feed". More sophisticated users notice that if they can find an RSS link somewhere (a blog or news site for example) that they can use it like a URL to get updates of information within services like My Yahoo, Bloglines, or something called an RSS reader.

    Murkiness and partial examples are the enemy here. Raising awareness and finding clear examples that fully express the potential and power of RSS should be the goal.

    Here are some clear, canonical examples that I think convey the full scope of what RSS does for us in a Web 2.0 world:

    RSS Use Cases

    Notification: Need to inform a lot of people about changes to information? Don't want central control? Want to enable self-service? Use RSS.

    Syndication: Publishing new information regularly? Put it into an RSS feed. This flows out to the world your blog entries, news articles, podcasts, videos, job posts, weather reports, financial updates, bug reports, etc. The software you use should be able to take your information and make it into an RSS feed. If your current software can't, find new software. It's that important.

    Glue: Need to connect any service to another service on the Web (or anywhere else)? Trying to mash together data? Building supply chains? There is generally no need to ever ask anyone to stand up a new web service. Pull everything you need via its RSS feed. Some software developers will disagree with this and say there are better methods, but to this I point out: 1) RSS is robust enough that it's all you'll ever need nine times out of ten and 2) it's what you're going to offered automatically anyway, take it and get something done.

    RSS creates the Web 2.0 information ecosystem by enabling interconnectedness, network effects, emergent behavior, and much more as well. And RSS doesn't demand control of the other end of the conversation. This is a big enabler all by itself and is a classic Web 2.0 force. By letting consumers of RSS use any tool or service they want on their side, barriers are eliminated and connectivity is encouraged.

    That doesn't mean that RSS doesn't have its
    weaknesses either and certainly there are other ways to create feeds, but RSS has the mindshare, support, and the goods right now. So though it's not perfect, it's more than up to the job. Let's spread the word...

    What did I miss? What other canonical examples are there?

    Technorati: web2.0, rss

    links: del.icio.us    



    AddThis Social Bookmark Button

    1. Hooman left...
    Friday, 11 November 2005 10:21 am

    RSS is undoubtedly an important first step on the path towards an interconnected network of shared social services. However, I think that everyone needs to step back from and take a hard look at it from a software design perspective. RSS is not and, frankly, should not be the mechanism to "tie" a Web of data together. There is no way to discern the structure, or meaning of the data in RSS 2.0. Yes, there is more structure than a simple text page. However, how do you know what the content contained within a feed actually means? By the title? By the channel name? By the item name? How do you know what an item name means relative to other items? How do you put the data in context to be manipulated in a useful manner? Where are the objects? For those of us that are data junkies and subscribe to 100s of feeds, this is a serious problem. It is great that I do not have to hope through websites to find information. But I still am constrained by the same keyword search mechanisms that I find on the web. Bottom line, although RSS is a good first step, there is a lot more to be done. Keep hacking folks.


    2. Stu left...
    Sunday, 13 November 2005 5:30 pm :: http://www.devdawn.com

    Dion,

    Great Article! Even though if I think about it, I understand RSS, the way you talked about it made me realise that it's more than just another tool that wordpress enables :).

    Am looking forward to reading more of your stuff. Keep on pushing out ideas, and making your vision known. That's another thing I liked about your article, it was clear that your purpose is for RSS to become better understood. Or at least, how it fits into solutions.

    Thankyou.


    3. David Gibbons left...
    Tuesday, 15 November 2005 3:35 am :: http://remoteiq.com

    Hi Dion.

    I agree on syndication but don't share your enthusiasm for RSS other than that.

    RSS is an unscalable, latent and highly ineffecient technology to impliment for either "Notification" or "Glue" - frankly, it's bad advice to apply RSS to those two use cases.

    The reason - the business processes requiring N or G are event-dependant - RSS is a "pull" protocol - events require push + pull to be properly orchestrated.

    Applying RSS to N & G will result in one of the following undesiderable outcomes ... 1) latency (this is why you have to ping technorati) or .... 2) VERY high and technically redundant processing overhead (this is why they don't ping you more often)

    These are hard lessons learnt in enterprise internet trenches --> pub-sub doesn't hack it for Enterprise business services - other than syndication. RSS IS "really simple" and should not be applied to all integration problems.

    The closest the web has to a standard today that I would advise using for N or G is ebXML - but few RSS hackers will be able to groc. it (myself included).


    4. Dion Hinchcliffe left...
    Tuesday, 15 November 2005 6:38 am :: http://hinchcliffe.org

    David,

    I would have agreed with you in the past but then I appreciated the numbers and the scale. In my post, I clearly stated that RSS is good enough 9 times out of 10. Given where it will be used and who will be using it (tens or hundreds of millions of uses), I bet I might have gotten the proportion wrong. I think RSS is probably appropriate 95 out of a 100 times or more in most given Web service situations. When it's not, I believe you should use the proper tool for the job, whether that's POX/HTTP, REST, SOAP, WS-*, JSON, or whatever.

    And yes, high latency is an unfortunate side effect of pull only protocols. For many applications, that's actually acceptable, and so far pinging has been a workable reinforcing adjunct. When it's not, I agree that you have to move to something else. See my next post about "tolerance continuums", which I think addresses some of your concerns in more detail.

    Best,

    Dion


    5. David Gibbons left...
    Tuesday, 15 November 2005 1:11 pm :: http://remoteiq.com

    Dion,

    Maybe 95% of use cases, but in terms of transaction volumes, this solution only works in the tail. By volume, I'd be surprised if RSS ever back-ends more than 5% of internet traffic - i.e. it's definitely not "THE" pipe.

    It has to do with context, right? If you're a hacker, playing with mashups on the weekend, then OK. If you're a company trying to make technology choices and buid web2 products, then applying RSS to notifications and glue is a big mistake. Why is latency not a bigger concer for you - surely it breaks notification and glue processes - this impacts the user experience - the RSS experience is sub-par and sub-expectations on the "anything anywhere" internet. That is another reason why adoption is so slow (I'm not the only geek not using it much). Just because the technical implementation is easy, doesn't mean it creates a good product.

    Performance is the bigger issue though. The diagram above, if implimented with RSS, would incur a redundant data processing and bandwidth cost that is exponentially (to the 10th power) bigger than that actually required to execute the process. This overhead is not only unacceptable from a $ and c's perspective, but is also a recipe for taking down your entire operation. Feel free to ping me for some gory examples. (Which post you were referring to?)


    6. Dion Hinchcliffe left...
    Tuesday, 15 November 2005 7:01 pm :: http://hinchcliffe.org

    David,

    I think we're almost in violent agreement. The point is pretty important so I'm glad you keep hammering on it.

    You're absolutely right that RSS only works in the tail, but the Web has a very, very large tail. From here on out, RSS will be the one web service you will always have available. Go to a web site and the one web service/feed you can count on seeing will be RSS. Other formats may emerge (and this might finally be where the Semantic Web/RDF steps in and is viable) but in 99.999% of the sites you visit, the API will be RSS, or if you're very lucky, REST.

    I would totally prefer REST myself for most things but that decreases the hackability/remixability factor for a lot of folks (REST is just too open ended).

    Developing a core competency in consuming RSS effectively is where it will be for so many people.

    That won't, and shouldn't, stop folks with serious needs for transaction abilities, volume, and stabler, robust protocols from using them. They just won't have as much company, or users.

    Best,

    Dion


    7. David AGAIN left...
    Tuesday, 15 November 2005 7:59 pm :: http://remoteiq.com

    :-)

    For hacking around in the tail, "feeds" are where it's at. We're fully agreed (on its importance, too). Thanks for your tenacity with me. I'm not sure I agree that the averagre web user gets anything out of hacking the tail - let's wait and see (When my Mom hacks up a mashup, I'll let you know).

    Clarification; I think all PUB-SUB protocols are evil for anything other than syndication and have nothing in particular against RSS, it's just the most popular hammer. Whatever the protocol, I think "event awareness" needs to be added to the picture.

    Best,

    d

    (PS - Conversation - this is what blogging's about - and a LOT more constructive than debating the Web2 definition)


    8. David (yet again, with update) left...
    Tuesday, 22 November 2005 3:15 pm

    Hi Dion,

    We have a solution - http://msdn.microsoft.com/xml/rss/ssefaq/

    Now, with SSE, I agree that RSS could be the pipe of the internet. Prediction ... SSE (or something like it) will be the protocol of choice for Notification and Glue ... since SSE uses RSS for syndication, we're both right :-)

    d


    9. pipe left...
    Wednesday, 20 December 2006 9:00 pm :: http://www.chinatraderonline.com/Lighter

    Cool!<a href="http://www.chinatraderonline.com/Lighters-Smoking-Accessor ies/Pipe/">pipe</a>