Dion Hinchcliffe's Web 2.0 Blog
Web 2.0 University

Blog Feed

Subscribe By E-Mail

Enter your email address:

Delivered by FeedBurner



Web 2.0 Expo San Francisco 2008 Speaker

Enterprise 2.0 Conference 2008 Speaker

Web 2.0 Strategies 2008 Speaker

    follow me

    Dion's Facebook Status

    Recent Readers

    Web 2.0 Ajax SOA Power Panel

    Web 2.0, Ajax and SOA Power Panel with Dion Hinchcliffe and Jeremy Geelan
    Click above to watch a SYS-CON Power Panel discussion on Web 2.0, Ajax, and SOA with Dion Hinchcliffe, Jeremy Geelan, and other industry notables including SOA Web Services Journal Editor-in-Chief, Sean Rhody. Taped on Dec 7th, 2005 from the Reuter's TV studio in Times Square.

     

    Public Calendar

    Web 2.0 Needs Trusted, Online Information Storage

    posted Tuesday, 8 November 2005
    Every platform worth its salt needs its own permanent information storage and Web 2.0 is no different. Recently I've talked about client side solutions like AMASS and TrimQuery which do very cool things to allow large amounts of permanent storage on the Web client. However I'm betting that client side storage is not going to be the solution for most people's Web 2.0 information storage needs. As Microsoft clearly realized with Windows Live and Office Live, people now have laptops, work PCs, home PCs, and mobile devices with important data and applications on each. Keeping all this data and software synchronized is a huge problem that centralized, online storage can solve. Heck, I feel the pain now, I have a new laptop that's been gathering dust for weeks since I don't have time to transfer all my data to it.

    Enter Web 2.0 to solve the problem. Keep your data online all the time and within easy reach by a permalink, right? Social data gathering sites like del.icio.us make it easy to keep tidbits of useful information available at your fingertips. Even Flickr allows you huge amounts of server-side storage for private storage of images. But both of these services are specific to certain types of data and aren't under the fundamental, long-term control of the user. And they often don't even allow data to be marked private!

    Generic storage on the Web brings up a whole morass of issues and ones that
    really need to be solved for Web 2.0 to be central and relevant to us in our daily lives.



    First is the
    trust issue. Like Michael Parekh recently said, "Look, I don’t *trust* your site to keep my personal (and definitely not my professional) data safe, okay, and I’m not going to change my daily habits to include a site that may disappear from the face of the Earth tomorrow."

    Second, is the ability for Web 2.0 sites to allow users to specify their own preferred vendor for permanent online storage of things like documents, music, images, video, or whatever. Fortunately, half of this problem is solved. There are numerous secure, online storage services today (StreamLoad, Box, Flipdrive, xdrive.com, and many, many others), though none of them are well known, trusted brands at the moment. And the long-term stability of such services is an open question for now (but if Google, IBM, or Microsoft got into the business, that would be something.)

    Third, there is the issue of standardization. There is no generally accepted way for online storage to be accessed securely by third party Web services. This makes it impossible for you to use Num Sum or 37Signals apps to do your work and then keep the data created by these services stored in a place that you choose and that you trust. The person or organization that solves this problem in a easily used, generally accepted way is probably going to do very well indeed.

    And yes, I know, you can manually export your data from many of these applications today if you want, but it's not easy, straightforward, or useful. And it's time consuming. To be successful, Web 2.0 3rd party information storage must be automatic and painless, once set up.


    Going back to the trust aspect of Web as a platform, establishing data havens that are protected by all prying eyes including governments, tax collectors, lawyers, hackers, and those just seeking to cause mischief will actually be very hard. Neal Stephenson's Cryptomonicon most famously painted a vision like this a few years ago with the concept of the offshore data haven: "The concept of a data haven is relatively simple: information is stored offshore (probably in some small, island nation) with super-strong encryption and high-speed links to other countries. The concept has been raised many times before, perhaps most notably in Cryptonomicon. There are many challenges to the execution of a data haven, but it´s clear the time has come." This level of trust probably has to be available for most folks to move all of their information to the Web. But with many associated governance issues including how to do the secure, escrow of information required by legal entities (financial information required for tax collectors, verification that accounts are child pornography free, subpoena enforcement, etc.), otherwise such information havens could become the province of only the most sophisticated criminals. Big problems indeed, but ones that will need solving for this all to work.

    Lastly, reliability is also one of the biggest issues. A local network outage, failure of satellites, breakage of undersea cables, denial of service, and many other factors can affect whether you can access your data and how fast. This issue will make many Web 2.0 services a non-starter for folks until reliability and ubiquity aproach five 9's (99.999%) and there are audits to prove it (especially important if you are trying to bet your business on using this approach.)

    For now, raising awareness and encouraging Web 2.0 services to use people's third party online storage will be enough. This includes the creation of simple, secure standards that readily facilitate the use of online storage. All this will be a task that will probably take us many years but will take us to the right place I think. I myself, plan on watching this space since solving trusted, online storage will go a long towards making Web 2.0 a widespread reality in the future.

    Update: I just received a nice note from Ian Sefferman who reminded me that his Openomy effort is launching soon. Openomy provides many of the capabilities of a 3rd party, trusted, online storage service as described here, including an API. Sometimes it does feel like Web 2.0 efforts are converging on many of the right spaces at the moment.
    Update 2: Web 2.0 VC Alex Muse reports that Microsoft just acquired FolderShare for incorporation into their Windows Live service.

    Technorati: web2.0

    links: del.icio.us    



    AddThis Social Bookmark Button

    1. Gert Van Waelvelde left...
    Tuesday, 8 November 2005 2:38 pm

    A few years ago Microsoft wanted to enter the online storage business as part of something they called ".NET My Services" (codename "Hailstorm"). .NET My Services was about having all your information online, and accessible from anywhere. Other companies could build on these services through a series of API's. They canceled that product, because apparantly the world wasn't ready for such a thing. It is fascinating to see that some of these ideas are a big part of Web 2.0 today. I believe that Windows Live is some sort of incarnation of .NET My Services. The only difference is that the world is ready for it now.


    2. Brian O'Doherty left...
    Wednesday, 9 November 2005 9:57 am

    Great article about online Web 2.0 storage. I think I can verily say that we already have it. In GroupFactor technology, exemplified at www.Quiknets.com (- go in as Guest Visitor). An easy sign up member-based network, totally web based, where each member has his own Private Box, for any files/documents, with a big range of right-click management options, such as Send anywhere, Compress/Decompress, etc. He can edit certain types of file. (eg r-click to Post Note, making a OneNote -type document). In the same system, i.e.. Integrated,... is online messaging - various types- and online document sharing, in "Meeting Rooms"- these contain files, messages and dedicated Chat for those on the Access List for a particular meeting room. All under one single sign on access ID. So, there is no question of seeking an easily accessible third party site to store documents edited/processed in the GroupFactor system--the storage is already integrated inside, as one of the services....and the various services live off and enhance each other--for example move a file from your Private Box into a Meeting Room directly. In a meeting room, r-click to "Create New Page" (a html document). Trust? The Big Issue, indeed. Users need real security, under their own control, as you say. Its what we call Telecryption and we will launch it before the end of November.Your data is encrypted in such a way that only you and whoever you send it to can decipher it. It stays encrypted on the server. And you never have to remember any but one master password, yet you have a different password for each of your correspondent relationships. Files in your Private Box are encrypted by you by default, yet, from any computer you can read them by simple one click, but no one else can. And we offer encrypted Meeting Rooms, where data stays encrypted and is undecipherable by anyone except authorised members of the "room", for whom it decrypts transparently. So, its Web 2.0 , I suppose, where all services reside on the Internet, accessible from any PC (with Windows and IE for now), although we've only just heard of Web 2.0 recently. We're a small Irish company, and have been writing this for three years, in javascript, xml, com, dhtml and some other tools, including some we developed outselves.


    3. Matthew left...
    Thursday, 10 November 2005 12:29 am

    On the subject of datahavens, check out HavenCo


    4. Lindsay Donaghe left...
    Friday, 11 November 2005 12:03 pm

    Trust and cost are still the major factors in having all your data hosted for you. For the trust issue, even if you pay for the service there are still loop holes in the terms of service for many of the current services such as this one from the XDrive: "You, not Xdrive, shall have sole responsibility for the accuracy, quality, integrity, legality, reliability, appropriateness and copyright of all Data and Xdrive shall not be responsible or liable for the deletion, correction, destruction, damage, loss or failure to store any Data." So, basically at this point, because XDrive relieves itself of any responsibility for my data's existence and accessibility, I would still have to keep a copy of all my data somewhere and make sure that it was all synced if there are any changes, which is a massive effort in itself. And, using XDrive as an example again, it costs $10/month for 5GB of data. I have probably close to 1TB of data that I'd like to store somewhere accessible and it grows every day. But I can't afford $2K+ a month to store it! I'm sure it won't be long till there is an affordable option but right now that seems to be a major sticking point.


    5. Mike Johnson left...
    Monday, 28 November 2005 10:53 pm

    If you are looking for a totally FREE online storage try www.limaspace.com . With Lima Space you get 3GB of FREE storage space and Unlimited Bandwidth for uploads and downloads.


    6. nba left...
    Wednesday, 4 January 2006 7:45 am :: http://www.recdir.com/trains_and_railroa

    hellooooooooo!


    7. Matt from 37signals left...
    Wednesday, 4 January 2006 11:36 am :: http://www.37signals.com

    This makes it impossible for you to use Num Sum or 37Signals apps to do your work and then keep the data created by these services stored in a place that you choose and that you trust.

    Actually, this isn't quite true for Basecamp (from 37signals). Basecamp allows you to use your own FTP/SFTP server to store your files if you choose. We also now offer file storage for those who prefer not to deal with hosting their own files.


    8. Tom C. left...
    Thursday, 26 January 2006 11:46 am :: http://www.pixecur.com/pixecur/our_produ

    Here's a new technology that exposes a drive in the file system on any PC. It stores your files as separate encrypted blocks mathematically across a large distributed network of leased servers in co-location facilities. You enter your Personal Enryption Code (a couple of encryption keys) into any computer running the client to operate on your files, discard the key when you're done and the files can't be found. You subscribe to a service, pay a monthly fee based on how much you are storing. Truly simple, use it from anywhere, and as far as an App is concerning, it's just coding to a file system.

    What do you think?


    9. Christopher Jones left...
    Sunday, 29 January 2006 3:43 am

    It is wonderful to see someone who is actually making the case for online protection of information.

    I have been researching the various services online. It seems security is not allways uppermost in peoples minds.

    With online services such as "todo lists" "online document editing services" "online collaboration tools" etc they sometimes have a handy RSS feature which automatically means that anybody with the URL tag of the RSS feed can view the private documents.

    My point is that when taking human errors and general inexperience, think how easy it would be to leave that single URL so that it is available for someone to see it or for it to find its way onto google, perhaps people who are using that document don't know and print some personally identifiable information, express opinions they wish to keep private, write some personal information thinking the document is not shared etc. etc, and before you know it, the information is then available to all and sundry and the persons security is totally compromised.

    Further more is the issue of data retention, people don't seem to think about email as insecure, further more people only seem to think about the link between composing email and then sending it, but nobody seems to question what happens when it reaches the servers, how long there private emails are stored for etc.

    These questions are related to the issue of online, onsite encryption and there is a huge huge case for it, especially with more and more concerns about the exponential growth in online cyber crime and identity theft etc.

    Think of this analogy, how many people would feel comfortable with this idea.

    Imagine you wrote some private and confidential, personal love letters to your future wife/fiance or girlfriend, the postman said he was going to take two or three photocopies of your private message but that it would be done in an automatic way and nobody would see it, then imagine that he told you it would be stored in a strong room for a period of time in case your letters got lost (backup), but you are assured that nobody can see them as the room is secure and he promises nobody will read them or look at them, unless some authority wants to look at them like the police, the government, or any other official like a private person wishing to get to look at your private letters via a court order for some legal reason, then of course they would be disclosed.

    How would you feel then in that situation? Well I know if the majority of people knew this they would not be too thrilled by the idea.

    Further more, recently upon questioning a well known UK based email service provider, they confirmed that they in fact " retain all emails for an indefinite period of time in there backup system".

    So that is another issue.

    Thankyou for openly discussing these related topics, I am a passionate believer in the fact that most people do not realise how easy online data can be abused and manipulated.

    Just do one simple google scan: "online encrypted notes storage" you'll find only one supplier of this service. www.luxsci.com, they are the only people on the internet that provide online secure and encrypted note space/journal space/diary space as far as I know, if anybody else knows of a service please post it here is I'd be very very interested. Even hushmail do not have this seemingly simple but very useful feature.

    With Regards Christopher Jones United Kingdom


    10. tech_samaritan left...
    Thursday, 11 May 2006 6:50 am

    There are trusted services that store your data safe and secure online. One such service is IBackup (http://www.ibackup.com)that has been around for some time.

    IBackup is consistent and they are trusted for their high performance and reliability. They use 128-bit SSL encryption for all data transfer and so far my files and folders are totally secure with them. IBackup’s online storage solution is easy to setup, simple to use. More importantly you don’t have to pay through the nose as IBackup have a slew of account options for you to choose from.

    In addition to SSL encryption, IBackup for Windows provides RC4 encryption of files on storage and it uses a user-defined encryption password. User data resides on raid protected NAS/SAN storage devices with multiple levels of redundancy.

    IDrive (www.ibackup.com/IBDrive_new.htm) and IDrive Multimedia, the network mapping applications of IBackup, also have 128-bit SSL encryption enabled by default. I think with such top level protection for my data there is no need for me to jump to the `free’ bandwagon now. Also, I don’t want all my data vanish into thin air one fine morning.


    11. John De Regnaucourt left...
    Wednesday, 27 December 2006 9:20 am

    A new player in the online storage arena is http://www.myotherdrive.com. Owned by ByteRocket, Inc. This site is unique in several ways. First, it uses a Java Applet for it's user interface, which solves a lot of the problems that HTML/Javascript based sites have. For example, it supports multiple file upload (many sites like mydatabus require the user to upload one file at a time). The files uploaded can be any size.

    The site also permits the users to share folders to 'friend' groups, with complete 'user access control' such as specific permission to 'add', 'delete', 'modify', 'view', and 'download,' per folder, per group. A friend can belong to more than one group.

    Look for a new 'synchronization' feature in an upcoming release - this option will make a local folder and online folder 'match' (taking care of uploading and downloading as needed), including handling subfolders.

    Another feature unique to http://www.myotherdrive.com is the ability to rotate image files. If you upload your personal photos and need to rotate them, it can be done online, without download the image, and then re-uploading it.

    Look for in-line video stream (aka YouTube) and music playing. The site is positioning itself to take over online storage, YouTube, and MySpace (sophisticated profile definition and search).

    The site currently offers 5GB of free storage.


    12. Marcus left...
    Thursday, 15 February 2007 2:53 pm

    Based upon all the different on-line storage sites my favorite is an American solution called Diino. It can be found at www.diino.com. It is both a client based solution as well as a web solution. The synergy between the two make this a much more attractive solution that myotherdrive.