Comments on: personal web platform http://cutting.wordpress.com/2004/10/01/personal-web-platform/ Ramblings about Lucene, Nutch, Hadoop & other stuff Wed, 10 Mar 2010 15:24:17 +0000 http://wordpress.com/ hourly 1 By: Rob Napier http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-844 Rob Napier Mon, 26 Feb 2007 23:55:38 +0000 http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-844 I hope you don't mind but I'd like to start with a small digression. I found your blog while trying to see if anyone could use an application of Lucene that my firm has developed for our Web 2.0 project. We built a nice search function to locate entries in our context-sensitive help system. Since we have benefited from the Lucence project and a host of other open-source projects, I am looking for ways that we can give something back to the community. So far, I've been unable to learn whether a packaged search module for placing on websites would be useful to anyone and if it is, how would we make it available. Now to the subject of your post: Web 2.0/RIAs/6As or whatever else you want to tag it seems to be in its infancy. Our once:radix environment is the only serious example of a complete development environment that we have seen so far. But over the three and a half years since we started work on this project, the advances have been extraordinary. I believe that your ideas on the subject of searching are well ahead of the game. It opens up all sorts of issues regarding the maintenance of data security. But if you can overcome that, I would be delighted to see it. Congratulations to everyone on the Lucene project. It is fast and effective. A great addition to our work. I hope you don’t mind but I’d like to start with a small digression. I found your blog while trying to see if anyone could use an application of Lucene that my firm has developed for our Web 2.0 project. We built a nice search function to locate entries in our context-sensitive help system. Since we have benefited from the Lucence project and a host of other open-source projects, I am looking for ways that we can give something back to the community. So far, I’ve been unable to learn whether a packaged search module for placing on websites would be useful to anyone and if it is, how would we make it available.

Now to the subject of your post: Web 2.0/RIAs/6As or whatever else you want to tag it seems to be in its infancy. Our once:radix environment is the only serious example of a complete development environment that we have seen so far.

But over the three and a half years since we started work on this project, the advances have been extraordinary. I believe that your ideas on the subject of searching are well ahead of the game. It opens up all sorts of issues regarding the maintenance of data security. But if you can overcome that, I would be delighted to see it.

Congratulations to everyone on the Lucene project. It is fast and effective. A great addition to our work.

]]> By: Hans Gerwitz http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-335 Hans Gerwitz Mon, 20 Feb 2006 18:46:00 +0000 http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-335 <a HREF="http://zoe.nu/itstories/story.php?data=stories&num=16&sec=1" rel="nofollow">Zoë</A> is a good start for email. I'd love to buy a network appliance that combined this sort of aggregation with .mac-style sync and publishing services.--> Zoë is a good start for email.

I’d love to buy a network appliance that combined this sort of aggregation with .mac-style sync and publishing services.–>

]]> By: Mike http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-334 Mike Tue, 31 May 2005 17:47:00 +0000 http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-334 Without the cool technologies (imap/ldap/etc), this is what Danger's sidekick has done. It has made me hunger for the open, elegant solution that you describe. - Michael Weiksner mike@e-thePeople.org Without the cool technologies (imap/ldap/etc), this is what Danger’s sidekick has done. It has made me hunger for the open, elegant solution that you describe.

– Michael Weiksner
mike@e-thePeople.org

]]> By: Brian J. Bartlett http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-333 Brian J. Bartlett Fri, 01 Apr 2005 03:12:00 +0000 http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-333 This is precisely what I have been researching and working on for the last couple of years, ever since numerous fora went to the web and we were told repeatedly that we could not use OffLine Readers (OLR's) anymore. The basic idea is to crawl the content, save it via conversion to XML into a database, and then do a merge replication to any device you happen to be connected to at the moment. Posting would be local to remote to the site in question. Since cookies, forms, and the like would all be in the database as well, and the application would be emulating a user performing the same actions, it should work. Since then the initial idea has mushroomed to add concepts such as mail collection, monitoring of Amazon, eBay, and Google (your web page ranking anyone?), and the like. Since the entire thing is dependent on a remote hosting provider that you tap yourself, is plug-in based, and will have strong authentication (passphrase, perhaps IP address based as well if desired), I think it has possibilities. I don't know about other ISP's, but mine comes equipped with durn near everything (.NET/SQL Server/etc. to PHP/MySQL) for about $3.50 per month with 40 GB of traffic, it wouldn't even be that expensive. There are limiting factors, cross-platform support (especially database feature/code compatability), firewall restrictions, etc., but the actual code is mostly developed in varioius open source applications extent today. Just food for thought as we are thinking along the same lines for what I'm now calling a personal media (or resource?) aggregator. Brian J. Bartlett mail@brianjbartlett.us This is precisely what I have been researching and working on for the last couple of years, ever since numerous fora went to the web and we were told repeatedly that we could not use OffLine Readers (OLR’s) anymore. The basic idea is to crawl the content, save it via conversion to XML into a database, and then do a merge replication to any device you happen to be connected to at the moment. Posting would be local to remote to the site in question. Since cookies, forms, and the like would all be in the database as well, and the application would be emulating a user performing the same actions, it should work.

Since then the initial idea has mushroomed to add concepts such as mail collection, monitoring of Amazon, eBay, and Google (your web page ranking anyone?), and the like.

Since the entire thing is dependent on a remote hosting provider that you tap yourself, is plug-in based, and will have strong authentication (passphrase, perhaps IP address based as well if desired), I think it has possibilities. I don’t know about other ISP’s, but mine comes equipped with durn near everything (.NET/SQL Server/etc. to PHP/MySQL) for about $3.50 per month with 40 GB of traffic, it wouldn’t even be that expensive.

There are limiting factors, cross-platform support (especially database feature/code compatability), firewall restrictions, etc., but the actual code is mostly developed in varioius open source applications extent today.

Just food for thought as we are thinking along the same lines for what I’m now calling a personal media (or resource?) aggregator.

Brian J. Bartlett
mail@brianjbartlett.us

]]> By: Anonymous http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-332 Anonymous Sun, 10 Oct 2004 13:22:00 +0000 http://cutting.wordpress.com/2004/10/01/personal-web-platform/#comment-332 My main concern here is this would require a strong, cross-platform user authentication/authorization mechanism. If this is personal data, then I need to be able to restrict access to only myself, while if it is group-work related data I need to be able to establish the identities/roles that are permitted to take actions on the data. My main concern here is this would require a strong, cross-platform user authentication/authorization mechanism. If this is personal data, then I need to be able to restrict access to only myself, while if it is group-work related data I need to be able to establish the identities/roles that are permitted to take actions on the data.

]]>