Scripting News - Latest Comments in Microblogging should be decentralized (Scripting News)

Re: Microblogging should be decentralized (Scripting News)

dave — Mon, 05 May 2008 11:01:04 -0000

...or you could simply use yonkly.com when emad finishes the open source code -it's a clone of twitter, and uses twitter's api to call in and out...that way you can have your very own twitter for you and your close friends but still dump into the pool...

Re: Microblogging should be decentralized (Scripting News)

Arik Fraimovich — Mon, 05 May 2008 01:57:46 -0000

I guess you have a point there. As the famous proverb says - they didn't build the Great Chinese Wall in one day :-)

Keep up the good work, and I hope to help when I'll have some time.

Re: Microblogging should be decentralized (Scripting News)

maslowbeer — Sun, 04 May 2008 22:16:25 -0000

Isn't twitter based on XMPP/Jabber?

Re: Microblogging should be decentralized (Scripting News)

Rex Pechler — Sun, 04 May 2008 18:16:03 -0000

I want to add features on top of Twitter. Like, add custom commands to the
API, like delete_last (to delete your most recent post, if you made a
mistake)... This could be part of a wordpress-based distributed social
network. (isn't there something in the works?)

Also, we can separate microblog-posts and normal blog-posts within
WordPress. With options like "Daily summaries" or "Summarize all tweets
between each blog post" or "don't create posts, but show tweets in my theme"

Re: Microblogging should be decentralized (Scripting News)

Derek Gathright — Sun, 04 May 2008 17:56:15 -0000

The issue I see with piggy backing off Wordpress is that yeah, the capability is there, but I don't want my tweets in my blog feed. I initially used Twitter Tools to do it, but it diluted my blog so much that I eventually had to turn it off. I think there is a clear distinction & purpose for microblogging vs. normal blogging.

I think there is a real problem with decentralizing twitter and throwing it into a microblogging genre, then trying to mix it with different networks while still being able to converse with users that still has to be resolved. See the comment I just posted at the bottom of this discussion. If we don't mix it with Pownce, Jaiku, etc.. then there's really no point to this whole thing. Ok, we get a "backup" feed for the downtime Twitter has, but that will eventually be resolved and twitter won't have downtime.

Re: Microblogging should be decentralized (Scripting News)

Rex Pechler — Sun, 04 May 2008 17:44:53 -0000

I'm proposing to build a WordPress plugin that will both allow you to post straight to it, and to scrape Twitter. We can call it the WP MicroBlogging Plugin... and it will be open source and extensible. It could also run as a standalone, without WordPress, and just provide a feed/page.

Re: Microblogging should be decentralized (Scripting News)

Derek Gathright — Sun, 04 May 2008 17:07:07 -0000

Here' s one problem I just thought of... One of the main attractions with Twitter is the @ replies and discussion you have directed at twitter users. On a decentralized network, how do you address this issue? Namespace it with @twitter:davewiner? Seems a bit far fetched that would catch on, especially with the extra characters it consumes. Sure, the @reply is essentially a trackback, but that requires that you pick a specific status update to reply to, but what if I just want to direct a general comment towards someone?

I think that is the major stumbling block to decentralizing Twitter. But, if all we want to interact with is Twitter and not involve the other projects (Pownce, Jaiku, etc...) then problem solved. (Not really the best "open" approach though.)

P.S. Looks like opentweet.com was registered yesterday (by someone at angelsoft.net), I'm gonna guess it was after they read one of these posts.

Re: Microblogging should be decentralized (Scripting News)

Derek Gathright — Sun, 04 May 2008 16:47:22 -0000

Well the question I have is do you post to Twitter, then have a script that scrapes your Twitter feed, or... post to your own feed, then have a script that posts to Twitter (and Pownce, Jaiku, etc...)? This decentralized idea appears to be about owning & hosting your own feeds, so I think it would be better served to have your own feed which auto-posts to Twitter and whatever other services you like.

If we are going this route, we might as well incorporate it into a self-hosted social network. In reality, your Facebook/MySpace status updates and your Twitter updates serve the same purpose, start with that, but plan to later incorporate standards for a personal profile & XFN, then who knows beyond that.

Sure all the tools are available nowdays, hell, we're pretty much talking about microformats and the semantic web, but we still lack leadership to provide everyone with a vision for exactly how everything will work together.

Jesus, now I'm gonna be thinking about this all night. Thanks DAVE! =P

Re: Microblogging should be decentralized (Scripting News)

Derek Gathright — Sun, 04 May 2008 16:34:32 -0000

Because it benefits the user.

This would be to Twitter what Wordpress.org is to Blogger or Wordpress.com, and last I checked the latter two were still worth quite a bit of money. Sure Twitter would lose hosting for 1% of us geeks that want to do it ourselves, but the explosion of it as a standard would more than make up for it.

Re: Microblogging should be decentralized (Scripting News)

xlogik — Sun, 04 May 2008 15:53:49 -0000

One of the guys from process-one blogged about a possible Twitter like platform built on the eJabberd server. http://www.process-one.net/...

Just thought it might be of interest and worth a look!

Re: Microblogging should be decentralized (Scripting News)

dave — Sun, 04 May 2008 15:39:59 -0000

In my experience, bootstraps work one step at a time. Start with a piece of the functionality, get it working, and use it to get the next level operational. I've had good results with this. Watch the FriendFeed guys -- they're doing it. I want to do it outside the confines of a company cause they can go out in a lot of different ways (not all bad for them, but many of them bad for users). The problem is their interests and ours diverge as the network gets bigger. So if they were to go away we'd be left with NOTHING. I want to be sure I have something. What I have might not work for you, but I think I see a way for it to work for what I do. To me the conversation is not what it's about. I've always had this differnce with a number of bloggers too. I like small pieces loosely joined, not just in principal but in practice. In the meantime where's the harm in tool developers backing up the users stream in a feed on a serve outside of twitter.com.

Re: Microblogging should be decentralized (Scripting News)

Arik Fraimovich — Sun, 04 May 2008 15:30:30 -0000

I gave a lot of thought to this issue when you first started posting about it two weeks or so ago. The thing is that twitter is more than just a platform to publish your tweets on. It's a communication tool, and therefore it's not that easy to decentralize it. If twitter is down, and all I can do is post my tweets it has all most no value to me. The value of twitter is from the conversation with other users.

Unless we come up with a solution to decentralized twitter streams and conversations, we won't have something worth. Maybe creating something over the jabber protocol (or at least very similar to it) will make it work. Because as far as I know, different jabber servers can talk one to each other - and that's exactly what we need with twitter.

And regarding the support of twitter for location of the alternate feed - we can just put it's address in the location field.

Re: Microblogging should be decentralized (Scripting News)

dave — Sun, 04 May 2008 13:51:31 -0000

I'll put up a hosting service today. I'll post a note when it's ready.

Re: Microblogging should be decentralized (Scripting News)

ka9dgx — Sun, 04 May 2008 12:43:57 -0000

While I look forward to a distributed twitter replacement, I think that there is more value in the silo model than we might have all suspected. It's important to make sure we deliver ALL of the social value, or it'll never work, no matter how clever the programming.

Here's why silos work: http://mikewarot.blogspot.c...

Re: Microblogging should be decentralized (Scripting News)

Jim — Sun, 04 May 2008 08:18:46 -0000

Thats exactly what i was thinking as i read this article.

Its not necessary for Dave to host our feeds when we all have systems in place on our blogs that already do such a thing. Plus we could serve it through feed burner to take any real heat off of our own hosts.

Re: Microblogging should be decentralized (Scripting News)

Richard — Sun, 04 May 2008 07:03:11 -0000

I've recently written a Twitter client and would definitely be interested in something like this. If you get a hosted service set up let me know.

Re: Microblogging should be decentralized (Scripting News)

kleevr — Sun, 04 May 2008 05:17:02 -0000

OVFO, one vote for open

Re: Microblogging should be decentralized (Scripting News)

Harold Gilchrist — Sun, 04 May 2008 04:36:38 -0000

I don't believe the answer to decentralized Twitter is RSS. I believe the answer is for anyone to be to run a standardized microblogging protcol server (mbps). Wasn't that the answer with the web? ie. http. If the Web was designed like Twitter (pne centralized server) is now we all would have all of our web pages on the same web server and have the same problems that are being experienced by the twitter net. Decentralization needs to start at the server. Someone or group needs to start standardizing a microblogging protocol that would be lead to an open server that can be run by anyone and supported my all present and future micro blogging clients/catchers like Twirl. Yes RSS is in there somehere but is not the core architecture that is needed to solve the decentralization problem of Twitter.

Re: Microblogging should be decentralized (Scripting News)

ka9dgx — Sun, 04 May 2008 02:34:05 -0000

I did some back of the envelope calculations about twitter... and put them in a blog post. - http://mikewarot.blogspot.c...
I also put the spreadsheet online (thanks to google docs) -
http://spreadsheets.google....

I estimate that the aggregate of ALL tweets is somewhere around 3k second, or 11 Mb/hour, or 264 Mb/day. I assume 332 bytes/tweet, which is very conservative.. so actual bandwidth would be less.

The trick is of course, that the 3k/second has to be tapped for the appropriate output streams. It could be done in a distributed framework.

--Mike--

Re: Microblogging should be decentralized (Scripting News)

Erik Giberti — Sat, 03 May 2008 21:51:55 -0000

What about a torrent style system for hosting of the feed? That would let you replicate the feed more broadly so high traffic feeds could be digested more easily and it doesn't rely on the user to set up machine instances etc

Re: Microblogging should be decentralized (Scripting News)

Bob Lee — Sat, 03 May 2008 20:58:00 -0000

We don't need support from Twitter. We can put <link rel="alternate" type="application/twitter" ...=""/> tags on your home pages (which are linked from Twitter already). It requires one more level of indirection, but it utilizes an existing abstraction.

Re: Microblogging should be decentralized (Scripting News)

Bill — Sat, 03 May 2008 20:19:19 -0000

I'm confused as to what Twitter's motivation to add the feature would be.

Re: Microblogging should be decentralized (Scripting News)

smbeebe — Sat, 03 May 2008 19:17:58 -0000

I already have RSS feed of my entire twitter stream, however, your idea is better because it differentiates each users' stream with an "alternate stream" hosted elsewhere which segments your twitter traffic and keeps a local copy ...smart since we already know that twitter sometimes goes down.

Re: Microblogging should be decentralized (Scripting News)

Rex Pechler — Sat, 03 May 2008 17:43:35 -0000

I think I've got it:

(I'm just thinking out loud here, hope you don't mind... also, I use WordPress, and PHP so I'll use that as my example system here)

A php script that follows the Twitter API format for posting messages. This way I could post easily, and maybe clients could be adapted easily to work through my server instead of Twitter's.

Next, a php script to archive any messages that I post directly to twitter, so I can use the current Twitter interfaces and have a backup.

I would then have a reliable microblog feed (through a third script) for when Twitter goes down... But what about other people? Assuming other people would set up the same or similar systems, we could create a directory of their backup feeds. This could be promoted and collected through a twitter bot, and hosted somewhere publicly.

... and then finally a fourth php script, this one to get data from my twitter friends' backup feeds. It would keep a list of the people I follow, and then ask the directory for (and store) the location of their backup feeds.

Thoughts?

Re: Microblogging should be decentralized (Scripting News)

dshaw — Sat, 03 May 2008 17:42:36 -0000

switchabit.com ? Sounds interesting.