DISQUS

Scripting News: Josh is right, URL shorteners are risky (Scripting News)

  • Jeremy · 8 months ago
    An even better solution to the Twitter URL problem: In cases where shortening is necessary, push the shortened link only over SMS. The long link is fine on the web.
  • dave · 8 months ago
    This makes total sense.
  • joshua schachter · 8 months ago
    I prefer "Joshua"
  • cshotton · 8 months ago
    Once upon a time, the URN spec was in play, allowing intelligible names in place of URLs. What happened to it?
  • tommorris · 8 months ago
    URNs can still be used for some things, and some of us Semantic Web types use them as identifiers (SQL translation: database keys) for stuff that has an existing naming system that won't map sensibly into URI-space. urn:isbn is used quite a bit to identify books, and I think that the digital library people might also use urn:issn. Obviously, the problem with URNs is that you have to have something intelligent in place to get data from them, while URIs have a set of useful built-in methods (HTTP GET, POST, PUT and DELETE) that URNs don't.

    This doesn't really solve the URI shortener problem: if we turn some long URI into a URN, we have introduced new problems.

    The solution is for everyone to stop making long URIs in the first place, and for places where long URIs are a problem to make them less of a problem.
  • mojito · 8 months ago
    With the Firefox "awesome bar" and Google integration, I don't use URL's anymore, I just type in a search string. Same with Chrome. I think Google will be the new DNS!

    Agree with Joshua about URL shorteners being a necessary evil.
  • dave · 8 months ago
    He doesn't say they're a necessary evil, he omits the necessary part.
  • joshua schachter · 8 months ago
    Yeah, I just don't see a solution here. Yet.
  • playerx · 8 months ago
    I certainly don't see individual people smartly using these short links anywhere space is a surplus.

    Well, they are bad, especially when they get recorded as the only way to get to the end point, and then expire.

    There needs to be link expanders which go out and read the HTTP 301 and then log/replace, repeat.

    Dave, when it archives the tweets with OPML editor would you put in a link expander? :)
  • Tony Buser · 8 months ago
    I created a link expander webservice which is basically doing that. It's logging the real url in it's database as they're passed through:

    http://linkspander.appspot.com
  • tommorris · 8 months ago
    What concerns me more is the HTML framing. The good URL shorteners are those which use the 302 response header. What would seem sensible would be for TinyURL et al. to basically give a database dump in a consistent format to someone like the Internet Archive, and for the Archive to then operate a lookup service for the no-longer-provided service as an API.
  • Ramin · 8 months ago
    Totally agree. Shorteners really ought to be a standard feature built into blogging engines.

    Till then, for those into Django, the recently updated django-ittybitty allows you to host your own shortener and keep track of things: http://www.codekoala.com/blog/2009/mar/13/annou...

    In the PHP world there's Phurl -- http://www.hido.net/projects/phurl/

    The thing that needs to happen is the shortener service API has to be standardized so folks can write simple embeddable tags and bookmarklets without having to worry about the underlying service. Now if only there was someone out there who could design some sort of standard API...
  • waded · 8 months ago
    I wonder how much storage it takes to back up tinyurl & friends. Bet it fits on a thumb drive. That, and a hosts file would buy you a cup of coffee.
  • Julien · 8 months ago
    I agree, but I think they are even more dangerous for phishing issues...
    but I also agree that they are a necessary evil and that, as Mojito adds, urls are probably becoming less and less relevant. How many people already type the name of websites into Google to find them?

    My bet is that very soon, the first browser with just a "searchbox" will appear...
  • joshua schachter · 8 months ago
    That's not what people use short urls for.
  • Julien · 8 months ago
    Sure, but a consequence of their use is a "loss" of value of the url itself. When a url is/was unique, it was the "important" to remember it. If you've got dozens of urls pointing to the same page... then, the URL doesn't make such sense.
  • Nigel Hall · 8 months ago
    I like the idea of a FOSS for url shortening that you can install on any domain. Then it's up to the individual to maintain a directory of their shortened links. Somebody call a VC quick.
  • lmorchard · 8 months ago
    You might like this self-hosted URL shortener: http://get-shorty.com/
  • James Robertson · 8 months ago
    yeah good idea. Where is your x10.us ?
  • daveevans · 8 months ago
    From yesterday's TC article, my thought is that much of bit.ly’s success is due to the fact that for some reason it’s the default url for Tweetdeck. I would think that Tweetdeck would charge an arm and a leg to the default url shorterner, sort of like Jason Calacanis' point about being a default recommended friend on Twitter for $250k.

    Shouldn't we add the Digg toollbar to this discussion as well?

    I think Facebook is going to be the real Twitter when all is said and done. Not a popular argument in this crowd perhaps but thats where the updates are happening.

    Irregardless, I hope Google doesn't buy Twitter and leave it to die.
  • breon · 8 months ago
    what if instead of shortening the URL, they just write some code to change it to an html link?

    for instance...

    Original
    "Check out this post from engadget http://sma.ll/8Hguf" (i made that shortener up)

    New
    "Check out this post from engadget [link]"
  • David · 8 months ago
    I'm not sure I understand the danger in URL shorteners from what has been states in this post. If you would mind would you go intonmore detail. Thank you!

    David. ^_^
  • James Kew · 8 months ago
    When that happens a large part of the web will die.

    No it won't. Links rot all the time; the web survives.

    (And I don't believe "a large part" of the web is built on short URLs, either. It might seem that way if you live on Twitter, but I don't and I don't see short URLs often.)
  • Chris · 8 months ago
    I have no issue with some URL shortening programs but what I'd like to see is an automated way to store the actual url in a bookmark service of our choice, both as safety & a bit more findability.

    Cheers.
  • michael_s · 8 months ago
    This is a good debate to have as we have seen massive proliferation of shortened URLs services but let explore this a bit mroe:

    *Lets start from the position where we don't put URLs up on a pedestal that need to be treated with religious deference --- the importance of pure URLs to users has been diminished -- in Japan advertisers don't include the URL on their billboards its simply go and Search for "Z"

    * I would suspect that 80% or more of the non-spam URLs are generated by fairly reliable services e.g. TinyURL (been around for at least 8 years). Rather, what we may have is a situation where one or two services are too big too fail.

    *By dismissing shortened URLs we are dismissing an idea that has been around in the physical world for 100+ years - you can buy a P.O. Box from USPS which redirects people to an alternative address. Do we really think that such a service should not find its way onto the web in some form.

    *Applications that auto-generate URLs need to do so with caution (use reliable Tiny URL service) --- just as you wouldn't
    use a third rate ISP or develop on a 3rd rate platform so to you shouldn't publish shortened URLs from unreliable or unproven services.

    *Google and most other search engines practice some form of URL shortening in search ads: There is a display URL which is usually very different from the destination or landing page URL --- and when a user clicks on the display URL a Google URL is called. So on the one hand we are not being entirely forthcoming with the user about their destination and secondly Google is sitting in between the URL on the page and the destination much like these URL shortening services do.
  • NigelBHall · 8 months ago
    Thanks a lot for the link. Going to give it a try.
  • spinchange · 8 months ago
    Google could fix this problem faster...and that's just a little bit.ly scary, isn't it?
  • Link Fail · 8 months ago
    I dislike shorteners that frame the content with stuff that I don't care about. Here's an example of two of them: http://go2.me/36a
  • AAfter Search · 8 months ago
    I like your intention about the short URL portability, but at the age of Twitter/Facebook and increasing wall-garden, that may not happen.

    We can reduce the one point of failure problem by having two short URLs. Web search engine AAfter.com already creates two short URLs at a time. Please, try us out, and give us feedback. We also have no problem to share our short url [aafter.us] database with any open source community. However, I am not following how 'use our own domain name' is going to work technically unless those domain points to our DNS server or every domains' .htaccess file is updated. Am I missing something?
  • kosso · 8 months ago
    I use my urlb.at shortener to shorten links made in the longer description field in Phreadz posts.

    But the thing is, is that I don't 'store/change' the link in the database itself (as twitter does). So if I decide to switch http://urlb.at off, or it's down, the original links pop back into the descriptions. Also, when someone wants to edit their post, they see the original url they entered, not a shortened one.

    Also, recently I have been running a script through my database to go and get the mime-type and title (if one exists) of every link it has. It's taking a while, but should be useful for things like search and in order to provide more info about the link being visited. (Though I haven't yet worked out exactly how I'll o that yet - probably from another parameter int he API.

    By far the worst thing I have learned about creating one is the huge amount of spam links the API gets, many of which I have 'banned' in one way or another, simply returning the requested url to be shortened.

    I built it orignally as an exercise. And since I have been recently improving it and adding the extra stuff like stats etc, I'm glad there's a discussion going on about it now. Here and on Joshua's blog.
  • Stephen · 8 months ago
    Dave,

    If you still have a vested interest in http://bit.ly can you get that glue worked out with them?
  • kosso · 8 months ago
    The new digg.com url shortener does what I call 'Referrer theft'

    Site owners will never know 'where' someone visited their sire 'from' as the HTTP REFERRER in their logs will only the show the shortened Digg url and not the url of the page the shortened link was clicked on.

    I just tested it with a few shorteners, including my own.

    I think this is really bad. And quite amazing for someone like Kevin (who is pretty smart) to do something like this.
    Sure, the bar itself is quite cute with some cute features on it, but framing a site is the worst way possible.
  • JpMaxMan · 8 months ago
    You are always free to roll your own... http://www.hido.net/projects/phurl/
  • carlosduarte · 8 months ago
    URLBorg.com allows domain mapping.
  • vrypan · 8 months ago
    It also allows to back up your data.
  • carlosduarte · 8 months ago
    Happy user here :)
  • BuzzNova · 8 months ago
    If you have a wordpress blog, you can use this plugin to shorten your own links:
    http://wordpress.org/extend/plugins/short-url-p...
  • DoeNietZoMoeilijk · 8 months ago
    "We need to prepare for the day when N of the URL shorteners go out of business."

    "PS: Twitter could fix this problem right away if they wanted to."

    If Twitter adds URL shortening, it too creates a problem if Twitter were to die. And it's not just Twitter either, FaceBook status updates aren't exactly long either.

    No, the best way, I agree with Dave, is to do it yourself. Don't rely on some third party to do it for you, with the added risk of Third Party turning either evil or belly-up. Now all I need to do is get me a shorter domain name. =]

    Speaking of third-party evil: the Disqus comment box doesn't allow me to enlarge the comment field in Safari. Well, it does, but then it just gets bigger than the iframe box (iframe? didn't check) it resides in. Ugh. If I *were* looking at Disqus for commenting (I'm not), this would turn me off.
  • dave · 8 months ago
    If Twitter did it itself that would solve the problem for Twitter.
  • DoeNietZoMoeilijk · 8 months ago
    Of course it would, but that would only be solving part of the whole problem. I don't know how identi.ca, facebook status, yammer and other microblog apps solve this problem.

    On the other hand, as I realised yesterday after posting my comment... How much of a problem WOULD it be if "shortening service X" (cli.gs in my case, I like the stats and the API) died tomorrow? I only use it for tweets anyway, and I consider tweets somewhat... let's say "temporary", anyway. If I want something to stick around, I'll post it to my blog; tweets are expendable.

    So, Service X dies, heck, Twitter dies as well... How much do I lose in that case? Not that much, really.
  • John Norris · 8 months ago
    Is there some sort of algorithm that can be applied to a URL to shorten it?
    Then the shortening and lengthening could be done locally.
    If the algorithm was known, it wouldn't go away.

    OK, data formatting is not my specialty, so maybe I'm all wet.
  • tojosan · 8 months ago
    Kottke has a great idea. I've long been concerned about the URL shorteners and their common use.

    I'm as guilty as the next guy using them though. I try to avoid their use though when the tweet will be under 140 chars anyway.

    Another solution would be for me to provide my own shortener as part of my blog. Perhaps a parallel domain, T.BB or some such.

    At any rate, this will mostly fall on deaf ears. See my other comment about change.
  • haqu · 6 months ago
    I agree that it would be better if Twitter had it's own URL shortening service. But these days, we have to use third party services. Good news: we have a choice. Bad news: we have a choice.
  • haqu · 6 months ago
    After trying to use several popular URL shorteners, I decided to make my own. It is fast and clean, with simple stats -- http://go2.st

    Feel free to suggest new features and improvements (twitter: @haqu)