Yahoo Pipes is pretty powerful

Until recently, people had been asking on Vallywag and Digg what Yahoo Pipes might be. Well, now we know. Yahoo Pipes is a powerful way to munge and aggregate feeds using a very slick graphical interface. Editing feeds in as a workflow means you can get some powerful results very quickly. For sources it currently supports Flickr, Google Base, Yahoo Search and Yahoo Local, as well as fetching arbitrary URLs (which you can also munge with a URL builder). All sorts of user inputs are supported, as well as iterative blocks to annotate and replace content, content analysis (which finds significant terms, and has long been a useful Yahoo API in its own right), content filters, BabelFish, string manipulation, date formatting, and more. The list goes on and will hopefully keep growing. Imagine taking the feed for your favourite blog and automatically having a relevant photo from Flickr added to each post. This not only makes such a thing possible, it’s one of the many included examples.

To try it out, I decided to create a simple pipe. I went for the standard feed-scrubbing example; BoingBoing with Xeni’s posts removed (nothing against Xeni, it’s been a long-running hobby of BB readers to make it more worksafe by filtering out her content, originally using Greasemonkey).

Pipes can published and shared with the wider world, so now you too can see my BoingBoing sans Xeni pipe here and of course subscribe directly to the RSS feed.

Other than couple of small usability gripes, I really love the system already, and am looking forward to making some cool things with it.

What gripes, you ask? Well, for one thing to populate a for-each module I have to drop the other module into it directly from the side bar; it doesn’t work if you drag them in from your workspace. A small thing, and it only took me 30 seconds to figure it out, but it’s not obvious. It’s a compliment to the system really, and when something is this close to being perfect a couple of tiny flaws make you notice how good it really is.

Now the internet is not just a series of tubes, it’s held together by a series of pipes.


RSS feed for comments on this post. TrackBack URI

  1. I read that title multiple times as “Yahoo Pipes is Pretty Awful”. I don’t know why. The UI is indeed rather slick. It’s good to see this happening, just to get the ball rolling in people’s minds.

    Comment by Neil Dunn — February 9, 2007 #

  2. The closing line’s the zinger! The interface looks subtlely striking (!), somewhat like Web 2.0 cliches combined with early puzzle games (like The Incredible Machine).

    Has anyone created any great pipes involving Second Life yet? I’d sure like to know!

    Comment by Torley — February 9, 2007 #

  3. I’ve been enjoying Pipes some more this weekend, and while I’m still impressed with the interface, the limitations are starting to annoy me. I want to be able to do more things with the feed than filter, translate, extract significant terms (with no input into which might be the most useful elements to check by the way), etc. I want to be able to get to the tags in my recent bookmarks, and make further searches based on that.

    Of course, since Pipes is web based there’s nothing stopping them sneaking more features in there over time, and I hope they will.

    The other thing to note is that of course while this is whizzy and pretty and usable, it’s not the only, or the first, mashup maker out there. I’ve been tagging some more using ‘mashupmaker‘ on The one I should probably mention (partly because it’s an emerging tech prototype from IBM, and so I’ve been talking about it at conferences and with clients for a while now) is QEDWiki.

    Comment by Roo — February 10, 2007 #

  4. Now that really is starting to look like the beginnings of the future. You need a full scripting language in there, and the ability to store and retreive to a database. Throw in a connection to amazons mechanical Turk, and you’ll really be living declaratively….

    Comment by kybernetikos — February 11, 2007 #

  5. Pipes and QEDWiki are pretty cool since they can be used by non programmers. I think that developers will always want to have access to straight HTML / JS and do not want to be bound to a certain platform. We have a simple MashupMaker online that allows just that. Check it out at

    Comment by Mike — May 23, 2007 #

  6. Learning Into The Rules And Regulations Of Google Google Adsense!
    and jezyk angielski. Learning Into The Rules And Regulations Of Google Google Adsense!

    Comment by nauka angielski online — January 24, 2014 #

  7. computer dictionary download and pozycjonowanie radio eska.
    computer dictionary download

    Comment by pozycjonowanie www wroclaw — April 7, 2014 #

  8. koenzym q10 naturell. Anti-Aging Skin Care: Turning Back The Clock

    Comment by — April 26, 2014 #

  9. Find An Epidermis Whitening Cream That Does Work and feromony naturalne.
    Find An Epidermis Whitening Cream That Does Work

    Comment by guarana działanie — April 26, 2014 #

  10. koenzym q10 do ssania. What Most Lipitor Secondary Effects

    Comment by gdzie kupic chlorelle — April 27, 2014 #

  11. How To Tighten Aged Skin Secrets Revealed, kwas
    hialuronowy ceny. Coenzyme Q10 Benefits For Skin
    You see as we age our muscles require more strength yet our capacity to maximize our
    natural amount of COQ10 begin to fade. COQ10 Ubiquinol gives our cells and thus
    our muscles a new energy intensity. Our heart pumps better.

    We become energized. And for using melancholy and depression
    motivating great news bulletin. We feel better because we are better.

    If we combine the development seen with the protein complex, thats a 72% improvement overall.
    You will get another 10% by using a fish oil supplement,
    plan . another study. Over time, you could the 100% evolution.
    Is it long lasting?

    With infinite options of anti wrinkle cream to choose
    from, is actually bound to be able to some confusion in selecting the best face cream,
    which you want. While doing so, you need to compare elements and reviews of wrinkle skin care products
    before they have been used.

    This suggestion should not make you’re thinking that the regular use of sunscreen may be the way to obtain
    protection. Various questions regarding effectiveness nicely as the safety of sunscreens.
    The best way to protect pores and skin is with clothing, just like
    a wide-brimmed baseball hat.

    One of the items that happen when your skin is confronted
    with sunlight is always that the volume COq10 for the cells is quickly worn
    down. Normally, COQ10 is found in every cell, as it’s needed for the cells produce energy.

    Before I get to the cosmetic ingredients to look for, i’ll just tell you in regards
    to newly released study concerning sagging facial skin and fish oil supplements.
    Actually. You really are your diet. The study showed a 10%
    improvement in firmness after three months of using supplements.
    10% might not seem like much, it also does develop a noticeable distinction.

    Now, heres what products for sagging skin
    should include.

    What Doesn’t WorkIt has to be a mistake as a measure to answer the
    question; exactly what is the strongest wrinkle cream without
    mentioning the elements that don’t execute.
    Some of them may actually do more difficulties.

    All these qualities specify anyone able to better deal with depression; more energy,
    better general as well as an ongoing desire to maintain a quality standard of
    living. And all from an excellent COQ10 quantity.
    kwas hialuronowy ceny How To Tighten Aged Skin Secrets Revealed kwas hialuronowy ceny

    Comment by kwas hialuronowy cennik — April 27, 2014 #

  12. koenzym q10 wlasciwosci. Tips On His Or Her Use Of Anti Aging Skin Care Products

    Comment by koenzym q10 wystepowanie — April 27, 2014 #

  13. A Take A Lsu Tigers College Football and nauka angielskiego
    online. A Take A Lsu Tigers College Football

    Comment by nauka slowek — April 27, 2014 #

  14. koenzym q10 skutki uboczne. Anti Aging Foursome Part Two
    Coq 10

    Comment by — April 28, 2014 #

  15. How To Go To Facebook Photos University and angielski lekcja
    1. How To Go To Facebook Photos University

    Comment by angielskie idiomy — April 28, 2014 #

  16. The Ideal Swimming Holes Vermont and benefits of spirulina.

    The Ideal Swimming Holes Vermont

    Comment by spirulina tabletki — June 16, 2014 #

  17. That is a really good tip especially to those new to the blogosphere.
    Short but very accurate information… Many thanks for sharing
    this one. A must read post! describes it (
    szafki na buty

    Comment by — June 17, 2014 #

Leave a comment

XHTML: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Powered by WordPress with GimpStyle Theme design by Horacio Bella.
The postings on this site are my own and don't necessarily represent my employer's positions, strategies or opinions.