Visit Adam Hobson's column >>

ADAM HOBSONHome Page

Saving the World Since 1984
Add To Watchlist
Articles Posted: 217; Links Seeded: 4232
Member Since: 1/2006

Newsvine API: What I would like

advertisement

Way back during newsvine's beta period in January, the newsvine team asked the community what custom APIs they would like to build all sorts of custom external applications. The discussion resulted mainly in a request for features, though there was some good suggestions for possible APIs.

Some of you may know that I have been working on a newsvine toolbar extension for Firefox (and Flock) called Firevine (So the name may be a bit cliché). I released version 0.3 in early January. There are many features that I would love to add, as well as a few other applications such aswordpress plugins, and various widgets. However, at the moment I am limited to basically just the various RSS feeds with which to work, and thus the possibilities are limited.

Thus I present to the community a few suggestions for possible newsvine APIs and their possible uses, listed in the order of which I feel is more important and useful.

Access to the conversation tracker

This is by far the most useful and needed feature. I even created a sample XML document (the DTD) that would be perfect to store the conversation tracker information. All it needs is the newsvine team to populate it with the proper information.

With this access, we could be notified of new comments where ever we happen to be browsing. You could be surfing CNN.com and notice that one of you articles gained a comment, open the external tracker and navigate straight to that comment. The conversation tracker is easilynewsvine greatest advantage over other sites such as Digg and Netscape, where you have to manually track your own conversations. Imagine the possibilities if you can track your newsvine conversation while not even browsing newsvine!

Access to the votes

Currently there is a method used by the seeding window that checks whether the current URL being seeded is a duplicate. It returns a few values, one of them indicating whether the URL is a dupe, and another value the URL to the original seed if the item is a dupe.

It would be great to add another value or two returned by this method, or a similar one. If the URL is already seeded it would be great to receive a notification of how many votes the articles already has, and a method to vote for the article.

Basically if implemented properly, when browsing an article that has already been seeded you will be notified that it has in fact already been seeded, you will see how many votes it has and you can vote for it yourself. I think this could greatly increase the amount of votes seeds receive because as we browse the Internet, we can vote on items without having to find where they are posted at newsvine.

Another use for this API would be to create newsvine badges similar to ones available for both digg and Netscape that we could place directly on blogs or other content sites. Not only could we then use it to submit an item to newsvine, but when it is already submitted we could vote directly on that page, again without having to find the item on newsvine to vote for it.

External commenting

I am less certain as to the benefits of this potential API and its uses, however I will at least propose it.

Just like the previous proposal where submitting a URL to the API will yield the amount of votes and let you vote, a different API could accept a URL and return a method to post a comment to the seed of that URL. Thus we would be able to comment on seeded items without actually visitingnewsvine.

There are a few potential problems though with this API and I would be quite fine if it was never implemented. The first problem is that we would be commenting blindly. For all we know we may just be repeating five other comments. Another problem is that these comments would not help support newsvine because users would be commenting externally and not viewing the newsvine ads that the site needs to stay afloat.

Another use of this API could be integration into blogs and the comments of mainstream sites. When posting a comment directly to the blog or mainstream article, you could be given an option to cross-post that comment to the corresponding seed at newsvine, if it was already seeded.

Access to the Chat

Other than for a few big events like Arena of Death matches or Drinking contents, the newsvine chat feature has gone relatively unused. Part of that is because there are never that many people at one time even viewing a particular item, much less wanting to chat about it. The newnewsvine live page and corresponding chat module could encourage more real time communication as this could serve as a central location for generalnewsvine talk.

Following that idea, it would be useful to be able to have a method to call a newsvine chat pop-up window from anywhere. That way if we just felt like chatting on newsvine we could click a browser bookmarklet and open the newsvine live chat.

Or even better, there could be another method that if given a URL that is already seeded, will return how many people are in the corresponding chat, if any, as well as a link to open an external chat pop-up and join right in.

The Big Picture

It was recently announced that Netscape would soon be unveiling version 9.0 of their browser. The big story is that the new Netscape browser will be very integrated with Netscape.com a social bookmarking and news site similar to newsvine and digg.

In my mind, this is clearly the next logical leap for social news. Flock was an attempt to integrate social networking and Web 2.0 with a browser. Netscape 9.0 will go one step further an integrate a browser with one particular social news site. I do not believe that newsvine requires its own browsers, because thankfully browsers like Flock and Firefox already exist that allow us to extend them to our heart's content.

Newsvine needs a full featured extension. Newsvine.com will be the hub, but the extension could connect everything together. Access the most important features of newsvine while browsing anywhere. Utilize the many features of newsvine for every page that you visit. Newsvine will no longer be just a website, but an entire experience.

I'm willing to write this extension, I just need some help in the form of an API.

  • 34 Votes
  • Enjoy this article? Help vote it up the 'Vine.

Back To Top

Published to:

What's this?
Who's leading the conversation?
This visualization below allows you to see the impact that each user has on the current conversation. The top row contains the group of users who have had the most impact, the 2nd row the group of users who have had the 2nd most impact (et cetera). Users with similar impact are grouped together, and the average score of the group is shown to the left of the group. The author of the article is also shown on the left, in their corresponding group. Each user's score is based on the number of comments the user has made plus the number of votes their comments have received. The scores are calculated relative one another, so while their absolute value is not particularly important, their relative difference does indicate a larger difference in impact on the conversation.
39
7.8
4.7
{"commentId":509004,"authorDomain":"darkside"}

Hear, hear!

(or is it here, here!)?

{"commentId":509004,"threadId":"73191","contentId":"549821","authorDomain":"darkside"}
  • 4 votes
Reply#1 - Fri Feb 2, 2007 4:08 PM EST
{"commentId":509009,"authorDomain":"stolte-sawa"}

I've always wondered.

{"commentId":509009,"threadId":"73191","contentId":"549821","authorDomain":"stolte-sawa"}
  • 2 votes
#1.1 - Fri Feb 2, 2007 4:10 PM EST
{"commentId":509025,"authorDomain":"deatienza"}

Maybe it's "Hear here."

{"commentId":509025,"threadId":"73191","contentId":"549821","authorDomain":"deatienza"}
  • 1 vote
#1.2 - Fri Feb 2, 2007 4:19 PM EST
{"commentId":509033,"authorDomain":"thevineofhob"}

I've always been a fan of either "hear heer!" or "heer hear!" ;-)

{"commentId":509033,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 3 votes
#1.3 - Fri Feb 2, 2007 4:23 PM EST
{"commentId":509048,"authorDomain":"stolte-sawa"}

I always figured it was a response to "lend me your ears," in which case, either works.

{"commentId":509048,"threadId":"73191","contentId":"549821","authorDomain":"stolte-sawa"}
  • 2 votes
#1.4 - Fri Feb 2, 2007 4:30 PM EST
{"commentId":509646,"authorDomain":"chill888"}

I thought it was hee hee and people were laughing at me.

Good luck on the continued development I have 0.3 installed and would love to see the features u are targeting. well done

{"commentId":509646,"threadId":"73191","contentId":"549821","authorDomain":"chill888"}
  • 4 votes
#1.5 - Sat Feb 3, 2007 3:56 AM EST
Reply
{"commentId":509155,"authorDomain":"brianford"}

You can read more,
here, here.

{"commentId":509155,"threadId":"73191","contentId":"549821","authorDomain":"brianford"}
  • 6 votes
Reply#2 - Fri Feb 2, 2007 5:35 PM EST
{"commentId":509242,"authorDomain":"thevineofhob"}

Okay, enough with the heres and hears. It's about the API folks, the API.

{"commentId":509242,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 4 votes
Reply#3 - Fri Feb 2, 2007 7:04 PM EST
{"commentId":509401,"authorDomain":"Keter"}

Would offering to sign an NDA help? I'll bet there's some kewl proprietary stuff lurking in there. FYI, I'm a technical writer if they need it documented, and I'll do an NDA.

{"commentId":509401,"threadId":"73191","contentId":"549821","authorDomain":"Keter"}
  • 1 vote
Reply#4 - Fri Feb 2, 2007 10:43 PM EST
{"commentId":509457,"authorDomain":"pwtenny"}

Bare minimum and first to be implemented have to be the ridiculously simple trackback ping, the much more complicated standard Atom API, and automated XMLRPC pings (also pathetically simple) to ping aggregators or individual sites such as Technorati.

The XMLRPC pings can be implemented in less than a couple of hours, 15 minutes if you know what you're doing. Trackback would take longer to implement because of spam and flooding abuse prevention code, plus you have to store the information in the database. Total time should be less than one day.

Atom is a whole other story.

{"commentId":509457,"threadId":"73191","contentId":"549821","authorDomain":"pwtenny"}
  • 3 votes
Reply#5 - Fri Feb 2, 2007 11:27 PM EST
{"commentId":509476,"authorDomain":"thevineofhob"}

I actually like it that they don't support Atom, I'll just quote from A List Apart for this one,

Why RSS 2.0 only?

Sure, there are other syndication formats out there, including some that aren't even called RSS. And there are companies that will generate multiple formats from a single RSS feed. We thought about all that.

And decided that RSS 2.0 was a standard, and that it was better to choose a standard and stick with it than to contribute to the fragmentation of the world-wide digital brainosphere.

Some pings would be nice though...

If you check the source code you can see that newsvine tags are now properly given the rel="tag" attribute so that a site such as Technorati can parse them.

However, depending on how you've decided to layout your column, Technorati is terrible at parsing it. I can't get Technorati to parse a single post of mine from newsvine, though Killfile's layout (seeds on the side) seems to work with Technorati better.

And then there is the lack of pinging to let them know when you've updated...

I wish you could just feed Technorati your RSS feed, that would work so well!

{"commentId":509476,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 4 votes
#5.1 - Fri Feb 2, 2007 11:43 PM EST
{"commentId":509606,"authorDomain":"pwtenny"}

You misunderstand, this is not about Atom syndication feeds for reading, but using Atom as a publishing protocol for sending posts instead of receiving them. With this, you form a valid Atom document locally, then send it as an application/atom+xml content type. It's what most blogging systems are moving to as a common API for third-party posting.

I recently wrote a PERL script that can upload to Google's Blogger via Atom (on a schedule, so it can post automatically all during the day) and once you understand the spec, it's very sweet stuff. With all the versions of RSS out there, this would be a nightmare to support.

It's good stuff, and fyi, Atom is the only one of the two that is actually an IETF standard, and has better industry support. RSS has already been forked once and its legal origins of ownership are still questionable. It really needs to just go away.

{"commentId":509606,"threadId":"73191","contentId":"549821","authorDomain":"pwtenny"}
  • 3 votes
#5.2 - Sat Feb 3, 2007 2:18 AM EST
{"commentId":510151,"authorDomain":"onlineapps"}

Adam, I think part of the reason Technorati is bad at parsing our feeds is that NV uses the - seperator (e.g. ohio-state) for spaces, and Technorati uses the + seperator (e.g. ohio+state). Also, Technorati doesn't use commas, it uses just plain spaces. Could that be part of a reason?

Regarding pings, I say not just the Technorati ping. Let's let the users decide which sites to ping. Technorati isn't the only blogging site out there. Google Blog Search is catching up, plus there are smaller sites like blog-search.com and blogsearchengine.com. If NV decides on not letting the users choose, how about at least using something like Pingoat, Big in Japan's QwikiPing, or Ping-O-Matic, where it pings multiple blogging sites.

{"commentId":510151,"threadId":"73191","contentId":"549821","authorDomain":"onlineapps"}
  • 1 vote
#5.3 - Sat Feb 3, 2007 2:18 PM EST
{"commentId":510244,"authorDomain":"thevineofhob"}

Online Apps, thats not the reason. My blog uses the exact same tag convention as newsvine, and technorati can parse that quite well.

It has nothing to do with the tags anyway. Even the posts can't be parsed, depending on how you format your column. The format that Killfile uses, articles in the center, seeds on the right, can be parsed just fine, http://killfile.newsvine.com">example.

The format that I use, seeds and articles mixed in the center, Technorati just can't handle, http://thevineofhob.newsvine.com">example.

I also find it interesting that for whatever reason technorati displays how many links and blogs are aimed Killfile's way, but is unable to do so for my column, despite the fact that if you search for it directly [example], you find many a link and blog.

I think Technorati would be helped greatly at parsing the non-standard blog templates (wordpress, typebad, blogger, etc) if you could submit your RSS feed to it to parse rather than having it parse your sites HTML.

{"commentId":510244,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 2 votes
#5.4 - Sat Feb 3, 2007 3:12 PM EST
{"commentId":510474,"authorDomain":"pwtenny"}

Just fixing the broken links above..

http://killfile.newsvine.com">Killfile
http://thevineofhob.newsvine.com">Adam

It looks like you haven't pinged Technorati in over nine months, maybe you should give in a try now and see if it works better. http://pwtenny.newsvine.com">Mine seems to be parsing correctly now, though it didn't when I had seeds on the right side (now center mixed.) I wonder what the deal is.

{"commentId":510474,"threadId":"73191","contentId":"549821","authorDomain":"pwtenny"}
  • 1 vote
#5.5 - Sat Feb 3, 2007 6:07 PM EST
{"commentId":510479,"authorDomain":"pwtenny"}

Well so much for that idea, I guess it's a bug in Newsvine's parser. Go here and paste into the search box the following URL's to see what Adam is talking about.

http://pwtenny.newsvine.com
http://killfile.newsvine.com
http://thevineofhob.newsvine.com

{"commentId":510479,"threadId":"73191","contentId":"549821","authorDomain":"pwtenny"}
  • 1 vote
#5.6 - Sat Feb 3, 2007 6:12 PM EST
{"commentId":510512,"authorDomain":"thevineofhob"}

I pinged just a week or so ago. It won't parse my column at all.

Weird what happens to those links...

{"commentId":510512,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 2 votes
#5.7 - Sat Feb 3, 2007 6:32 PM EST
Reply
{"commentId":510167,"authorDomain":"onlineapps"}

Hear Hear Yes yes for the conversation tracker. The best, IMHO, would be to use RSS: that way, not only could a developer use it, but also regular, less technical people.

Another use for this API would be to create newsvine badges similar to ones available for both digg and Netscape that we could place directly on blogs or other content sites. Not only could we then use it to submit an item to newsvine, but when it is already submitted we could vote directly on that page, again without having to find the item on newsvine to vote for it.

I definitely think that's the best method. I've never actually seen the Netscape button, but the digg button I think is horrible for the simple reason: you have to manually enter in the URL of the dugg story. I like your idea of a dual-method, in which you can submit a story if it hasn't been already, or vote for it. One thing is, could we make it that if you click the Vote button, it doesn't open in the same window? How about using AJAX, and making it not leave the page at all (unlike digg's)?

Access to the Chat

I've got a better idea: Why not make Chat use a standard protocol, like IRC? That way, developers wouldn't have to call the client, they could also write one!

Anyway, great idea Adam!

{"commentId":510167,"threadId":"73191","contentId":"549821","authorDomain":"onlineapps"}
  • 1 vote
Reply#6 - Sat Feb 3, 2007 2:28 PM EST
{"commentId":510258,"authorDomain":"thevineofhob"}

I don't think we could convey the exact information that is needed to properly implement an external conversation tracker via RSS. The Doc Type is too limiting.

The netscape button is nice because it only requires your posts url, then it submits that to the Netscape API and gets back all the relevant info for that URL if it was already submitted. If not, then it just lets you submit it. You don't actually need the Netscape submission URL like the digg button does.

One thing is, could we make it that if you click the Vote button, it doesn't open in the same window? How about using AJAX, and making it not leave the page at all (unlike digg's)?

I've never really used the Digg button, so I'm not sure what you mean here.

Regarding the Chat, there have been efforts in the past that looked to access the chat feature from external sources. It seems to have worked quite well, but the lack of interest in char kinda killed the project.

{"commentId":510258,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 2 votes
#6.1 - Sat Feb 3, 2007 3:23 PM EST
Reply
{"commentId":510374,"authorDomain":"acoolie"}

The Conversation Tracker source can be found at http://www.newsvine.com/_wine/user/commentTracker, so it would not be very hard to interpret that into an XML file, since it includes all of the links for home, comments, and friends (it does not have the number of links, but that can be obtained rather easily.

On votes and external commenting, they both direct traffic away from Newsvine, discourage conversation, which are basically the two basises of Newsvine. I don't really understand the vote one entirely either. If you seed a link has already submitted, doesn't the window give you a link to the seed? Can't you just click on the link and vote from there.

Newsvine should not become a full-featured browsing experience. A browser or an application are just too big for Newsvine to expect users to adopt.

For example, something like Gmail Notifier would be great for bringing Newsvine to the desktop, but all it would do would display links to seeds and articles, nothing else.

Also, many Newsviners do not use Flock or Firefox, so if any sort of extension were to be made, the Newsvine website itself should not change at all, so users who don't use these extensions would not be limited.

{"commentId":510374,"threadId":"73191","contentId":"549821","authorDomain":"acoolie"}
  • 2 votes
Reply#7 - Sat Feb 3, 2007 4:55 PM EST
{"commentId":511995,"authorDomain":"aine"}

Adam, you and I seldom agree on anything (in Politics, that is), but here I have to say "Well done!" because these are all excellent ideas which I would truly love to see come to fruition (gratuitous use of the Vine metaphor, penalty, one shot of Jameson's).

One additional idea, which I have privately posed to Calvin is the ability to send a single post per day to my Wordpress blog with a summary linked list (like what appears in our columns) of all the seeds or articles I've submitted in the past 24 hours, using the xmlrpc protocol. Del.icio.us currently allows me to do this with my tagged links, into a single category of my blog (which I am using as a side-blog). I want to do this with Newsvine as well, as it would help to get the word out about Newsvine, as well as allowing me a sort of archive in my own blog which I can search and refer back to.

{"commentId":511995,"threadId":"73191","contentId":"549821","authorDomain":"aine"}
  • 2 votes
Reply#8 - Sun Feb 4, 2007 5:49 PM EST
{"commentId":512012,"authorDomain":"thevineofhob"}

Interesting idea.

I've been attempting to integrate newsvine with my wordpress blog more as well. So far I've just been taking advantage of the RSS feeds and displaying my recent articles and seeds on my blog's front page (currently being revised, so don't mind if an image or five are missing) as well as a fake "archive" page. It's not perfect, but at least I can link my newsvine contributions to my blog.

After I sort out a few other things, I was going to turn them into wordpress plugins. Maybe I'll try that tonight if I have the time. If not, sometime this week.

{"commentId":512012,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 2 votes
#8.1 - Sun Feb 4, 2007 6:04 PM EST
{"commentId":512025,"authorDomain":"aine"}

If you do some wordpress plugins, let me know somehow (this thread is now in my tracker, but feel free to send me a note via my column or whatever).

{"commentId":512025,"threadId":"73191","contentId":"549821","authorDomain":"aine"}
  • 1 vote
#8.2 - Sun Feb 4, 2007 6:19 PM EST
{"commentId":512027,"authorDomain":"darkside"}

Ahhh! Look, everyone, he's linking to his own blog! BURN HIM!!

{"commentId":512027,"threadId":"73191","contentId":"549821","authorDomain":"darkside"}
  • 2 votes
#8.3 - Sun Feb 4, 2007 6:22 PM EST
{"commentId":512035,"authorDomain":"aine"}

PS : Interesting, and I'm intrigued by the "fake" archive. Not sure how you did that. *grin* I'm currently using my NV RSS feeds on my blog, as well, but it only gives me the linked titles, not a summary. You can see what I've done with the del.icio.us posts in my sidebar there, and they used to appear as a normal post mixed in with all my other posts on the main blog page, but I installed the Side Blog plugin and used that category to fill it with content.

{"commentId":512035,"threadId":"73191","contentId":"549821","authorDomain":"aine"}
  • 1 vote
#8.4 - Sun Feb 4, 2007 6:33 PM EST
{"commentId":514177,"authorDomain":"lance"}

fyi ... development on a newsvine wp plugin is underway

{"commentId":514177,"threadId":"73191","contentId":"549821","authorDomain":"lance"}
  • 2 votes
#8.5 - Mon Feb 5, 2007 9:04 PM EST
{"commentId":514203,"authorDomain":"thevineofhob"}

What's it gonna do? I'm working on a few now and I'll quit working on one if it's basically the same that you guys are working on.

{"commentId":514203,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 2 votes
#8.6 - Mon Feb 5, 2007 9:19 PM EST
{"commentId":514219,"authorDomain":"lance"}

primarily, it's going to allow for simple cross-posting of articles on newsvine

{"commentId":514219,"threadId":"73191","contentId":"549821","authorDomain":"lance"}
  • 2 votes
#8.7 - Mon Feb 5, 2007 9:32 PM EST
{"commentId":514275,"authorDomain":"aine"}

Excellent!! Let me know, I'll be a guinea pig beta tester. :)))

{"commentId":514275,"threadId":"73191","contentId":"549821","authorDomain":"aine"}
  • 1 vote
#8.8 - Mon Feb 5, 2007 10:14 PM EST
{"commentId":514360,"authorDomain":"thevineofhob"}

Amazing! Certainly nowhere close to anything that I am working with. Great idea, and a feature that I can't wait to take advantage of. If you do need any guinea pig beta testers, look my way as well ;-)

{"commentId":514360,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 2 votes
#8.9 - Mon Feb 5, 2007 11:15 PM EST
Reply
{"commentId":512022,"authorDomain":"Henryvii"}

Any way this would work with Camino as well?

{"commentId":512022,"threadId":"73191","contentId":"549821","authorDomain":"Henryvii"}
  • 1 vote
Reply#9 - Sun Feb 4, 2007 6:15 PM EST
{"commentId":512031,"authorDomain":"thevineofhob"}

Camino is not built on the XUL framework of Firefox and Flock, writing extensions for it is far harder.

{"commentId":512031,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 2 votes
#9.1 - Sun Feb 4, 2007 6:27 PM EST
Reply
{"commentId":1106972,"authorDomain":"onlineapps"}

Any update from the Newsvine staff on this or the WP plugin?

{"commentId":1106972,"threadId":"73191","contentId":"549821","authorDomain":"onlineapps"}
  • 1 vote
Reply#10 - Wed Oct 17, 2007 2:17 PM EDT
{"commentId":1107383,"authorDomain":"thevineofhob"}

Not at all. But give them time. They'll get more resources soon, so maybe the API could come in the future.

{"commentId":1107383,"threadId":"73191","contentId":"549821","authorDomain":"thevineofhob"}
  • 1 vote
#10.1 - Wed Oct 17, 2007 4:40 PM EDT
Reply
{"commentId":1106993,"authorDomain":"SVForbes"}

With this access, we could be notified of new comments where ever we happen to be browsing

Excellent suggestion.

Informative article.

{"commentId":1106993,"threadId":"73191","contentId":"549821","authorDomain":"SVForbes"}
  • 2 votes
Reply#11 - Wed Oct 17, 2007 2:26 PM EDT
{"canLink":false,"threadId":"73191","isPrivate":false}
Leave a Comment:
You're in Easy Mode. If you prefer, you can use XHTML Mode instead.
As a new user, you may notice a few temporary content restrictions. Click here for more info.
{"threadId":"73191","contentId":"549821"}
Start TrackingStart Tracking
Stop TrackingStop Tracking