BBC Click Radio Recording As-Live at the OU

In case you’re around the OU campus in Milton Keynes on Monday 18th July, we’re recording the final episode in our season of special episodes on openness with Gareth Mitchell and the BBC Click Radio team.

If you’d like to attend, the recording will take place in the Berrill Lecture Theatre from 1pm to 1.30. Please be seated by 12.45 for the sound check;-)

Who Can See Whose Conversations In-stream on Twitter?

A week or so ago, I posted a quick hack using the Google Social graph API showing how to generate a list Common Friends or Followers on Twitter, so that you could look up which folk would see, in their Twitter timeline, a conversation between two other people on Twitter. (A hosted version of the service is now available here.)

At the time I also generalised the code so that you could look up the extent to which any party could see the conversations between two other parties on twitter, in stream. This is another single page web app and it can be found hre: Twitter in-stream eavesdrop.

It looks like this:

Very simple, very quick… there is nothing more to it than what you find if you View Source… (In fact, there’s more than you need if you View Source – there is also a Google Analytics tracking code in there…)

Virtual Revolution: Google Economics

Th third episode of the OU/BBC co-produced Virtual Revolution (which may well be available on iPlayer from time to time) has just aired, and included a quick overview of how Google works – from finding relevant search results, to pricing the adverts that make Google its money.

So here’s a quick recap, and a little more detail…

Firstly, the famous PageRank mechanism that drives Google’s search results ranking. Here’s how Terry Winograd, one of the interviewees on the Virtual Revolution programme, describes it:

Vodpod videos no longer available.

(Michael Nielsen has written an even more comprehensive tutorial on how this works at Lectures on the Google Technology Stack 1: Introduction to PageRank. If you want to read the original PageRank paper, you can find it here: The Anatomy of a Large-Scale Hypertextual Web Search Engine.)

Next up, Google’s chief economist, Hal Varian, explains how the advert auction that powers Google’s AdSense service works:

(If you buy Google AdSense adverts, you might also be interested in how to price your bids effectively…)

For a full length lecture by Hal Varian on “The Economics of Internet Search”, check out the following hour long video:

[To learn more about effective searching on the web, see the OU course Beyond Google: working with information online, or check out this free tutorial from the Open University Library: Safari: Skills in Accessing, Finding and Reviewing Information.]

Okay – So I Need Something New to Read. Any Suggestions?

I tweeted”randomly buying books on amazon, and it’s not making me happy… anyone got any good holiday book recommendations?” and among the replies @janetedavis suggested “Write us a quick blog on what books you’ve enjoyed & maybe we can suggest holiday books you might enjoy.”

So here it is: books I’ve enjoyed include most of what I’ve read (and I tend to ‘collect the set’ when I read an author I like) by:

– Jose Luis Borges
– Richard Brautigan;
– Terry Pratchett;
– John le Carre;
– Herman Hesse;
– William Gibson;
– Mark Manning and Bill Drummond…(?!);
– Michael Dobbs;
– Iain Banks.

That gives a flavour… (the list is far from being exhaustive, and is just off the top of my head… but I’m slow at typing and this was a quick post!)

I’ve also trawled through more than a few Harvard Business Books (new business models, management innovation, data driven business etc) and O’Reilly geeky techie books (analytics, visualisation, web 2 and mashup stuff – you can imagine…)

At the recent Festival at the Edge, a compelling story by Hugh Lupton made me realise I know nothing about the enclosure acts, so something non-fiction there would be interesting. I keep looking for books about the Luddites, but I’ve collected most things with “Luddite’ in the title or subtitle! (So I guess industrial revolution themes are in there… tales of early factories and workhouses could be interesting, and the growth of the canals… Stuff that brings to mind the dark satanic hills and mills of my upbringing in West Yorkshire ;-)

I’m definitely on the lookout for a simple intro to architecture, and keep having a scout around (so far unsuccessfully) for something to read about consumer psychology and the design and layout of supermarkets (architecture again, I guess?)

Maybe I should run this post through a term extractor and then see what Amazon recommends as a result?! ;-)

Guardian DataStore Visualisation Competition

A post over on the Guardian DataStore site last week announced a competition based around visualising data from the Guardian DataStore: Build stuff with our data and win a Flip Mino HD camcorder.

There are two categories for submissions:

1) The best user experience for understanding meaning in data, and
2) The best tool for web developers to build other things with data

I’ve posted quite a few recipes so far that describe different ways of engaging with the data, many of which you can find from posts categorised here with visualisation, so it’d be great to see people trying to run with them.

Many of the recipes I’ve come up with start by getting data out of the spreadsheets as CSV, so that it can then be passed to other services, such as Many Eyes Wikified or Yahoo Pipes; or JSON, so that it can be pulled in to a web page. (My very work in progress Guardian Datastore explorer can be used to generate URIs that run queries on Google spreadsheets, which may be of some use if you want to get started on running SQL like queries on spreadsheet data.)

As far as I know, know one has explored using tools like the JavaScript InfoVis Toolkit yet, which could be interesting from the point of view nice UIs, as well as the developer perspective (e.g. a nice set of hooks in to the DataStore from visualisation toolkits or code frameworks). And then of course there are plenty of other more traditional chart toolkits out there…

If you’re after something a little more exotic, how about something like Thematic Mapping, HeatMap API or CloudMade on the geoviz front, though the problem of geocoding DataStore data would have to be solved first (Yahoo Placemaker might be handy there?); the Timetric or the MIT Simile Timeplot or Timeline tools for displaying information against a time axis (none of which have, to date, and as far as I know, been combined with a Fourier Analysis tools to help identify periodicities in the charted data); or how about finding a use for TimeMap, which combines MIT Simile Timeline widgets with Google maps..?

For truly open ended visualisations, using something like Processing may be the way to go: there’s already a Processing wrapper for the OpenPlatform API, but I’m not sure if anyone has provided an easy way (as yet) to pull DataStore content into it. Integration with Processing.js, a Javascript implementation of Processing that makes things like Obsessing possible, is also something that could open up a lot of opportunities for making use of the data?

On the other hand, if it’s analysis you’re after, it might be interesting to see what could be done if the DataStore spreadsheets could be integrated with various stats analysis packages (is there a variant of R as a st of Javascript libraries, I wonder?!)

PS Just for the record, I’m not eligible to enter the competition just at the moment…