Recently the multi-talented IRISS programmer, Ben Lyons tool part in the BBC’s scraperwiki hacks and hackers day. The event focussed on getting hacks (journalists) and hackers (programmers) to work together on developing a tool which would bridge the two worlds. Ben and programmer Paul Miller formed a team with theBBC journalist Chris Sleight who reports on the central scotland area (http://www.youtube.com/watch?v=TeH6Ca77coY).
Chris had an interest in obtaining data from the central scotland fire and rescue service(http://www.centralscotlandfire.gov.uk/news/latest-incidents/recorded-incidents.html), which the team agreed to focus on. While this site was useful to Chris, there was also no easy way for him to obtain updates when there is an fire incident, nor a way to use the data in any really meaningful way.
After some intial digging the team found a way to use scraperwiki to scrape limited data from the site (at circa 60 records at a time), and also discovered another 14,460 historical records, which allow them to start building several outputs.
Within one day the team managed to build a dynamic protoviz visualisation from within scraperwiki (http://scraperwikiviews.com/run/firebug_simple_viz_2/), as well as extract some very useful statistics (the one they chose to work with on the day was the percentage of malicious calls per area). They also did some initial work on creating geo-mapping views, which is one of IRISS’s focus for its data visualisation team this year.
For the team’s impressive efforts they were awarded second place on the day, and also won the scraperwiki “best scraper” award.
As a follow up, Paul Miller spent some time the following week finalising some additional features, including notifications on twitter @FireCentralScot and an interactive googlemap (http://central-scotland-fire-reports.paulmiller.it/fire/map/custom ).
You can watch Ben speaking about this great event on youtube: http://www.youtube.com/watch?v=3RQ1f6vUMoM
Well done, Ben!