Categories
Policy Web metrics

Australian internet usage trends and statistics

Knowing your audience is critical yet being outside of North America often means that we end up justifying projects, strategies, methodologies on general audience data drawn from another continent.

The CCI at QUT has just published the latest ‘Digital Futures Report – the Internet in Australia‘ which is a very comprehensive look at how Australian internet users connect, what they look at, and how they behave online. With the continuing digital divide, and amongst users a usage divide, there are obvious implications for those of us whose mandates is either national or state-wide compared to city or community museums.

Read the full 65 page PDF.

Categories
Folksonomies Geotagging & mapping Imaging open content Web metrics

Commons on Flickr – a report, some concepts and a FAQ – the first 3 months from the Powerhouse Museum

The first three months of having images from the Tyrrell Photographic Collection in the Commons on Flickr have been very interesting. We launched on April 8 with 200 images and have been adding more each week since.

At the 12 week mark we had 600 photos uploaded, mostly location photography with just under 50% geocoded. Whilst we promised at the outset to upload 50 a week we had to break that promise around week 5. As we began to see which images were being viewed more than others or attracted more comments than others we started to look for similar images in the Tyrrell Collection – many of which had not yet been digitised and catalogued. This extra digitisation and cataloguing reduced the uploads of some weeks to just 25 new images. On the upside, though, this also means we have a large number of already digitised images held back for weeks when key staff are going to be on leave.

Splash! Playable collections

In the first 4 weeks of the Commons we had more views of the photos than the same photos in the entirety of last year on our own website. It wasn’t as if we made the images on our own website all that hard to find – they were well indexed on our own site by Google, they were made available to the national federated image search/repository Picture Australia, and they also existed in our OPAC. Still, that was no match for Flickr.

Flickr’s roots in MMOG ‘Game Never Ending‘ makes it the ideal place for cultural institutions to explore the notion of ‘playable collections’. The social norms and community behaviours that have emerged and are encouraged around image content in Flickr (as opposed to other photo sharing sites) enable historic photographic collections to become game entities. Albeit with a slightly different rule set.

In the Commons images lose the boundaries placed on them by collecting institutions. They take on new contexts and meanings, and they become maleable. All images in Flickr take on these more fluid characteristics, but in the Commons they way others see, respond and interact with these images is slightly different.

In fact I think it is really important to point out the difference in observed behaviours between our photos in our standard Flickr account. I’m not sure how the other institutions who are contributing to the Commons are finding it, but we’ve noticed that there seems to be a difference in behaviour and social norms in tagging and commenting on our Commons images versus our other images. Presumably the obvious ‘historic’ nature of the images combined with the fact that the institutions aren’t the photographers has an effect on this.

The global reach of Flickr and its active international user base (although far from evenly distributed proportional to online population) is impressive. Although our collection is very much focussed around Sydney and NSW, we’ve still managed to attract some tagging in other languages. Other Commons contributors have far more international images and should be drawing more internationalised tags and comments.

What are people doing?

The Commons has several obvious types of engagement from the point of view of a contributor. I hesitate to put these into ‘levels’ because almost everyone does each of them. The first seven, at least, are integral to the ‘game play’ of Flickr and should be judged against the rule set of the game system itself, rather than necessarily against outside behaviours.

Visitors can engage in –

1. Viewing

Viewing comes in many forms and can be counted when those views occur on Flickr. This is the simplest but also least useful way of measuring the project. What is useful about view data, however, is the ability to track the trends and patterns in viewing and observing when and deducing why certain images generate more views at a particular time.

2. Favouriting (“bookmarking”)

“Favoriting” (US spelling) on Flickr is the equivalent of bookmarking. Flickr users ‘favourite’ for many reasons and this is another very simple measure of the relative popularity of an image. It is important to understand that whilst an image may be ‘favourited’ by many different users the reasons for their ‘favoriting’ are not revealed. Again, it is through observing bursts of favouriting of the same object by multiple users, or the favouriting of many objects by the same user that potentially reveals more.

3. Friending (“I am interested in seeing more/connect with me”)

Friending on Flickr identifies a desired but not necessarily reciprocal relationship between the ‘friender’ and the ‘friendee’. The Powerhouse decided after a few weeks to reciprocate all friend requests and we also look at the photos taken by our ‘friends’ and where appropriate tag, comment, and ‘favorite’ their images too. This social reciprocity is really important but also time consuming.

At 12 weeks we had hit 612 ‘friends’. Each of these friends now gets visual notification of new images we upload.

4. Social commenting (“here I am”)

I’m calling the comments that say ‘awesome photo’ or ‘cool picture’ as social commenting. This is a really loose way of describing comments that are really about leaving a linkback-ed mark of a visit. Akin to an “I woz ere” but in a more networked way.

On Flickr this social commenting acts as the ‘social glue’ that binds the communities that play the ‘Flickr game’, together. Whilst it is very tempting for museum professionals to downplay or scoff at this sort of interaction, it might be useful to think of these sort of comments as playing a role akin to comfortable seating or a nice cafe in a museum gallery.

5. Tagging (“let me help”)

Because the Commons specifically asked the Flickr community to ‘help tag’ images the tagging that is done within the Commons tends to generate some pretty useful additional metadata. Whilst the account holder can see who the tagger was, the rest of Flickr cannot. Tagging here is a great example of altruistic behaviour as the tagger is neither the image creator or owner.

6. Image content tagging (“here’s something interesting”)

Flickr also allows the notation of an image with the ‘add note’ function. We’ve noticed that some users are helpfully identifying particular buildings, landmarks, signage, flags and other important elements within an image with these tools. This creates a certain kind of additional metadata that isn’t about the object/image as a whole, but about a certain subset of the content.

7. Content commenting (“let me tell you more about this”)

Here’s where the value of the Commons is easiest to explain to other cultural sector professionals. This is old-fashioned community engagement and we’ve been really lucky to have engaged a number of prolific and dedicated members of the Flickr community who have taken up the challenge of identifying the exact dates, locations and other unknown details about the images we’ve uploaded.

Whilst some of the information we are learning about the images this way could probably have been discovered by the Museum itself, that the public has been able to do this for us and often within hours of new images going up on to the site speaks volumes.

This is also very much about empowering and acknowledging the importance of ‘amateur’ knowledge, which in the networked environment can often outpace, and sometimes outperform, isolated ‘professional’ knowledge.

8. Content embedding (“I’ve stuck this on my site/blog/profile”)
9. Content remixing and connecting (“here’s my images that fit with yours”)

Although harder to track, the other obvious purpose of the Commons is to encourage re-use. Re-use of heritage materials radically asserts their relevance in contemporary society and is an increasingly necessary bridge between the world of ‘museums as holders of old stuff’ and the world of ‘museums as places for inspiration (and connection)’.

All of this is ‘user generated context’ (cf. Haque) as much as it is ‘user generated content’. Context is increasingly what matters in a world overloaded with content, and museums through the exhibition medium should be specialists in understanding the importance of ‘context’.

And of course, our Tyrrell Today group has already gathered 123 images that are contemporary location photography matching the historic photography of the Tyrrells. This shows a huge amount of commitment from others in the Flickr community – to go out and purposely reshoot a Tyrrell from today’s perspective and we’re thrilled to have generated this much interest. We hope we can reciprocate.

Here’s an example.

(contemporary image by lifeasdaddy)

Some basic quantitative stats at 12 weeks

So with all that in mind, here’s some raw figures to consider.

How many?

600 photos uploaded (at 12 weeks)
103,000 views of photos

How are they being found?

69% via Flickr
2% via external search
6% via other websites (blogs etc)
21% direct to URL

Most popular:

Woman inside a settler’s hut (2nd most favourites) – 1735
Wool sorting room, Clifton Station – 1334
Cutting Out – 1011
Bondi Bay, Sydney (3rd most favourites) – 967
Circular Quay 1892 – 945

Perhaps not surprisingly for a global audience the top three images are those without geographic specificity and thus more general global appeal.

Most favourited:

Kookaburras – 29
Woman inside a settler’s hut – 19
Bondi Bay, Sydney – 15
Frank Senior, sculler – 13
The start of girls’ snowshoe race, Kiandra – 11

How many tags?

2433 tags (excluding machine tags)
Average tags per image – 4.055, median 2, standard deviation 4.93 (a fair number of objects have no tags, mostly the newest)

Most tagged:

George St, near Hunter St – 26
A farm homestead – 24
Choir, St Andrew’s Cathedral, looking east – 23
Sydney from Shell Cove, North Shore – 22
Woman inside a settler’s hut – 21

Some answers to some other frequently asked questions

1. What has been the impact on image sales?

It is early days and too early to tell whether or not we’ve ‘lost’ sales as a result of putting these images in Flickr. Interestingly we are getting a lot more online enquiries about purchasing these images and the offline (telephone, fax, etc) haven’t noticeably declined. It is too early to tell but I think once the other benefits of being in the Commons are brought into the equation we will have massively gained.

2. What happens when other institutions add their images? Do your images get ‘lost’ in the flood of new content?

Actually we’ve found that in this situation more is more. When new institutions add their images we see new peaks appear in our stats. This is because with each new addition comes a slew of blog posts across the blogosphere. The addition of the George Eastman House recently and the Bibliotheque de Toulouse both generated new types of media coverage of the Commons as a whole.

Also as the Commons evolves new features are added by the Flickr team so with the George Eastman House came cross-Commons ‘search‘ which will become even more useful as more complimentary collections are added – which in the case of the Powerhouse probably means more Australian collections.

3. What is your favourite story about the power of the Commons?

See my earlier post on the ‘discovery’ of the Mosman Falls.

4. Aren’t you worried about releasing these images as de facto ‘public domain’? Don’t you want attribution and credit for collecting, preserving and making these available?

We’ve noticed that our images are now spreading to the Wikimedia Commons, and are also being used in blog posts and various websites. And, although we haven’t specifically encouraged remixing – primarily because of the nature of the content of most of the images – there have been some Flickr users who have notified us of the intent to create screenprints and other derivatives of some images.

Now, because these images have been identified as ‘no known copyright’ there is no legal need to attribute the source of these images but every single re-use or embed of our images to date has featured an attribution. This is another testament to the nature of the Flickr community. Now that some of these images are also in the Wikimedia Commons it will be interesting to see whether the same courtesy attribution occurs.

5. I work in a museum/library/archive and we already have a Flickr account. As a matter of fact, we’ve had one for ages. Why is the Commons so different?

The two obvious differences are the banding together of collections under the promotional umbrella of ‘The Commons’; and the application of ‘no known Copyright’ to the images. The increasing prominence of the Commons within the Flickr ecosystem brings Commons images to many more people than a regular Flickr account. Together this creates an interesting effect – comparatively more interest in the images and more engagement around them. I wonder whether this is the effect of providing a clearing in the surrounding data smog where the intention of putting up historical images is very clear and contextualised (rather than obscured)?

6. What is the big deal about ‘no known Copyright’?

I guess the answer is both philosophical and practical. Philosophically it makes sense for publicly-owned heritage images to be made available to the public in a digital form to reuse and repurpose except where there are cultural sensitivities involved. This may not apply to institutions that aren’t publicly funded of course.

On a practical level it makes sense because asserting Copyright (or even Creative Commons) over something that clearly wasn’t made by you is full of legal complexities. Not only that, it complicates matters for learners of all ages who legitimately want to see and use these images – if only they knew they existed.

7. What are you doing with all the tags and comments?

Tags are easy and we’re treating them just like our other community generated metadata. Now we’ve passed the 3 month mark we’ve pulled all the tags to date back into our own collection database online where they will soon appear alongside the tags that have been on our own site.

Comments are a little more tricky and we’re working out ways that we can dedicate resources to going through these and updating the collection records properly. There are several factors that make this less than trivial – paradoxically many of the images with the most ‘documentation’-style comments are also the ones that have not been fully catalogued by our own curatorial staff. I expect that we will have resolved a proper process for the ingestion (and crediting) of information supplied via Flickr comments in the next six months.

8. How do you manage the community that is forming around your content on Flickr? What is the time commitment?

As I mentioned right at the top of this report we are still coming to terms with this. Our Image Services Manager, Paula Bray, does the bulk of the responding, commenting, favouriting and interacting. She is an avid photographer too and had her own Flickr account prior to joining the Museum and well before this project. She spends at least an hour a day in Flickr – yes, even weekends – and that’s not counting the time she spends selecting and preparing the content for bulk upload.

I drop in and out of our account to check what is going on each day also spending about 20-30 minutes a day making sure things are as they should be.

This need for ‘continuous participation’ is a challenge but it is reaping enormous rewards. However within an institution of our size and structure both Paula and I are spending considerable time ensuring we have a strong case for the resourcing of this ongoing participation which is part of the reason why we’re testing different metrics and documenting outcomes as we go.

9. How do you upload the images to Flickr? (and pull down those tags and comments)

We use the very well documented Flickr API to both upload and download. It took about 5 programming hours at most to build our uploader and also a downloader in PHP. After the images are uploaded from our collection database we have to go in and add them to the correct groups, geotag what we can, and then change their permissions so everyone can see them. Easy.

Need to know more? I will continue to post reports periodically. Courtney Johnston at the National Library of New Zealand (kia ora!) has posted a similar report on what they’ve learnt from the first year of having a ‘standard’ Flickr account. And, Bridget McKenzie in the UK has produced a good discussion paper arguing the pros and cons of having a Flickr presence for your institution.

Categories
Web metrics

Google Trends does basic comparative metrics

Google Trends has started to allow domain level searches. This means that you can now pull up rough traffic figures, as calculated by Google, on any top level domain (subdomains like play.powerhousemuseum.com or artgallery.nsw.gov.au won’t work), and compare them to others. This moves Google Trends into territory covered by services like Compete, Quantcast (both US-centric) and, to a lesser extent, Hitwise.

Categories
Collection databases Search Web metrics

OPAC2.0 – Examining Delta Goodrem’s dress again / more on search

The most popular object in our online collection database is still a dress worn by Delta Goodrem.

I’ve previously written about how the popularity of this dress was driven in part by coverage on a number of Delta Goodrem fan forums. But this neglects the criticality of search. Google has always driven traffic to this object and looking at last months analytics where Google search represented 86% of referrers to the object, the top 5 keywords used to discover this dress were these –

1. lisa ho – 11.24%
2. evening dresses – 4.55%
3. lisa ho dresses – 2.71%
4. formal dress – 2.13%
5. chiffon dress – 1.07%

Because of the frequency of the keywords ‘lisa ho’ in the title, description and body text of the object record, and the trusted PageRank of the Powerhouse Museum domain, we rank 11th in Google search results for ‘lisa ho’; 2nd for ‘lisa ho dress’; and 4th for ‘lisa ho dresses’.

Fortunately for us, this external traffic isn’t fleeting. Visitors to this object view almost double the average number of pages viewed by others on our site; and they spend more time on the site too.

Looking at the internal search terms for that same object the results are very different.

1. Australian fashion (also a subject classification)
2. tennis (user tag)
3. lisa ho
4. delta goodrem
5. elegant (user tag)

External search has effectively driven nearly 10 times the traffic of internal users to this object. It has also brought audiences to the object who have very little behavioural similarities to those who search within the context of our own site (internal search). This creates many new challenges in terms of usability and user experience.

Over the entire collection there are pockets of objects for which the difference between internal and external search is not as great however this needs much greater data analysis (and may be the subject of a future post or paper).

Categories
Social networking Web metrics

Just how popular is that Facebook application? Artshare and Steve Art Tagger and Developer Analytics

I’ve been wondering for a long time about the real popularity of Facebook apps that are targetted at specific niche user groups.

Well with Developer Analytics you can find out – without needing to be the actual developer of the Facebook application in question.

With the museum community starting to build useful applications like the Brooklyn’s ArtShare or the Steve Art Tagger, the ability for us all to evaluate the success of these sort of projects is increasingly important. This is especially the case for cross-institutional projects to which we are all beginning to contribute our content. Are these projects reaching the audiences that we want our content to reach? Where should we focus our energies?

What can you learn from Developer Analytics?

For Artshare I can quickly see that as of today it has 2,900 install with 58 average daily users, as well as pull up a popularity graph to see this over time. (Update: Shelley at the Brooklyn says that these stats conflict with the ones she can pull up from within Facebook – see comments below) I can also compare it with the Steve Art Tagger which has been up for a few months and has 200 installs but only an average of 2 active daily users. Readers from the libraries world might be interested in taking a look at the statistics for the OCLC’s recently released WorldCat Facebook app.

I can also look at which commercial applications are most successful and track trends across, say, the multitude of Flickr-related applications to see which are the most sticky and used.

There are important lessons to be learnt from the other successful Facebook applications which we can draw upon when building our own.

Here’s a chart from the My Flickr application which, being an app with a large-ish userbase provides significantly more data about users – including the other apps that users of My Flickr use, gender, age and friend demographics. (A side note – the availability of this information to application developers in itself should be of interest to all Facebook users concerned with privacy).

Head over to Developer Analytics and do some digging of your own.

Categories
Collection databases Web metrics

OPAC2.0 – Top search phrases and statistics for 2007

Here’s some of the latest figures from our collection database for the calendar year 2007. Because our search tables run on a rolling 3 month basis we have had to wait until April to generate the results for 2007.

In 2007 there were 15,121,291 objects viewed in our collection database (including views on dHub and via Opensearch). 5,447 tags were added during this period.

Here’s some more interesting facts and figures.

Categories
Developer tools Web metrics

Google Teleportation / Google’s ‘search within search’

Google’s ‘search within search’ or as they call it ‘teleporting‘ has hit the Powerhouse Museum.

I’m not sure whether this is a compliment or not, but as the New York Times reports, this is a very interesting development which raises many issues for content-rich sites with vested interests in their own internal search.

As you can see in the screenshot below, a search for ‘powerhouse museum‘ now not only shows the main home page link, and the ‘selected’ 8 results (automatically picked by Google – probably a mix of popular pages and ‘relevant’ pages by title), it also shows a secondary search box.

Searching in this second box returns a site-specific search result, but still on Google, and depending upon the search term, filled with term-sensitive search advertising. Here’s an example of the effect of entering a term like ‘travel‘ into the secondary search box.

Worse still, try this one – ‘venue hire’.

It is going to be interesting to watch the effect of this on user behaviour. For Google it allows them to keep users on their search site for a longer period of time (and tempts them with advertising), and, if I look at this with a positive spin, it also hopefully delivers users to exactly what they want on our site by the time they get to it,

Either way though, this is another nail in the coffin of traditional web metrics and measurement. Where previously visitors wanting to find your organisation by a brand name search would start their visit to your site at the home page (after being delivered to there by Google), now they are more likely to exhibit similar behaviour to content-seekers, and start their visit deep in your site. This has significant implications for site design and navigation if users do actually start using the ‘search within search’.

Have any other museums found their site is now affected this way? (I notice that the Australian Broadcasting Corporation – ABC is another Australian site that is)

Categories
Interactive Media Interviews Web metrics

Museum transparency and the IMA Dashboard – an interview with Rob Stein

Last year the Indianapolis Museum of Art launched their Dashboard – a visual display of various data about the museum and its activities. Updated regularly the Dashboard gives open public access to much data that would usually be buried deep in an annual report.

The ‘transparency’ that the Dashboard offers is remarkable – it not only makes that information available on an ‘almost live’ basis, most importantly it makes it ‘accessible’. Everything from the number of new artworks on view and website visitors to new plantings in the gardens and budget performance, many statistics are available, and many more can be drilled down and explored in greater depth.

I’ve been very interested in the project and how it might have impacted organisational change at the IMA. I conducted an interview with Rob Stein, Chief Information Officer at the IMA, about the project.

Rob Stein explains the genesis of the project;

“Our CEO, Maxwell Anderson, has been interested in the role of transparency in museums for quite a long time. He has also spent a lot of time thinking about what kinds of metrics museums can use to measure their performance against mission based statistics (see his paper ‘Metrics for success in Art Museums‘). So, the decision to investigate what it might look like to create an institutional dashboard that could inform both the staff and the public was certainly initiated by Max, and reflects the museum’s commitment to operating as transparently and openly as possible.

Our goal was to create a site that could be accessed and understood easily and that would be of general interest at one level, but that could also eventually support a depth of investigation into how this museum measures up to our mission and strategic priorities. We don’t see that there’s any reason to keep these things secret, and in fact believe that making it easy for the public to see how we’re performing will offer a great incentive to the staff to understand why this is important.

The visual design of the Dashboard has been instrumental in making ‘sense’ of the data and opening up access.

Since statistics can sometimes been seen as boring and not interesting to the general public, we tried to keep the site as visually engaging as possible. We took quite a bit of inspiration from the dashboard screen of the Google Analytics tool as well as from Apple’s general design aesthetic. Google’s Analytics tool is great in that it offers bits of relevant information in one screen (the dashboard) that are easily digested, but also provides the ability for users to dig deeper into statistics that interest them. I think we were able to accomplish this effectively by incorporating “teaser” modes for each statistics on the Dashboard.

We also make pretty liberal use of an underlying set of taxonomies to help in organizing the information. Each statistic can be tagged, or categorized against a pretty simple taxonomic structure. This allows us to group statistics by department, or topic, or to say which statistics need to be grouped together for some reason (i.e. 2007 end of year reporting) The navigational tabs at the top of the screen are generated on the fly from these underlying taxonomies, so that whenever we add a new statistic, or topic to the dashboard they are immediately available.

Each node of the dashboard currently [also] provides its own RSS feed that users can subscribe to, In addition, users can also subscribe to any topic or departmental page as well. So, for instance if our finanace committee wants to always pull in new statistics related to IMA’s finances they could subscribe to the RSS for the Finance Topic.

Likewise there have been some sensible choices in the data made available to the public. Rob explains the focus on ‘interestingness’ in the choice of what to present;

We polled the staff and asked them to solicit information or statistics that they felt would be interesting, and particularly focused on those statistics that mirrored an activity or priority that supported the museum’s mission. We intentionally chose a small set of these statistics to start with, and probably placed a bit more emphasis on those statistics than changed relatively frequently. Now we’re in the process of going back and expanded on those sets of statistics and opening up the Dashboard to items that maybe don’t change very often, but are of general interest (i.e. the square footage of gallery space, the acreage of the museum’s grounds, etc…)

Dashboards rely on timeliness and there are many challenges in integrating back-end systems to deliver cross-organisational data. I asked Rob how important ‘live data’ was to the objectives of the project, and some of the implications that this has had internally to the museum.

This question illustrates a pretty important philosophical nuance that we’ve been talking about internally at the IMA. Currently, most of the statistics shown on the Dashboard are updated by staff members from many different departments at the museum. Our thinking in this is that the staff member responsible for tracking any particular statistic should, as part of their normal workflow be required to report that statistic to the dashboard. The reasoning here, is that we feel that when reports are automated, it is easy for staff members to become disconnected to the tracking of the information. We want the dashboard to be useful and interesting to the public, but also a tool for the museum to use in tracking its own progress across time. By asking staff members to take on the responsibility for reporting this information, we’re sure that they are aware of the trends in performance.

The flip side of this coin is that this does open the door to having statistics that could be fudged to make them look better than they really are. Also, if the responsible staff member is away from the office on vacation or a trip, the statistics they are responsible for may lag in their updates.

Our implementation of the Dashboard is definitely a work in progress. Since we created the software and web design in house, we’ve planned all along that we would feel our way through some of these difficult issues, and make changes to the sytem as we got feedback from our audience and the community on how dashboards should be operated. For example, in the next few weeks, we will be launching a set of new Dashboard nodes that will completely automate the reporting of attendance. We have systems in place in the museum that make this possible, and now understand and feel comfortable that these systems are reporting their numbers accurately. We’ll be moving from updating these numbers by hand on a weekly basis to live data being reported to the web every 5 min.

We’ve also been toying around with the idea of producing some kind of integration between the Dashboard software that we’ve built and Crystal Reports and the Flash integration that they support. We feel like this might give us a way to better integrate the Dashboard framework that we’ve built with a typical way that business systems support automated reporting. In doing this however, we’d still want to address the staff’s connection with the data and it’s reporting, and we haven’t quite figured that one out yet.

Might Dashboards ever ‘replace’ annual reports in terms of general public access?

I’m not sure that Dashboards should ever replace annual reports. I think annual reports are sometimes criticized in that they are hard to digest and tedious to produce, and of ultimately limited value in some settings. This may actually have more to do with poor execution than a critique of the annual report as a medium for communicating about the state of an organization. Dashboards, by their nature are designed to be good at communicating small bits of information in a somewhat random order. Navigation can facilitate themes or grouping of statistics, but Dashboards will have a hard time supporting much of a narrative regarding the performance of an institution. Annual reports or other long format texts can do a much better job of this, but will probably always struggle to interrelate large sets of seemingly disparate statistics. Given those two thoughts, it seems that dashboards and annual reports are probably pretty good compliments to each other, and we should probably leverage that relationship better than we do today!

With all this data now being publicly available there would be some exciting possibilities for cross-institutional data sharing and analysis. Rob explains some tentative future plans for the project;

We’d love to open source this product at some point in the future and hope that it would encourage other institutions to take the transparency of their operations to the next level. In order to make that really successful we’re in need of some good partner institutions that could look at the existing system with a critical eye and provide insight and resource in determining how the Dashboard could be more broadly applicable for many different kinds of institutions.

We take software quality pretty seriously here, and feel like there are some projects that treat open sourcing their software as almost a dumping ground for stuff they’re done with. We think that casts open source software in a bad light, and is not helpful in communicating that there are a lot of open source projects that are of extremely high quality and value. We’re not underselling what it would take to package the Dashboard in a way that’s easy to use and install, and to providing at least some amount of support to a future community of users.

Thanks to Rob for taking the time to answer my questions and being so open in his responses.

Try out the Dashboard.

Categories
Museum blogging Social networking Web 2.0 Web metrics

Applying a new social media framework from Forrester to the cultural sector

Josh Bernoff at Forrester has put together another good chart of how corporations might use social media to support five key functions – research, marketing, sales, support and development. He neatly ties together function, objective, the appropriate choice of social media application, and then a success metric for each.

Whilst the cultural sector may not have the same ‘sales’ and ‘support’ needs, there are clear parallels if we begin to look at the objectives column.


(source: Groundswell at Forrester)

Let’s break it down.

Listening

Audience evaluation practices in light of visitor generated social media are clearly undergoing change and there are enormous new opportunities for insights. As Josh indicates, good metrics of success for ‘listening’ are the value and depth of insights, and the comparable cost of focus groups and surveys. In light of Lynda Kelly’s work in this area I’d say that social media offers many exciting new ways to not only undertake audience research but also to present it. Her work with ‘visitor stories’ is particularly exciting.

Talking

Most museum marketing teams, sometimes assisted by the web team, are now ‘talking’ to audiences in new ways and starting conversations. Officially sanctioned museum blogs are now far more common and many museums both small and large are talking to audiences on Flickr and YouTube as well as Facebook and MySpace. Where the cultural sector lags is in having well developed measures of ‘buzz’ and awareness – and few are tracking through the door visits that are a result of these activities. Offering downloadable tracked discount passes through these media are an easy way of starting to track ‘conversions’ and ‘sales’.

Energising

Museum membership departments are starting to look at social media as a way of creating and strengthening the member community but these are still early days. The real ‘energising’ in the sector lies in the deep engagement in social media of niche communities of visitors – Flickr pools, YouTube groups, MySpace friends. Probably the best examples of ‘energising’ in the cultural sector lie around the well developed MySpace presence of MOCA and the Flickr pools and groups run by the Brooklyn Museum. Here there are some very ‘engaged’ visitors who act as brand ambassadors for the organisation.

Supporting

This is perhaps the most difficult objective for museums to engage with. It relies on building a strong community around your content – most probably your collection – and then letting go. In workshops and presentations the inevitable question comes up here around ‘authority’ and ‘reputation’. What if the community knows ‘more’ about part of your collection than your museum does? In the corporate/commercial world some of the most significant successes from social media have been in reducing customer support – and having the customers answer each other. Look at any support forum for any product and you will see, if it is working well, that most of the responses and suggestions are from other users. Now, could a museum provide a platform for community members to answer the questions of others about objects in the collection?

Here at the Powerhouse we are struggling with the increased volume of public enquiries since we launched our social media-infused collection database. Requests for information have tripled and now the sort of questions we are asked are more detailed and require significantly more curatorial research time than previously. At the same time we are receiving valuable new information and corrections to our collection documentation at a rate of nearly 2 a day.

Would it be possible to provide a platform for, say, the numismatics experts to answer the questions of other collectors directly, through our site, and reduce the ‘support calls’ needing to be answered by curatorial research staff?

Embracing

Already many are starting to harness the insights they are gaining from their visitors. At the Brooklyn they are going as far as having a ‘crowd-curated’ exhibition soon called Click!. and back here at the Powerhouse we have been using a lot of the insights of the users of the collection database to inform our classification and documentation practices. I also know that over at the Australia Museum Lynda Kelly’s innovative collaborative evaluation work with visitors, especially teens, is transforming the content of future exhibitions.

Categories
Museum blogging Social networking Web metrics

Better museum blog metrics – is your blog really working for you and your organisation?

Musuem blogs, even when they are one-directional (and have comments turned off), need to be measured differently. Jim Spadaccini and I wrote about this earlier in the year, but now with many many more museums blogging it is time for an update.

At the Powerhouse we’ve seen phenomenal growth in our blogs. This very blog, Fresh & New is one of the most popular parts of the Museum’s website (and it isn’t even linked from anywhere else on the site!), and the Sydney Observatory’s blog continues to grow well beyond the traffic figures of the pre-blog Sydney Observatory. (Our other blogs rise and fall much in line with the frequency of postings.)

But raw traffic growth is not a good measure. (And that’s not just because traffic figures are pretty rubbery these days).

In our paper Jim and I avoided site traffic and instead proposed that two better measures of success for museum blogs were citations/linkbacks and user comments. These captured the ‘interactivity’, the multidirectional communication, that most museums set up blogs to encourage and explore.

Web analytics guru, Avinash Kaushik has proposed 6 ways of measuring a blog’s success. He breaks it down to –

(summarised)
1) Raw Author Contribution – number of posts, length of posts, consistency of posts
2) Holistic Audience Growth – site traffic trends and RSS/feed trends
3) Conversation Rate – trend of comments per post
4) “Citations” / “Ripple Index” – linkbacks, how others discuss your content
5) Cost – total cost of running and posting to your blog
6) Benefit / ROI – including unmeasurable benefits

Kaushilk’s model fits the museum world particularly well because unlike many other business-style blogs, we are primarily about rich, detailed content – and we are using blogs to better, more widely, and more accessibly disseminate such content. To this end, his measure of Raw Author Contributions works well – and provides a metric to encourage continuity and consistency – something everyone struggles with.

Likewise, “citations” are easily explained to curatorial and research staff who operate in the academic world. Jim and I covered Conversion Rate and Citations in detail in our paper but if you already run a museum blog you may not have realised that Technorati has started expiring citations after 6 months. This can rapidly change your ‘authority’ rating if an old post has received a lot of linkbacks but your more recent work has been less widely discussed. As Kaushik writes, “I like this aggressiveness. Its a incentive to stay on your toes”. This again encourages consistency.

We are also, through our public programme and education areas, generally good at encouraging visitor interactions. Whilst this may not always transfer through to our websites, there are plenty of existing skills in our organisations in other sections and departments.

We are about to launch a new public facing blog for our Image Services unit which handles image sales and licensing as well as operating our amazing Photography Department who produce some fabulous, but rarely seen, images. In coming up with some measures of success for this new blog we have an added challenge – the primary content for the blog, images, will be stored on Flickr. Like the John Collier images at the Maxwell Museum, a large number of ‘visitors’ will only ever view the museum’s content on Flickr, not visiting the blog. In that sense, we are also going to be measuring image views by looking at the Flickr statistics as well.