Categories
User behaviour User experience Web metrics Young people & museums

“Let’s make more crowns”, or, the danger of not looking closely at your web metrics

Happy new year everyone.

I’ve got a bit of a backlog of posts but there is an ulterior motive for getting this out the door – and, well, it has been more than 18 months since I should have written about this.

Make-a-king's-crown---Play-at-Powerhouse screenshot

Over on our children’s website – Play at Powerhouse – we have a lot of content for children and parents to do at home either before or after they visit the Museum.

The website was launched in April 2007 as a way of segmenting off the ‘family’ audience from our main website and improving the user experience for that important group. Prior to its establishment, parents who just wanted to know what was on for their kids would have to navigate through exhibitions and events to figure out what was appropriate.

When the site was designed the main navigation was split into two halves – two very simple sections covering the practicalities of a museum visit, and two section for online and at home play.

And so in setting targets for the site we kept in mind that ideally we’d have a pool of casual visitors who we’d best serve by providing quick information that better helped them plan their visit to the museum; and a second group who we’d hope to build as ‘regular’ users of the site for craft activities, and to a far lesser extent, a few online games.

(Digressing briefly, we decided not to focus much on making ‘interactive games’ because there were already many established websites – in Australia the work of the national broadcaster the ABC especially – doing that as their main online focus and, frankly, far better than we could ever expect to do both in terms of design and also promotion).

The ‘craft’ section – Make & Do – was seen as a valuable resource that aligned with the Powerhouse’s reputation as a museum of ‘making things’ in a very crowded children’s web space. Importantly, too, we felt that it was good to support parents in giving them activities from the web that purposely meant doing things with paper and scissors, or out in the garden, anywhere away from a screen.

Over the past nearly three years the site has grown (and is on the schedule for a major UI overhaul!). It attracts a significant amount of traffic – peaking around school holidays as would be expected – and the craft activities, especially, are well linked by sites all over the world.

Internally the site has become integrated with the children’s programming as a whole to such an extent that the site’s Online Producer, Kate Lamerton, is moving over to join the unit responsible for general museum children’s programming. (In many ways this decentralising of content production is a sign of the maturity of the online product).

But that’s not the whole story.

As the site has developed we’ve tried to make user-led choices in the development of new content in the craft area. If the web is good at one thing it is data gathering. Very early on it the thinking of the site we felt that it was important to monitor what was popular and then use that as a means of thinking about what other content should be developed for the site.

Just to give you an idea of the resource burden of content generation – a single craft activity might take two to three full time weeks for Kate to conceptualise, prototype, and then create and instruction set for, photograph and upload. Some take considerably more, others, less.

So obviously we’d want to be choosing those craft activities wisely.

Now not every exhibition at the Powerhouse has obvious choices for craft activities for children, so Kate spends a fair bit of time thinking about ‘events’ to tie activities in with – obvious things like Mother’s Day, Father’s Day [1, 2].

And, because we care about web metrics, we are looking at what is popular and thinking about what I called ‘riffing’ on those – generally making ‘complementary’ thematic content.

But web metrics is a little more complex than that as I’ve said many times here (and in my workshops).

Here’s some data from the last two years.

Let’s first take a look at popular sections by page views for all visitors:

Content type % page views
Make & do (craft) 34.63%
What’s on (events & exhibitions) 24.16%
Play & interact (online games) 15.02%
Visiting (basic visiting information) 6.85%
Home page 15.85%

The first impression here is that the site is doing very much as planned.

The craft activities are generating the bulk of content views whilst the what’s on shows that site visitors are also more likely to be predisposed to visiting the physical museum. As expected with search driving most traffic on the web, the home page is less important as a single entity than each of the larger categories.

Let’s drilldown into Make & Do and see what is popular in there – the top ten by page views for all visitors.

Content type % page views
Craft index 24.63%
King’s crown 15.95%
Outback farm 6.02%
Easter index 3.72%
Knight helmet 3.34%
Princess hat 3.12%
Queen’s crown 3.07%
Masks for the ball 2.53%
Wizard’s hat 2.30%
Witch’s hat 2.14%

Here’s where things get interesting and where the initial thinking became skewed.

The clear leader – by far the most popular bit of craft – is the instructions and templates for making a King’s Crown. And appropriately we went along and made a fair amount of other types of ‘headwear’ – all of which have been popular too.

But are we serving our core audience? Who are these people who are coming to download the instructions for making a King’s Crown?

Let’s re-do those data tables again but this time let’s only look at traffic from Australia and then Sydney.

Content type % page views (all) % page views (Australia) % page views (Sydney)
Make & do (craft) 34.63% 21.06% 15.86%
What’s on (events & exhibitions) 24.16% 30.83% 33.85%
Play & interact (online games) 15.02% 16.12% 16.20%
Visiting (basic visiting information) 6.85% 8.64% 9.38%
Home page 15.85% 19.46% 20.58%

A different story starts to emerge.

Those craft activities are viewed by a far smaller proportion of site visitors the closer we get to our Sydney-based visitors. In fact, for Sydney-based visitors craft activities are even less popular than the online games on a percentage of total page views basis. Not surprisingly, though, by being located in Sydney and thus able to physically visit the Museum, the What’s On section increases in popularity.

Here’s those top ten craft activities again.

Content type % page views (all) % page views (Australia) % page views (Sydney)
Craft index 24.63% 35.29% 41.49%
King’s crown 15.95% 3.31% 1.90%
Outback farm 6.02% 3.97% 4.48%
Easter index 3.72% 7.01% 4.47%
Knight helmet 3.34% n/a n/a
Princess hat 3.12% n/a n/a
Queen’s crown 3.07% n/a n/a
Masks for the ball 2.53% 2.68% 1.96%
Wizard’s hat 2.30% n/a n/a
Witch’s hat 2.14% n/a n/a
Science index n/a 2.83% 3.16%
Easter baskets n/a 2.58% n/a
Speace helmet n/a 2.49% n/a
Mascot colouring in n/a 2.18% 2.68%
Healthy living n/a 2.02% 2.56%
Space index n/a n/a 2.19%

Now this is where it gets really interesting and where the team realised the importance of geographic segmentation. That headwear – the crowns and helmets and hats – wasn’t popular amongst local audiences. In fact, the more local we go the less popular it gets!

So much for putting resources into designing and making instructions for them!

Where was all this traffic for the King’s Crown coming from then?

Here’s the answer.

Country % visits
USA 53.96%
UK 14.27%
Australia 9.14%
Canada 5.42%
Mexico 1.34%

I’m glad our King’s Crown has been popular with Americans – in fact, predominantly Californians and Texans – but without the geographic segmentation being picked up early on in the life of the website we could have continued down that path oblivious to the irrelevance of that content to our local audiences (and the taxpayers who fund the museum).

Have you checked your popular content recently?
Is it really reaching the site visitors you are intending it to?

(Incidentally, if you are intending to attend Museums & the Web 2010 in Denver and wish to do my Web Metrics workshop then book quickly as it is almost full!)

Categories
User behaviour

Visible data and behaviour change – Stockholm

A quick off topic post from the road, having been re-reminded of Dan Hill’s Personal Well-tempered Environment in his presentation at Web Directions South a few weeks back.

My first impressions of Sweden, from arriving in the airport and catching the train into the city, were of a country that pushes its’ ‘green’ credentials upfront. All the transport from the airport to the city was ranked in terms of ‘eco-friendliness’. The public transport brochure for tourists proudly states that “(public transport) is good for the environment”. It then goes on to explain where the funding for public transport comes from (ticket sales, advertising, property rents and 50% from local taxes) and the number of jobs it provides for the community (14,000). This sort of additional information and context struck me as rather unique – certainly back home there isn’t any talk of where the funding comes from, and definitely not in the material produced for the tourist market.

What is striking about this is the use of ‘transparency’ as a means of encouraging certain types of behaviour – encouraging public transport use, and discouraging fare evasion. It also assumes a level of ‘good intent’ amongst readers.

This transparency extends to my hotel room where I am told that only 1/3 of people who stay in my room number reuse their towels more than one night at a time. This pales in comparison to the eco-friendly guests of Room 138 – they reuse at a rate of 87.5%! In defence of my room number – I expect, being a single room, my room gets a lot of single night stays and this skews its’ figures – (or the people who stay here are cleanliness obsessives). Again this is interesting because the hotel plays on the guest’s competitiveness and, again. assumes ‘good intent’ – can you beat Room 138?

stockholm-hotel

Then walking the city today I stumbled upon a piece of public art in Strandvägen that is fed by air and water pollution data. It looks like the work is quite old – and it gives a simple visualisation of pollution levels with a light sequence. Nothing too remarkable there except that it claims a real time data feed – something which I’m sure could/should be repurposed for online visualisations.

stockholm-obelisk

stockholm-obelisk-text

Food for thought.