As I’ve written in previous posts, internal search provides great insights into so many aspects of your site, and is one area that you should definitely focus measurement on.
Aside from the usual keywords that people are searching on, and whether or not those keywords lead to a conversion of some sort, there’s other measures that can be used to show whether your internal search is working.
For example, if you segment your audience type (as we do into Staff, Students and Anonymous traffic), you can see the different searches those audiences conduct.
Some measures to understand the effectiveness of search results would be:
- Time on the search page – a large amount of time would indicate they are not finding the result
- Search bounce – a high bounce would indicate poor results
- Number of searches per session – while not a direct indicator, could indicate poor results
- Keyword pathing – shows refinement of searches
- Number of Results – look for the zero’s in this one
Sometimes, no matter what you do, your organic search results just don’t cut the mustard – especially in a distributed content model where the content owners are less inclined or less experienced to think about SEO. If you find yourself in this situation, there’s a number of different things you can do to help. Half the battle though is realising that your natural search results are going to be poor (garbage in, garbage out) and any change is likely to be a slow burn.
One option to assist would be Omniture SiteSearch, which will allow you to do all sorts of things, including influencing results based on previous search data from SiteCatalyst, integrated with Test & Target…but we’ll save that for a future post.
Number of Searches
On the flip side, to get more insight, let’s look at the number of searches per session.
You can implement that very easily by using what’s called a counter eVar. You simply want to know the number of times something happens, before something else happens.
In SiteCatalyst, you can create a counter eVar (simply select the type of eVar as counter). Each time something happens, such as a search, we pass in the value of the keyword and we pass in a special value “+1” to the eVar.
SiteCatalyst then allows you to see reports based on those different values.
Our internal search tracking code looks like this:
/* Internal Search Event Setting */
if(s.prop5&&s.prop5==”0″){s.prop5=””}
if(s.prop5) {
s.events=s.apl(s.events,”event1″,”,”,1);
s.eVar39=”+1″;
}
if(s.prop5&&!s.eVar5) s.eVar5=s.prop5;
We set s.prop5 with the keyword on the search page – everytime a keyword is present.
eVar39 is our counter eVar. It basically captures the number of times that we have searched for something. Each time we do another search, the value in SiteCatalyst is incremented by 1 and then we end up with a report that shows the number of searches during a session (as we have set the eVar to expire on a visit).
So in this, albeit very limited result set, it shows that there were 184 searches on the first attempt.
There were 53 searches done on the third attempt, and so forth.
Interestingly (sadly), one search term was searched for on a 17th attempt – someones keen, but likely couldn’t find the result they were looking for, and they continued to search until they found some decent results.
You can also break down (providing you have full correlations on search terms), on each attempt to see what they were searching for.
In the instance where the person conducted 17 searches, the 17th search was for the term “vbs location”
I’ve also illustrated here that keywords can be broken down by the number of searches conducted. In the example above, Bookshop was searched for 205 times in total, but featured as someone’s 2nd, 3rd, 4th and 5th search attempt (the none is because it’s got previous data prior to my eVar being put in place).
Monetising Search
For most companies, search conversion is key – revenue generation from search. However, for the most part, our internal search does not “convert” to a sale of something. It’s mostly used to find content, so we’re keen to understand what that costs us (not how much revenue is being generated).
If you’re looking for a way to calculate a cost for search, here’s a “back of the envelope” calculation…
The average time spent by Staff on our search results page is around 208 seconds.
The average number of annual searches by Staff alone is 124,600…
therefore…
25,916,800 seconds expended using search annually
= 431,947 minutes expended using search annually
= 7,199 total hours expended using search annually
(that’s a phenomenal number when you think about it… that’s 960 working days at 7.5 hours a day)
If the average cost per hour of a resource is $ 40.00
then…
$ 287,960 is the total cost of resources who spend their time searching
If you can decrease search time spent by just 10% (21 seconds), you theoretically save around $29,000 – or you increase productivity availability by 96 days…food for thought!
A few fancy calculated metrics in SiteCatalyst and you could probably put cost of search against each keyword for a specific audience as well…but we’ll leave that for now.
On the plus side, if you do the above, you’ll conversely be able to see conversions from search, enlightening you as to which search terms are driving revenue, or leads etc.
