The Bowen Craggs Index of Online Excellence is a unique guide to the best in internet corporate communications, across main web sites, social media, country sites, apps and other online channels. It’s not really about communications, it’s about marketing - but marketing the whole enterprise, not just the things or services it sells. The Index is a ranking – in fact it is many rankings – but the real aim is not to stimulate praise, blame or panic, but to show what should be done (and what should not be done) to make a website as effective as possible.

As the database is constantly reviewed, there is no longer a particular deadline. The Index, as published, is a snapshot of our current data as we are reviewing sites on a rolling cycle. The Interactive Results Table provides a live view of our latest ranking.

Almost, but not quite. We adjust the questions to take account of changes in the world of the web. For example over time we have given more emphasis to the mobile web. Our guidelines are regularly revised, with training to ensure that analysts are always up to date.

We always consider the profile and needs of the companies being examined: in that sense our benchmarking is not objective, nor should it be. For the same reason, it is not a ‘tickbox’ exercise: every metric is judged by its relevance and its utility to the client, rather than ‘Is it there or is it not?’. The key questions are much more likely to be ‘How appropriate is it?’ and ‘How well is it done?’.

Companies included are taken from the FT Global 500, ranked by market capitalisation. We conduct reviews of the top 200 companies from this list. These ‘quick’ reviews follow a less in-depth methodology than our full reviews, but allow us to establish a list of companies worth looking at in-depth. From this shortlist, we conduct full reviews to finalise our Index ranking of the top 30 companies. The subscription database that underlies the published Index, contains best practice from all 200 companies we have reviewed, even if they have not made the top 30 overall best performers.

Our starting point is that the Index has to be credible – for us that means a checkbox approach cannot be used, because companies vary so much in what they can and should be doing online. Bowen Craggs has developed a methodology to benchmark corporate sites in great detail. The metrics are divided into two groups: overall and specific. Specific metrics concentrate on how well the site serves different groups. Within the overall metrics, Construction covers navigation and coherence, Message looks at the visual and content messages the site transmits, while Contact covers both ease of making contact and use of FAQs. Some of the questions we ask are broad (Is the look and feel appropriate? Does the site tackle relevant controversial issues?) – here analysts have to make a judgement based on their knowledge of the company, industry and the web. Others are quite specific (How well are CSR management and measuring systems explained? What format are provided for quarterly results?).

Social media is a crucial component of our methodology. We assess whether the company is making appropriate use of social media; in particular, whether it is coordinating its social media activities with those on the global website estate. Questions addressed include:   * Are different social media channels effectively and consistently targeted at appropriate audience groups?   * Are these channels regularly updated with appropriate and engaging content?   * How effectively are critics handled via each online channel?   * Is output across different social channels coordinated or fragmented?   * Are different channels appropriately tailored to different geographies?

We have seven consultants and analysts working on the Index, all with a background in the web and business, and many have been working on the Index since it started, in 2007. Our reviewers are all experts on the corporate web and are trained to ask first, what should be provided, and only then to judge how well it is provided. ‘Appropriate ‘is the key word. We look at the entire presence, covering non-English content where relevant.

Bowen Craggs has or has had commercial relationships with approximately half the companies in the list. We are confident that this does not in any way affect our judgment and scoring:   * Most of the companies involved are subscribers to our best practice database - we have not provided consultancy.   * Where we have provided it, we have been careful to maintain Chinese walls between consultants and reviewers.   * Because we publish our detailed analysis in the database, it would be very difficult to 'adjust' the scores without that being noticed.