Judging Criteria

In these Awards, effectiveness is measured in terms of commercial benefits achieved for the client and the customer and is not related to standards of aesthetics, or ‘good’ and ‘bad’ design.

What the judges are looking for

Context
In order to understand the significance of what has been achieved by design, it’s important that your case explores and explains the business and market context and there is clarity around the original business challenge, objectives and goals.

Understanding the business and market context within which your work sits is vital for understanding the significance and scale of impact, and this comes into play when judges are assessing how effective your work has been. Judges understand that every design solution operates within its own unique market and business context and the information you provide to them in this area is crucial for establishing the level of effectiveness.

How the results performed against original business objectives
The judges are looking to be able to relate the results back to the original objectives of the project. How do your results stack up against the objectives? How challenging were the original objectives? Was the original scope of the project exceeded? To what extent has the design work influenced the client’s business strategy, direction and / or decision making? If your work is particularly complex, embedded in a larger-scale business environment and/or without a clearly defined start and finish point, think about how you can clearly articulate the business challenge, what you were aiming to achieve and how you can prove and demonstrate the impact your work has had. What kind of measures and evidence proves your impact?

Scale of effect and breadth of impact
In order to assess effectiveness, judges will want to fully understand performance over time, as well as the scale of effect and breadth of impact of the solution. Explanation and proof of the significance of your results in the relevant business and / or market context is crucial.

Some methods of explaining performance include, but are not limited to:
— Performance against objectives.
— Performance against market norms or against competitive products or companies.
— The performance of a re-design against the performance of the old design, or evidence that design has created a shift in performance.
— The use of research after (and where possible, before) launch to establish a causal relationship between the design and its effectiveness.

Performance can be evaluated in a broad range of ways, however it is the significance and relevance of the results, as well as clear evidence of the link between design and the results, that is key. Use of both quantitative and qualitative measures within your entry is encouraged – qualitative results are important in building evidence in your case - but make sure you justify how qualitative data supports the case and impacted the results.

Cause and effect of design solution
Judges will be looking for clear proof of a cause and effect between the design solution and the results. It is important that you don’t simply assume that design created the results – you must demonstrate proof. Judges are not looking for an in-depth description of the design solution but instead will want to clearly understand how the design decisions behind the solution impacted the results. This is your opportunity to explain how design addressed the business challenge, created a shift and enabled success, with a convincing link between the design solution and the results.

In these awards, effectiveness is measured in terms of commercial, behavioural, societal and broader business benefits achieved and is not related to standards of aesthetics or ‘good’ and ‘bad’ design. Judges want to understand how results were achieved and what made this design solution work.

Need some ideas for what metrics could be used? See page 12 of the entry pack.

Proof of effect and other influencing factors
Design is rarely the only factor influencing a project’s commercial success and often design activity is intrinsically linked to other business activity. The aim of a DBA Design Effectiveness Awards entry is to prove beyond reasonable doubt a cause and effect between the design solution and the results. If other elements were employed that had an effect on the success of a project, you should explore, explain and evaluate the impact of that activity in order to help prove how your work created and/or contributed to the results claimed. Each entry has its own unique context and judges will need to be able to discern the extent to which your work impacted the results. If you think there were no other influencing factors, it is advisable to state this and show the judges why other potential impacting factors did not impact the results.

You must tackle this area head on and ensure the judges aren’t left with unanswered questions.

Not sure what counts as an influencing factor? Check out page 13-14 of the entry pack.

Judges are looking for clear, concise and comprehensive entries. If the entry is written and structured well, it will deliver a stronger message. Mistakes within the results section - for example inconsistent or inaccurate metrics - greatly go against an entry and every care should be taken to check your entry contains no errors.

Sources and types of data
A project’s success must be linked to a measured fact rather than an assumption, so the use of factual research to substantiate your claims is advised. Fact-based data such as Nielsen statistics carry substantially more weight than anecdotal points of view, e.g. a product manager’s subjective opinion on a finished product. Always indicate sources of statistics or other information quoted.

Projected and forecast data is not admissible.

Links to webpages or sources of additional information are not permitted.