Idea Evaluation - Facilitation and Conflict Part 3

12 Dec 2022

Idea Evaluation

This is the third part of the four-part series on conflict. In the first part, we explored why we need conflict. In the second how to establish a space that will be conducive to exploration of ideas. In this post, we will explore some techniques to objectively review ideas.

There are four parts to this series, this is the third:

1. Why we need Conflict

2. Ground Rules for effective conflict facilitation

3. Objective evaluation of Ideas

4. How to Navigate Conflict

Clear Success Criteria

Having clear outcomes for the event is key. For the Scrum Events this should be self-evident, however I have found that it is always worthwhile to call them out as it will help remind everyone to focus.

With other workshops having the desired outcome stated at the start, will emphasise the event's focus.

Once the outcome is stated or discovered, then the agenda can be outlined with approximate timings. This will act as an enabling constraint – it guides people to the content and flow of the event. This will reduce the uncertainty around what will happen and invite them to engage in the process.

Idea Review Techniques

The following are a few techniques to assess ideas, with the fastest least detailed first.

Roman Vote

This technique is named after the voting method in the coliseum, which is not true! Each person uses their thumb to declare whether they agree or not.

  1. The idea is clarified in one sentence.
  1. Everyone shows their hand at the same time (to prevent anchoring). Thumb up to agree, sideways to abstain or be neutral, thumb down to disagree.
  1. Simple majority to find the group answer



Fist of Five

A simple technique where everyone shows the number of fingers for how strongly they agree. No fingers for zero votes, up to 5 fingers for a maximum of 5 votes. Everyone must vote.

Tally up the votes, or use this an opportunity to explore the range.

Dot Point Vote

This is a slightly longer technique that can be used to sort thoughts after idea generation.

  1. Cluster like ideas together, and give them a title
  1. Each participant is given a set number of dots (I like using odd numbers 3 or 5)
  1. Set a time box
  1. At the end of the timebox order the ideas by the votes

Merit Score

With complex ideas, there may be many aspects that need to be considered. Using an objective merit score can help clarify the strengths of proposals, and in my experience, help unlock a further blended solution. I learnt this technique from Roy Osherove’s Notes to a Software Team Leader

  1. Agree the criteria for evaluation. Try to keep it less than 10 to avoid people getting overwhelmed.
  1. Generate the scores for each criterion, solution by solution. You may want to use a fist of five to make this process faster. Be open to discussion – this is a tool for understanding as much as clarification.
  1. Add the total

Call to Action

When you are facilitating, the group expects you to have some techniques on hand to help them get through the agenda.

What techniques do you prefer to use to guide a group through idea evaluation?

Pragmatic | Positive | Professional

APD will help improve the way you build products in an iterative and incremental way. Get in touch today for a free 30 minute consultation.

I'd like a free consultation