Skip to main content

Product Backlog Refinement explained (1/3)

March 14, 2016

One of the most challenging activities in Scrum is Product Backlog Refinement. During training courses I get many questions on this activity. What do you do during Product Backlog refinement? How do you prevent discussions going off track or in too much detail? Who should be there? When do you estimate? In this blog series, you will get some good practices and guidelines for having better, more effective and more vivid Product Backlog refinement. This series will consist of three posts:

  1. Before you bring an item into a meeting
  2. What do you typically do during a meeting focusing on refinement?
  3. Facilitating a meeting on Product Backlog refinement


‘Ready state’

The goal of Product Backlog refinement is to work with the Scrum Team and stakeholders (when relevant), to get Product Backlog items in a ‘ready state’. What does this mean? This basically means that the Developers have the idea that an item is:

  1. Clear enough, so they understand what stakeholders are asking for and why they are asking for it.
  2. Small enough, so the items should be small enough to get done within a sprint (typically a few days of work) to comply with the definition of done.


This activity is all about interaction between the Product Owner, Developers and stakeholders. If you were expecting a blueprint for a ‘ready’ item you clearly need to do some homework on agility. When an item is ready depends on many different aspects like experience of the Scrum Team or knowledge about the product. It even differs per item when Developers considers it to be ready. This activity takes time and doing this right saves a lot of time in Sprint Planning.

 

Before you bring it to a meeting


The most important part of Product Backlog refinement actually is before you start refining. The most ineffective use of a Scrum Team's time would be to refine an item that doesn’t contribute to the product vision. For a Product Owner, one of the first steps when a stakeholder has an idea is to find out what this person would like to have and why they need it. A common pitfall is that a stakeholder asks for a solution, the 'how', and a Product Owner in all it’s enthusiasm fails to retrieve what they would like to have and why they need it. Numerous times I have seen stakeholders ask for an iPad app. This sounds incredibly valuable and any developer would like to spend time on this over working on some legacy application. However, when the reasons behind the solution are unclear it will most likely end up somewhere hidden in the app store.

So, knowing the reasons behind the idea makes it easy for a Product Owner to judge whether this idea contributes to achieving the long-term vision of the product. If not, a Product Owner might consider to work on it anyway since it opens up a new market opportunity but most often it would be better to focus on those items that contribute to the team’s reason for existing. If these boxes are all checked then comes the most important decision. With the knowledge the Product Owner has, is it a valuable idea to create? Does this item have a fighting chance to be picked up by the team or will it end up somewhere at the bottom of the Product Backlog. I have seen Product Owners collecting every question ever being asked over a course of 8 years ending up with 12,000 items on the Product Backlog. A complete waste of time and effort. Even a product backlog with 100 items might be too much for a single team. As a Product Owner, you should ask yourself, how big is the chance of this item being picked up if it initially will be placed on the 40th position on the Product Backlog?



 

Wouldn’t a stakeholder be happier in the long run, if you spare him the false hope of his idea ever to be picked up? As you can see in the image above, there will be a lot of conversation between a Product Owner and stakeholder before it ends up on a product backlog. If the Product Owner does not consider the idea to be valuable, the stakeholder has two options, provide a better business case for the idea or just accept it just wasn’t a good idea to begin with. Our best advice for good Product Backlog refinement is to prevent everything to be discussed in Product Backlog refinement.

 

Stages of Readiness


One of the key pillars of the Scrum framework is ‘transparency’. For managing the Product Backlog, this means that it should be visible for the Scrum Team and stakeholders what the order is and in what stage of readiness a particular item is. The image below shows an example of a Product Backlog Kanban board.



 

Typically a Product Backlog item goes through three refinement meetings before it is considered to be in a ready state. First, when a stakeholder comes with an idea or wish, the team would roughly estimate the size of the item. A very fast way to do this is by 't-shirt sizing'. Nobody knows the exact size of a small sized t-shirt but everybody has an idea about the relative difference in size between a small and medium sized shirt. It is the first input for a Product Owner to get an idea on the effort involved in realizing the item. The second part is to assign story points to the item but again in a quick and dirty way. The format often used is Magic estimation or Silent estimation. This is estimating effort without having long and in depth discussions on the item. The final stage before an item is considered to be ready by the Developers is to do planning poker. This is a frequently used technique for estimating items. This technique is time consuming so preferably you would only apply this for items you actually want to be realized and based on previous estimation you have considered to be valuable enough to spend the effort.

Hopefully, this post has provided you with some ways of improving the efficiency and effectiveness of Product Backlog refinement. In the next blog, which will be posted next week, I will explain what typically happens when you set up a meeting to refine a Product Backlog item.

 


What did you think about this post?

Comments (11)


Theron James
01:48 am April 13, 2016

Hi, any tips for visualizing cross team refinement within a Nexus Scrum? They have that example in slide 15 here http://www.thepathtoagility... but looking for tools to accomplish this.


Erik
02:35 pm March 13, 2018

Hi Stephan, as a relative new PO (4 months in this company), I often have very exhausting refinement sessions with the development team. There are many story's on the backlog, that have been prioritised. We know we have to work on them, and when. For instance a lot of work for the GDPR right now. The issue is, that many times, the outline of the story is clear, but the details are not as concrete and can be interpreted in different ways. Developers tend to be very good at that ;). I think it is no problem to discuss an item, ask questions and then go back to the stake holder to make things more clear and then discuss the item in a next refinement session before doing the final story point estimate. Some teammembers on the other hand, are very annoyed every time a Story is not clear. And they blame me, for not understanding everything in detail about the story (most of the times, the story's were already there, or written by other team members). I am looking to find a format to make this more acceptable?
I tried reviewing the story's before hand, but when I think it is clear, still unexpected questions pop up during refinement.
I tried refining with a smaller group (the team is big: 8 developers, 2 testers)
Do you have any other ideas or tips on how to handle this 'situation'?


John Moody
02:32 pm March 14, 2018

Hi Erik, you may consider writing your acceptance criteria in Behaviour Driven Development syntax, i.e. 'given / when / then'. I use this with my scrum team. They like the unambiguous specificity it offers. An example might be:

1.
Given a user is on the home page of the payment portal
When the user clicks on the Privacy Policy hyperlink in the footer of the homepage
Then the user is presented with the payment portal's Privacy Policy page
And the text presented on the Privacy Policy page is as follows:
"Lorem Ipsum Dolor Sit Amet..."
And...
And...

Using this syntax will give the developers and testers confidence that you have a good handle on the desired functionality, and also provide ready-made test cases. Likewise, if you are unable to specify an acceptance criteria in this way, there could be an opportunity to clarify with stakeholders before you present the product backlog item in the refinement session.


Agile Smile
02:28 pm March 20, 2018

Hi Erik. It's a good things that the details aren't concrete; they're all potentially fluid until they're committed to in the Sprint Planning meeting.

User Stories should be a problem definition, not a solution definition. As a PO, you give the team the "why", and the "what" part. It is the team themselves that should define the "how" a story is implemented. This is a crucial difference. As long as you understand the users' needs/ problems, the team should innovate on the solution, which they should discuss and agree among themselves during the refinement. You'll hit problems anytime you try and "solutionize" user stories,as the team will rightly find holes - they're the solution experts on the team! You will be the person with the best knowledge of user needs on the team!

If there is a question that you don't know the answer to, that's fine. Simply take that user story away and find the answer for the team. Though it may mean that the story isn't "ready" for the next sprint.

Some disagree with this, but I think the PO should be involved in the team's retrospectives. If you are, then try and work through this with the team in the retro. Experiment with different ideas working to improve the refinement process. If the team don't do retro's with their PO, I'd hold a "special" retro with them to specifically discuss this. It sounds like you and the team would greatly benefit from this.

Hope this helps :)


Erik
08:08 pm March 20, 2018

Thank you for your respons. This sure does help. I am on the right track I think. Our Scrum Master is creatively organising the retrospectives and yes, I am part of them. Always.
I prepared a little presentation where I ask feedback from the team on the refinements. And will share your and my thoughts with them.


Colin Hammond
06:06 pm March 28, 2018

There have been no tools that help bridge the gap between product owner's intent and developer's interpretation. So we spent over a year developing ScopeMaster, a tool that helps improve the drafting of user stories to eliminate ambiguity and generate stories that can be coded. Oh, and it also estimates functional size in (ISO standard) function points. https://www.ScopeMaster.com.


Erik
08:04 pm March 28, 2018

Good thing you changed the url :)


nihar
08:49 am October 11, 2018

Hi, While in a backlog refinement meeting, the story points suggested by different development team members 2,3,5 etc - Is it based on a member having a specific skill such as dev, qa ? For example, John raised his hand for 5 - and is it dev only not testing ?


ALL-USTAADHI NATOSA
07:03 am March 31, 2020

yes great, I got something in my preparation for PMI-ACP EXAMS


peace love
01:32 pm November 4, 2022

wow! you hit the nail right on the head. you made backlog refinement so simple for me. am planning to write my product owner exam and also scrum 2 and 3.
thanks really great explanation


Nguyễn TùngAnh
09:29 am January 15, 2023

i love your post