Safe Fail and Fail Safe concept of the 2 types of experiments or trial runs is not new. I had to make a case to a strong process oriented crowd on adopting a new process and tool for allowing harvested knowledge at an organization level.
Major portion of the debate that ensued clearly gave a chance to contrast between the 2 types of experiments. I am only taking the roll out part of the whole change (a better word in safe fail types would be adoption).
For Fail Safe roll outs
- A business case that proves or claims that a change would happen on a stated benefit which is along either commercial or satisfaction value
- Once the business case is all clear there would be a pilot on a smaller (claimed representative) chunk of selected projects and disproportionate effort goes into making the business case a reality
- Now proving the benefit means you have a fixed boundary on the initial state and a new end state that has happened due to the change/experiment. Of course this will include non accounting for reasons that possibly worked in favor (that statement reflects the fact that I just finished reading “Fooled by Randomness”)
- Provided the sample set results are satisfactory the change is rolled out to larger set of people whose contexts are generally not clearly understood, and the effort that was put into the pilot is surely not replicated at this new large scale
- Post this usually benefit measuring exercise is conducted and published as is or there may be a change in parameters of what is measured as scale has changed
On the other hand Safe Fails
- Do not have a “business case” as the outcome is usually not clear when begun
- The pilots are usually not chosen or selected but are rather like drug trials are volunteers
- Boundary states are not necessarily fixed and coupled with outcome not being clear
- Larger scales is possibly an indication of the success of the change/experiment itself, but really speaking the success comes from the number of such experiments that Safe Fail type allows that will work in context.
- This point is not applicable as usually there is ignorance of how the change will adapt and work.