Tag: Testing

End-To-End Testing Considered Harmful

End-To-End Testing is deemed valuable by many organisations, but the false confidence and opportunity costs it generates are at odds with Continuous Delivery. Why is End-To-End Testing so commonplace, and yet so ineffective?

Read More

Release Testing Is Risk Management Theatre

Continuous Delivery often leads to the discovery of suboptimal practices within an organisation, and the Release Testing antipattern is a common example. What is Release Testing, and why is it an example of Risk Management Theatre?

Read More

No Release Testing

This series of articles explains why Release Testing – end-to-end regression testing on the critical path – is a wasteful practice that impedes Continuous Delivery and is unlikely to uncover business critical defects. Organisation Antipattern: Release Testing – introduces the Release Testing antipattern and why it cannot discover defects Organisation Antipattern: Consumer Release Testing – introduces the consumer-side…

Read More

Application Antipattern: Hardcoded Stub

A Hardcoded Stub constrains test determinism and execution times When testing interactions between interdependent applications we always want to minimise the scope of the System Under Test to ensure deterministic and rapid feedback. This is often accomplished by creating a Stub of the provider application – a lightweight implementation of the provider that supplies canned…

Read More

Organisation Antipattern: Passive Disaster Recovery

Passive Disaster Recovery is Risk Management Theatre When an IT organisation is vulnerable to a negative Black Swan – an extremely low probability, extremely high cost event causing ruinous financial loss – a traditional countermeasure to minimise downtime and opportunity costs is Passive Disaster Recovery. This is where a secondary production environment is established in a separate…

Read More

Organisation Antipattern: Consumer Release Testing

Consumer Release Testing is high cost, low value risk management theatre Despite the historical advice of Harold Dodge that “you cannot inspect quality into a product” and the contemporary advice of Don Reinertsen that “testing is probably the single most common critical-path queue” the Release Testing antipattern remains prevalent in the IT industry, and is by no means…

Read More

Organisation Antipattern: Release Testing

Release Testing is high cost, low value risk management theatre Described by Elisabeth Hendrickson as originating with the misguided belief that “testers test, programmers code, and the separation of the two disciplines is important“, the traditional segregation of development and testing into separate phases has disastrous consequences for product quality and validates Jez Humble’s adage…

Read More