Test Magazine, May 2016

Co-authors – Lee Hawkins, Rajesh Mathur

Testing Management – It’s Not What You Might Think (Thinking Isn’t Optional)

One of the ironies of the software testing industry is that a lot of people outside the industry (and also a lot of people inside the industry) believe that testing is easy. Testing can be easy for certain software products. For example, applications which meet the following assumptions:

  • simple architectural designs
  • are used sparingly
  • are not mission, life or business critical
  • do not interact with other applications or environments or their interaction as well as integration is minimal
  • usability and accessibility requirements are minimal and may have bugs that “may not bug someone who matters”.

Such applications are usually free, open-source or come as freebies with other software products. An example is Notepad which has minimal functionality and comes free with other Microsoft products.

On the other hand, testing can be very complex. Think about all other software that you use or interact with, or depend on, while at home or work, while driving, while traveling by air etc. The list of complex software we interact with is almost endless. However, when many people talk about software testing, they generalize the subject and call testing easy. This generalization naturally leads to the belief that anyone can test. If you share this belief, please read on. The authors suggest you read  “Perfect Software and Other Illusions about Software Testing” written by Jerry Weinberg. This might change your perceptions and thinking.

Since many people believe testing is easy, some testers or technical people we meet also feel that test management is easy and that anyone can do it. Most of the people who say such things do not really understand what they mean by testing or test management. It is very important to understand what we mean when we use these terms. In the words of Michael Bolton,”Words are powerful tools for understanding and clarifying ideas, but like all tools, they must be used skillfully to achieve their purposes and to avoid trouble.” The authors of this article mostly use the vocabulary of the Rapid Software Testing Namespace.

Here are some of the myths of test management that we have often heard from test professionals. In this article we will examine some of these.

  • I don’t need to know testing to become a test manager.
  • Test management is all about organizing resources. (The authors of this article prefer to use “people” or “team members” and not “resources”).
  • As a test manager, I do not have to actually test.
  • Knowing about testing is not that important as a manager because anyone can test.
  • I am a test manager and it’s easy because all you have to do is to assign resources to projects.
  • As long as I follow best practices, it will be all good.
  • Test Strategies and plans are based on templates. So as long as you have a template, planning is easy.
  • The availability of a detailed requirement documentation makes a test manager’s job easier. Her testers can simply write test cases based on requirements.
  • Following standard testing processes help you deliver good testing and vice versa.

Test management, like any other management discipline, requires a balanced and relevant skillset. Here are some of the skills that help one make a good test manager:

  • Leadership and management: Dealing with people (people management), setting priorities, delegating, motivating and developing people, coaching, listening. Demonstrating that you trust your people to understand problems and provide great solutions.
  • Critical thinking: To understand the mission of the project and to devise approaches appropriate for solving the problems. Recognising and negating pitfalls and biases that the problems pose and to draw meaningful conclusions, when needed.
  • Project management: You don’t have to create project plans, but learning how to decipher them or to add to them is seen as a good skill. Other project management skills that are useful to know as a test manager are scoping, planning, coordinating, budgeting, organizing and understanding risks.
  • Communication & collaboration skills: As a test manager, an important part of your job is to communicate. You communicate with your team members, with peers like development managers, architects, database administrators, infrastructure people, support teams, and with management teams. Good collaboration skills help you value and build relationships with these people., Forming positive alliances and understanding and is important when compromise and negotiation is required.
  • Testing: An important skill for test managers is to understand testing. Creating a test plan based on a requirements document and a test plan template is not test management. You must understand testing and you must be ready to roll up your sleeves!

It is clear that test management is much more than just resource management as some of the test managers we have met or worked with seem to think.

So what makes a good test manager? It is a combination of people skills combined with test skills. The balance is important. The context of the engagement matters and the balance will change as a test team matures. The one thing that stays constant is the need to have a “people first” attitude. Management is great for handling management responsibilities (reporting and the like), beyond that, you must embrace leadership.  When most people complain about their manager they are not complaining about management. They are really complaining about too much management and not enough leadership. A leader is a person who distributes empowerment through trust. It is someone who trusts you to solve problems using the skills you have (or ones they will actively encourage you to develop). They are most definitely not a micromanager and they know how to create an environment in which failure is safe. A manager, on the other hand, talks about how people (they would call them resources) should feel empowered but not give them the right permissions to actually be empowered. They micro manage and assign blame. There is no safe way to fail and the acceptable solutions are your managers solutions. Leaders motivate, managers suck motivation out of people. Daniel Pink in his book Drive – The Surprising Truth of What Motivates Us talks about motivation models.  A summary is presented below:

Motivation 1.0 – These are your basic instincts. Humans have had these since the dawn of time. This is the drive to survive.

Motivation 2.0 – The recognition that people respond to reward and punishment (controlled motivation). In the early 1900s Frederick Winslow Taylor was a notable contributor in this area. This approach hinges on rewarding desired behavior and punishing other, unwanted, behavior. This a command and control approach and appears to still be the predominant form of motivation used by managers. Recall that quote from Lenin? Control over trust, that [1] is motivation 2.0 thinking.

Motivation 3.0 – tapping into people’s intrinsic (autonomous) motivation, the desire to do a great job. Allowing people to utilize their sense of autonomy, allowing them to self-direct. This requires resisting the urge to control people.

If you want people to succeed, excel and engage then you must give them room to do so. Managers must learn to manage less and lead more.

Good test managers follow good practices of management. While people management skills are really important as a leader, another important requirement in becoming a good test manager is to becoming a skillful tester. We strongly recommend that you maintain a healthy interest in continuously improving your testing skills.

Imagine you decide to learn how to drive a motor car. You have a friend and your friend’s Grandfather has decided he will help you. He’s been driving for years so you’re confident that he’ll know what you need to learn. Experience is really important, right?  The morning of the first lesson arrives. You sit in the driver’s seat of your car imagining yourself out on the road. Your friend’s Grandfather arrives, gets into the passenger seat and says “You know I’ve been driving for over 60 years”. “Awesome, you respond, you must have driven a lot of cars”. The answer comes back “No, still driving my first model T. I take it out for a short drive every decade or so on a private property”. Is Grandpa really the right guy to be guiding you, teaching you car driving skills? Just about every industry I can think of has examples of people who think knowledge at a point in time (especially certification) equips them for life, and that skill, practice and acquiring new knowledge and skills are not important. This is a bad attitude and a great way to make yourself redundant. You really want to make sure that you don’t roll up to work a “Model T driver” when your team are all suited up “Formula 1 racers”. Experience is important but the right experience is far more useful.

Documentation and metrics (by this we mean metrics that are supported by a clear context that enables them to tell the underlying story) are useful. If you are moving into a test manager role it is likely to be one of the first items added to your “to do” list. Improving your team’s testing capabilities, creating a capability of finding important bugs fast is probably the most important task. Documentation and metrics do not make your clients happy, high quality software does. How you do that depends on your testing and people management skills. As a manager you might simply embark on a “certification collection” exercise and tell your clients  “My test resources are really good. They are all certified and we use only best practices”. As a leader you might talk to your people, discover areas they feel development is required. You might also consider skills that do not have “test” as part of their description. Courses that focus on things such as teaching, mentoring, coaching, thinking, analysing, team building, leading. The absence of a certificate at completion will be overridden by the value of the knowledge being brought back to the test team. As a leader you’ll tell your clients “We have a really broad experience base. The people in the test team are broad thinkers, they love analysis and problem solving. We are one of the happiest and strongest teams I have ever worked in”. We have previously answered some questions about certification in the January 2016 edition of Testing Circus magazine. A very good resource for improving testing skills is to attend courses offered by the Association for Software Testing.  

Through our experience, we believe that, amongst other things, good test managers are rounded individuals. They manage when required but otherwise lead and are good at leading by example. Their people first approach engages those that work with them and encourages those same people to work with a real passion because their input is highly valued. The testers experiment and innovate because they are lead by someone who makes it safe for them to fail and supports moving forward from the failure. We are not being critical of people who do not demonstrate these skills. We are, however, suggesting that if this article makes you feel like you manage and never lead, it is time to reconsider your approach.


Rob Lambert has written a lot on this topic too, so review his blogs for ideas: http://thesocialtester.co.uk/writing/  http://cultivatedmanagement.com/blog/ http://thesocialtester.co.uk/wp-content/uploads/2013/08/thediaryofatestmanager.pdf  http://cultivatedmanagement.com/how-to-manage-time/


Pink, Daniel H. (2010-01-13). Drive: The Surprising Truth About What Motivates Us. Canongate Books

Johanna Rothman has written many good articles on this subject. Visit her website for those articles: