Testing: the black sheep of computer science

Testing is an essential aspect of computer science that ensures the reliability and effectiveness of software products. It involves the process of evaluating software applications to identify errors, bugs, and defects before deployment. Despite its critical role in software development, testing has often been considered the black sheep of computer science. In this post, we explore why testing has been treated as such and the importance of changing this perception.

Black sheep with glasses typing on a computer

One of the reasons testing has been regarded as the black sheep of computer science is that it is often viewed as a mundane and repetitive task. Developers are usually more interested in the creative aspects of programming, such as designing and implementing new features. Testing, on the other hand, involves verifying that the code works as intended, which can be time-consuming and tedious.

Another reason is that testing is often seen as an afterthought in the development process. Many organizations prioritize delivering new features quickly, often at the expense of testing. This approach can lead to software products with multiple bugs and defects that can result in costly consequences, including downtime, data breaches, and loss of customer trust.

Furthermore, testing is often a complex and challenging task that requires a deep understanding of the software system, the application domain, and various testing techniques. Testing professionals must be skilled in designing and executing tests, analyzing test results, and communicating their findings to developers and stakeholders effectively.

Another issue that contributes to the black sheep status of testing is the lack of recognition and appreciation for the work that testing professionals do. Many people outside the software development process view testing as a straightforward task that anyone can perform, and as such, they don’t appreciate the skills and expertise that testing professionals bring to the table.

Changing the perception of testing is crucial, as it plays a critical role in the success of software products. Effective testing helps to identify defects early in the development process, reducing the time and costs associated with fixing bugs and defects after deployment. It also ensures that software products are reliable, secure, and meet the needs of the end-users.

To change the perception of testing, organizations must prioritize testing in the software development process. They should invest in training and hiring skilled testing professionals, provide the necessary tools and resources, and encourage collaboration between developers and testers. Additionally, organizations should recognize and appreciate the value of testing and the contributions of testing professionals.

While programming and testing are both important parts of software development, testing requires a different set of skills and knowledge than programming. In this article, we will discuss why testing needs better skills than programming and provide examples to support this claim.

Critical thinking and problem-solving skills: Testing requires testers to think critically and identify potential issues and edge cases that developers may have missed. This involves analyzing requirements and design documents, exploring the software system, and evaluating different test scenarios to ensure that the software meets the specified requirements. For example, testers may have to simulate different user behaviors, test for compatibility with different platforms and devices, and evaluate performance and scalability under different loads. These tasks require testers to have excellent problem-solving skills and the ability to think critically and creatively.

Domain knowledge: Testers need to have a good understanding of the domain in which the software is being developed. This includes knowledge of the business processes, user workflows, industry regulations, and technical constraints that affect the software system. For example, testers working on a healthcare application must have a good understanding of the medical terminology, healthcare workflows, and regulatory requirements related to the application. This knowledge helps testers to identify potential issues, create relevant test scenarios, and evaluate the software system’s performance accurately.

Attention to detail: Testing requires a high level of attention to detail to identify issues that might otherwise go unnoticed. Testers need to be meticulous in their work, thoroughly reviewing software requirements, design documents, and code to ensure that the software functions as expected. For example, testers may need to verify that the software performs the intended function, handles errors and exceptions correctly, and provides appropriate feedback to users. These tasks require testers to be detail-oriented and have excellent organizational skills.

Communication skills: Testers need to communicate effectively with developers, project managers, and other stakeholders. They must be able to articulate their findings clearly, report bugs, and explain complex issues to non-technical stakeholders. For example, testers may need to write detailed bug reports, provide test results, and participate in project meetings to discuss issues and solutions. These tasks require testers to have excellent communication skills, both written and verbal.

There have been several high-profile cases where more testing could have prevented a software-related catastrophe. Here are some examples:

The Therac-25 radiation therapy machine: In the 1980s, a software defect in the Therac-25 radiation therapy machine caused several patients to receive lethal doses of radiation. The defect was caused by a race condition that occurred when operators changed settings too quickly. The manufacturer had not performed adequate testing on the machine, and the software was not designed to detect the error condition. If more testing had been performed, the defect could have been detected and corrected before the machine was released to the market.

The Ariane 5 rocket launch: In 1996, the maiden flight of the Ariane 5 rocket ended in disaster when the rocket veered off course and self-destructed. The cause of the failure was traced to a software error in the rocket’s inertial reference system. The software was not designed to handle the high-speed data that was being generated during the flight, and an overflow error occurred, causing the software to shut down. If more testing had been performed, the software defect could have been detected and corrected before the launch.

The Volkswagen emissions scandal: In 2015, it was discovered that Volkswagen had installed software in their diesel vehicles that detected when the vehicles were undergoing emissions testing and activated a “cheat mode” that reduced emissions to pass the test. During normal driving, the vehicles emitted up to 40 times the legal limit of nitrogen oxide. If more testing had been performed on the vehicles, the software defect could have been detected and corrected before the vehicles were released to the market.

The Equifax data breach: In 2017, Equifax suffered a massive data breach that exposed the personal information of over 143 million people. The breach was caused by a software vulnerability in an open-source web application framework that Equifax was using. The vulnerability had been patched months before the breach, but Equifax had not performed adequate testing to ensure that the patch had been applied to all of their systems. If more testing had been performed, the vulnerability could have been detected and corrected before the breach occurred.

These examples highlight the importance of thorough testing in software development. In each case, more testing could have prevented a catastrophic outcome. It’s crucial for organizations to prioritize testing in the software development process, invest in skilled testing professionals, and perform thorough testing to ensure the reliability and security of their software products.

In conclusion, while programming and testing both require specific skills, testing requires better skills than programming in critical thinking, problem-solving, domain knowledge, attention to detail, and communication skills. These skills are essential for identifying potential issues, designing relevant test scenarios, and evaluating the software system’s performance accurately. Therefore, organizations must recognize the importance of testing and invest in hiring and training skilled testing professionals to ensure the delivery of high-quality software products.