Practical Advice To Starting Continuous Testing

Practical Tips for beginners to get started with Continuous Testing.

Image credit: https://pixabay.com/illustrations/suggestion-advice-business-care-4300902/

Non-Medium Members: You can read this article for free on Substack.

Continuous Testing, different from Continuous Integration, is a process of executing Automated E2E (preferably UI) tests frequently as regression testing.

Goal: Run a large number of tests on a daily basis

Below is a screenshot of one BuildWise agent participating in executing a suite of 577 End-to-End (UI) tests (Selenium). Real Continuous Testing!

Executed over 150 End-to-End tests on one BuildWise Agent (new M4 Mac Mini), as a part of 6-Agent CT run. There was one test failure, which were handled by the BuildWise auto-retry feature. For more, check out my father’s book.

It is a nice goal. However, even for experienced software engineers, it is important to take small steps when setting up Continuous Testing.

Tip 1. Get your tests running fine from command line first.

A Continuous Testing server, e.g. BuildWise, is designed to execute automated E2E tests. Of course, A CT Server has specific features, such as Dynamic Ordering, Parallel Execution, …, etc in BuildWise. But for new projects, put that aside for now — the…