Lessons from the Video A/B Tools

When designing the Video A/B Tools, I originally had a single script that was “all in one”. It could slice-n-dice videos, pick random segments for testing, etc. You name it, it could do it. However, this approach was a disaster for testing. There were way too many combinations of different parameters to test. In the end, I split the functionality into separate scripts, which made testing much simpler. The moral of the story: it’s nice to have a single binary that does everything, but it can be better to split it into specialized tools.