Benchmarking CI systems (Travis vs CircleCI vs Semaphore)
April 17, 2016 11:25
No one following this article yet.
Here comes a simple benchmark to compare performance of containers in different CI system for public projects. It is based on noosfero's test suite, specifically the test:api rake task
My computer (Core i7 6700HQ, 240gb SSD): 55s
We can see the semaphore was clearly the leader among the three. Also it was quite simpler to configure than the yml of travis and circle.
UPDATE: Added GitLab CI using DigitalOcean runners. The interesting about it is that it is running all builds in parallel, which in the end makes it the fastest!