What is our primary use case?
We use Buildkite for CI/CD during software development stages. Our environment includes separate pipelines for different tasks, such as testing, deployment etc... We have 30-40 pipelines in Buildkite
How has it helped my organization?
Initially, we manually configured and ran tests during deployments using Jenkins. After each job, we manually reviewed the reports to identify any test failures and then reported these to the development team. This process created a significant gap between the developers and the testing team.
To address this, we implemented Buildkite. Now, every code change triggers automated tests. We have separate pipelines for each stage of software development, including app testing, system testing, and deployment. This setup functions like a flow diagram: changes in the app automatically progress through the testing and deployment stages. Based on the results, the application is deployed to the server seamlessly.
What is most valuable?
Using Buildkite, managing pipelines becomes much easier. Each pipeline’s output is straightforward to understand, making it simple to edit configurations, Despite an initial steep learning curve, the overall process remains comprehensible. Buildkite also offers features like hooks and triggers; for instance, an action in the app can automatically trigger a pipeline. These elements can be added to specific pipelines, ensuring the entire process is automated.
When changes are made and files are modified in the repository, Automattically with the helo of hooks the Coresponding test pipeline this triggered.The hooks and the use of YAML files are particularly helpful in this process.
What needs improvement?
Since we were using Buildkite for the first time, we initially had a lot of difficulty understanding how it worked. The lack of third-party documentation meant we had to rely solely on Buildkite's documentation, contributing to a steep learning curve. Over time, it became much easier to use, though understanding certain features in Buildkite and YAML Configurations was particularly challenging at first.
Buildkite provides a comprehensive pipeline execution environment. However, in certain instances, Where a pipeline get's failed, pinpointing errors can be difficult. Therefore, when issues occur, understanding the root cause can be trickier and requires deeper analysis.
For how long have I used the solution?
I have been using Buildkite for eight months.
What do I think about the stability of the solution?
We haven't face issues till now.
What do I think about the scalability of the solution?
We haven't had any issue for the scalability part.
Which solution did I use previously and why did I switch?
Previously, we utilized DevOps and Jenkins. With Jenkins, deployment was a manual process; we identified the job and validated it through reports. Now, everything is fully automated with the introduction of Buildkite. For each specific change in the application, the corresponding test pipeline is executed, and deployment occurs only if the pipeline get's passed.
How was the initial setup?
The initial setup is complex. Most work for the pipeline has to be done by the development team. I'm only responsible for the test pipelines from our end.
We began with a POC for the build process, which took around one month. We started by using Azure DevOps, then transitioned from Azure DevOps to Buildkite. It took us some time to configure Buildkite and understand how it works. Eventually, we managed to have it up and running within a week. The entire POC phase lasted around eight to nine months, during which we thoroughly reviewed and refined our plans.
At least ten people were involved in the Buildkite deployment.
What's my experience with pricing, setup cost, and licensing?
We are using the free version of the solution.
Which other solutions did I evaluate?
I was not part of the process
What other advice do I have?
Overall, I rate the solution a seven out of ten.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
*Disclosure: I am a real user, and this review is based on my own experience and opinions.