What is our primary use case?
Our main use case for Bitrise is using it for the CI/CD pipeline for our mobile apps.
We use Bitrise for all the testing pipelines and workflows, including unit testing, component testing, UI testing, and system testing, as well as deploying builds into internal app distribution platforms like Firebase distribution. We also use Bitrise for deploying into the App Store and Play Store.
Bitrise is embedded into our team, which is a very effective use case of a CI/CD system. Once a developer merges or creates a pull request, Bitrise runs every test and build. We rely on Bitrise's CI/CD capabilities rather than testing manually. We have many automated checks running at different stages, which gives us more confidence with the app and with the builds that developers write.
How has it helped my organization?
Bitrise has positively impacted our organization by making the time to finish a ticket and time to release much smoother and faster. The flakiness of systems has reduced significantly. We had an in-house CI/CD system before, and compared to that, Bitrise is much faster and more reliable with all the builds.
We have been using Bitrise for three to four years, so some of our earlier data is approximately four years old from when we were evaluating CI/CD systems and changing from in-house solutions to cloud systems. Previously, we had long-running builds that took two hours or more, which after migration to Bitrise has been reduced to approximately one hour for the entire pipeline. With the parallel system and cloud agents now available, some of our repositories have builds running in fifteen to twenty minutes with multiple parallel machines. This represents a reduction from one hundred percent of the original build time to approximately ten to fifteen percent of the build time.
What is most valuable?
The best features Bitrise offers include mobile-specific CI/CD, which is a very niche offering that no other providers have matched in maturity based on our evaluation. All required dependencies come pre-installed in the cloud machines, which is much easier to set up. Bitrise also has many integrations with other systems that help us work with what we already have.
Out of the features mentioned, the pre-installed dependencies on the cloud machines are particularly valuable, especially not having to worry about all the versions of Xcode, Android Studio, and other dependencies. This is the breakthrough advantage of Bitrise.
What needs improvement?
Dashboards could be much more useful for our organization. There is a lot of information in the dashboards, and the usefulness of the insights dashboards is difficult to maximize because we have many repositories and many operations running. Trying to focus on bottlenecks becomes a more manual task. Having only specific information rather than a whole set of data could be a significant improvement. When overwhelmed with data, you lose control and track of things.
Bitrise's build systems are sufficient, but running tests has limitations. Bitrise has integration with Firebase Test Lab, but it is limited to sixty minutes of testing time, even though it is free. We could benefit from support for standalone mock servers, such as WireMock or Mockito. Currently, with Firebase, we need to do much more setup on our own. Test sharding is difficult based on our last evaluation. We currently run on simulators and cannot run tests on actual devices using the mock because Firebase Test Lab is time-consuming to set up. This is something we would like to see improved in Bitrise.
The dashboard has too much data without easy filtering options to get the specific information needed. Customized dashboards for specific teams based on how they build and test would be a great improvement rather than the same dashboard for everyone.
For how long have I used the solution?
We have been using Bitrise for approximately three to four years.
What do I think about the stability of the solution?
Bitrise is stable from my experience.
What do I think about the scalability of the solution?
Bitrise provides appropriate scalability for our organization.
How are customer service and support?
Bitrise's customer support is excellent.
Which solution did I use previously and why did I switch?
We used in-house systems with Buildkite before choosing Bitrise.
What was our ROI?
I cannot share specific return on investment information because we had an on-premise system before that is not comparable to our current setup. The number of repositories and teams is much larger now. With the current setup, it would cost approximately another couple of team members to establish and run an in-house system, with at least one person dedicated to maintaining it, which was not the case before.
What's my experience with pricing, setup cost, and licensing?
I cannot comment extensively on pricing, setup cost, and licensing because it goes through a procurement team. Pricing is concerning for our organization as it is on the higher end comparatively. Pricing is one of the areas our organization examines in greater depth.
Which other solutions did I evaluate?
We evaluated Bitrise, CircleCI, and GitHub Actions when choosing Bitrise, along with a couple of other options that we did not evaluate in depth.
What other advice do I have?
I would rate Bitrise as nine out of ten, or possibly ten as well, but I will rate it as nine to reflect room for improvement.
I choose nine out of ten for Bitrise because it accomplishes the purpose for which it was built, and it does so very efficiently.
Regarding Bitrise's AI capabilities, I cannot comment on governance and security because we have not used those features to date.
The accuracy and reliability of Bitrise's AI output is something our team has not explored yet.
Bitrise is deployed in our organization using a public cloud deployment model with Bitrise cloud machines.
My advice for others considering Bitrise is to try it first. You will be impressed by the native mobile support; much of the heavy lifting is done by Bitrise.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Other
Disclosure: My company does not have a business relationship with this vendor other than being a customer.