What is our primary use case?
I mainly use Comet for research topics, summarizing information, and understanding difficult concepts. I use it for organizing and tracking my work on academic projects. It helps me keep track of experiments, compare results, manage data, and document my progress in one place. As a student, this makes it much easier to stay organized, analyze outcomes, and collaborate with classmates when working on research or machine learning projects.
Recently, I used Comet while working on a machine learning project that predicts student academic performance based on study habits and attendance data. I tracked different model runs, recorded parameters and results, and compared performance metrics such as accuracy and precision. Using Comet made it much easier to identify which model performed best and keep all my experiment details organized throughout the project.
What is most valuable?
Comet helps me maintain a clear record of my work, which is especially valuable in balancing multiple assignments and projects. Instead of manually tracking results in different files, I can keep experiments, metrics, and notes organized in one place. This improves reproducibility, makes it easier to revisit previous work, and saves time when preparing reports or presentations.
The features that stand out most to me are experiment tracking, performance visualization, and project organization. Experiment tracking makes it easier to compare different models, runs, and understand what changes led to better results. The visualization tools help me quickly analyze metrics and spot trends without having to create charts manually. I also appreciate how Comet keeps datasets, code versions, notes, and results organized in one place, which makes managing projects much more efficient.
The feature I rely on the most is experiment tracking. When I am testing different models or configurations, it is incredibly helpful to have all the parameters, metrics, and results automatically logged and organized. It saves me from manually documenting everything and makes comparisons much easier. As for specific tools, I use the experiment comparison dashboard all the time. Being able to view multiple runs side-by-side and quickly compare metrics such as accuracy, loss, and validation performance helps me make decisions much faster.
Comet does an excellent job of bringing different parts of the workflow together in one platform. Instead of switching between spreadsheets, notebooks, and separate tracking tools, I can see experiment metrics, visualizations, and notes in a single place. This not only saves time but also makes collaboration and project reviews much easier.
What needs improvement?
My experience with Comet has been very positive, but there are a few areas where it could be improved. One area is the learning curve for new users. Some of the more advanced features can feel overwhelming at first, especially for students who are new to machine learning experiment tracking. More beginner-friendly tutorials and guided onboarding would help. I would also like to see more customization options for dashboards and visualizations, making it easier to create views tailored to specific projects. Another improvement would be deeper integration with commonly used collaboration tools, which would streamline project documentation and team workflows.
There are a few additional areas where Comet could improve. From a performance perspective, I occasionally notice that dashboards with a large number of experiments can take longer to load or navigate. Regarding documentation, while the available resources are helpful, I would appreciate more beginner-focused examples, step-by-step tutorials, and real-world use cases. For support, my experience has generally been good, but having more community resources, discussion forums, webinars, or educational content specifically aimed at students and researchers would be valuable.
For how long have I used the solution?
I have been using Comet for approximately eight months.
What do I think about the stability of the solution?
Comet has been generally stable and reliable.
What do I think about the scalability of the solution?
In my experiments, Comet has handled scalability reasonably well for the types of projects I work on. For moderate increases in workload, such as more hyperparameter sweeps or additional experiment runs, it still performs well and keeps the data organized in a way that is easy to navigate and compare. That said, when the number of experiments grows significantly, I have noticed that loading dashboards and browsing through large experiment histories can become slower. It is not a blocker, but it does highlight that performance can vary depending on project size. Overall, I would say Comet scales very well for academic to mid-sized machine learning projects, and it remains usable.
How are customer service and support?
Customer support is pretty good, but I have not had a chance to directly reach out to them because I was able to troubleshoot all the issues with the online discussion forums. However, I heard from my colleagues and friends that customer support is actually good.
Which solution did I use previously and why did I switch?
I mainly relied on a combination of manual tracking methods, such as Jupyter notebooks, Excel, or Google Sheets. I switched to Comet because it brought all of these pieces together into a single platform. The main reason for the switch was efficiency and reproducibility.
Before choosing Comet, I explored TensorBoard, Weights & Biases, and setup using Jupyter notebook spreadsheets, which is what I initially started with. I did not do a formal head-to-head evaluation, but I explored them enough to understand their workflows. I chose Comet because I felt it had a good balance of ease of use and clean visualization tools without being too complex for my projects.
What was our ROI?
I do not calculate ROI in financial terms, but I have seen it in terms of time saved, productivity, and experiment efficiency. I estimate I spend around thirty to forty percent less time organizing and comparing experiment results compared to manual tracking. Project iteration cycles are faster, and I complete research projects more efficiently. In terms of qualitative ROI, the biggest benefit is improved workflow structure and reproducibility.
What other advice do I have?
Most of the major improvements I would like to see have already been covered, but one would be enhanced collaboration features.
I would suggest setting up Comet properly from the start and using it consistently for every experiment, even small ones. I also recommend taking time early on to learn how experiment tracking, metrics logging, and comparison views work because those are the features that provide the most value once you are actually iterating on models. Another recommendation is to keep experiments well-organized with clear naming conventions and tags.
I would rate my overall experience with Comet an 8 out of 10.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Google