Weights & Biases enables efficient and transparent machine learning operations, focusing on collaboration and model performance tracking.
| Product | Mindshare (%) |
|---|---|
| Weights & Biases | 1.0% |
| Datadog | 11.8% |
| Dynatrace | 11.8% |
| Other | 75.4% |
Weights & Biases provides experiment tracking, hyperparameter optimization, model artifact versioning, metric visualization via dashboards, and real-time monitoring. Users appreciate its ease of collaboration, centralization of results, model comparisons, and access control. Hyperparameter optimization and data versioning are essential for improving model performance, maintaining reproducibility, and enhancing workflows in ML projects. Its UI is easy to navigate, making model artifact management and error tracking accessible for team use.
Weights & Biases needs better tutorials and training to enhance user engagement. Integration with cloud providers requires improvement. Users suggest enhancements in cost management, scalability, and visibility of AI workflows. Incorporation of artificial intelligence for rapid research and ease of experimentation is desired. User experience and interface need refinement, and network stability issues persist. Improved documentation and simplified deployment examples for Kubernetes could enhance efficiency, alongside addressing storage costs to accommodate larger datasets.
Users primarily utilize Weights & Biases for experiment tracking, model evaluation, and metric visualization. It supports AI-driven workflows, collaboration across teams, and structured machine learning comparisons. Its capabilities aid in understanding machine learning experiments, managing data, tuning model evolutions, and tracking model metrics. Through visualization and collaboration, it enhances model development and deployment. Users log metrics, errors, precisions, and recalls during training and testing in Jupyter Notebooks, aiding in predictions and data management.
Weights & Biases supports scalability effectively, handling both individuals and small teams efficiently. With its operations on AWS, users find it currently fitting their needs, although some are considering expanding to Kubernetes for further growth. Scalability is not seen as a constraint in existing training workflows, and the ability of the platform to accommodate varying needs is appreciated by users, suggesting confidence in its expansion capabilities.
Users consistently find Weights & Biases to be stable. Multiple comments emphasize its stability, indicating confidence and reliability in its performance. The platform’s robust stability has been a key highlight, repeatedly mentioned across different experiences. Their assessments uniformly recognize the dependable nature of Weights & Biases, pointing to a consistent track record in maintaining stability during usage. Stability appears to be a hallmark that users frequently note when discussing Weights & Biases.
Known for its user-friendly interface, Weights & Biases facilitates machine learning model development by offering tools for experiment tracking, dataset versioning, and model visualization. It supports seamless integration with other ML tools, enhancing productivity and streamlining workflows.
What are the key features of Weights & Biases?
What benefits should be expected from Weights & Biases?
In industries such as finance and healthcare, Weights & Biases supports compliance and accuracy through rigorous model monitoring and dataset tracking. In manufacturing, it aids in predictive maintenance by enabling continuous improvement of algorithms and processes.
Weights & Biases was previously known as Weights and Biases Weights & Biases.
| Author info | Rating | Review Summary |
|---|---|---|
| software Engineer at a financial services firm with 10,001+ employees | 3.5 | <p>I use Weights & Biases to track model metrics, appreciating its intuitive UI, artifact versioning, and excellent support. Yet, I've encountered stability issues and find its documentation, particularly for Kubernetes, hard to navigate.</p> |
| Senior Software Engineer at a tech vendor with 10,001+ employees | 3.5 | <p>I use Weights & Biases for ML experiment tracking, visualization, and data/model management, particularly for prediction models. It improves reproducibility and team collaboration, outperforming tools like MLflow, though storage cost needs improvement. I rate it 7/10.</p> |
| T PM at a consultancy with 51-200 employees | 4.5 | <p>I used Weights & Biases for experiment tracking and hyperparameter optimization, significantly improving efficiency, collaboration, and model performance. It was stable with good ROI. While cost and AI workflow visibility could improve, I found it a valuable solution and highly recommend it.</p> |
| Machine Learning Engineer at a tech vendor with 10,001+ employees | 4.0 | <p>I find Weights & Biases excellent for experiment tracking, hyperparameter optimization, and versioning, significantly aiding my ML work. While stable and scalable, I wish for more tutorials and better cloud integration.</p> |
| Étudiant at a educational organization with 201-500 employees | 4.5 | <p>For my project, I found Weights & Biases highly effective. Its experiment tracking, visualization, and comparison features centralized our research and helped select the best embedding model smoothly. I rate it very highly for its intuitive nature.</p> |
My main use case for Weights & Biases is tracking metrics for my models when I'm training or testing new models.
I can give a quick specific example of how I use Weights & Biases to track metrics during my model training or testing by setting up the script to send my metrics when I'm training models in my Jupyter Notebook.
In addition to tracking metrics, I also track down errors, precisions, and recalls.
In my opinion, the best features Weights & Biases offers are that they are easy to adapt and navigate through inside their UI, and I can check the model artifacts by versions. Sometimes when it throws errors, I can check them easily, and it has access control that's a good fit for corporate usage.
What I like about the UI and the access control features is that they are just easy to navigate, easy to understand, and finding is also easy.
Weights & Biases has positively impacted my organization a lot because many users are using Weights & Biases for tracking models and seeing metrics. I believe it places a lot less weight on setting up this tracking method.
I can share specific outcomes or metrics since using Weights & Biases. For example, I can check each epoch's model artifacts and see how effectively it worked on my evaluation set, and it can be fetched by the unique ID.
I think Weights & Biases can be improved by being more stable because sometimes we have a lot of network issues and it's hard to debug. Also, there are some minor UI bugs where some graphs in specific formats don't show.
I would add that their documentation is not easy to go through, and when I'm trying to deploy to Kubernetes, their examples are huge and really difficult to understand.
I have been using Weights & Biases for three years.
Weights & Biases is stable.
Since Weights & Biases is running on AWS on our side, I think it's pretty scalable for now, but I want to expand it to Kubernetes.
Their customer support is great because they have 24/7 support and created separate Slack channels for our company users.
I didn't previously use a different solution; I was just using a notebook.
Before choosing Weights & Biases, I wasn't in a position to evaluate other options, but somebody did.
My advice to others looking into using Weights & Biases is to try it out first and also look at the other options, as it's hard to switch when you are used to Weights & Biases's UI. Other than that, I think it's just about trying to understand the real metrics and concept.
I would rate this product a 7 out of 10.
My main use case for Weights & Biases is as a platform to understand machine learning experiments, including tuning model evolutions and managing data. I use it heavily when I need to write ML scripts for my data processing and data analyst responsibilities. It primarily functions as a research tool for tracking and visualizing, serving as a framework to support my data work.
To provide a specific example of how I have used Weights & Biases in my work, I have a script in my current process that involves code I want to write in Python and PyTorch. I install Weights & Biases, log in to the website, and run queries by configuring it. I have used it to create graphs of the accuracy for the process I'm working on, specifically for a customer prediction model that uses Python scripting.
When I used Weights & Biases for my customer prediction model in Python, it helped me not only with the visualization aspect but also in managing datasets and collaborating with my team members during model development and deployment. It compares the model and visualizes the metrics we want to derive from it by running ML scripts, helping us understand the project in a deeper way through image classifications and NLP models, monitoring accuracy and utilization, and managing hyperparameters while sharing experiments and comparing results.
I have used Weights & Biases mainly for predictions, as it generates automated predictions based on the LLMs we create and stores those predictions, providing data with accuracy and creating charts to help us compare the data and run against future experiments.
Weights & Biases offers several best features including tracking, visualization, the registry part, datasets, dataset versioning, and monitoring framework integrations.
Out of tracking, visualization, registry, dataset versioning, and monitoring, I find myself relying on data versioning the most because it stores changes in datasets for reproducibility, and the model registry keeps track of which prediction model is currently deployed, along with real-time monitoring during training. It also provides accuracy scores, functioning as an experimental tracking tool.
These features help in ML engineering, comparing models, and collaborating with the team while maintaining reproducibility throughout the ML lifecycle.
Weights & Biases has positively impacted my organization by improving the processes we build for the client, particularly in prediction projects. It has improved our datasets and metrics, resulting in faster model comparisons. It provides tracking and model management that helps maintain reproducibility throughout the ML lifecycle.
Weights & Biases can be improved in areas such as user experience, user interface, cost, and features.
Regarding needed improvements, I believe the storage cost should be addressed because we want to store larger datasets and more items, so it can be enhanced in that aspect.
I have been using Weights & Biases for a year.
Weights & Biases is a stable platform.
In terms of scalability, it can support individuals and small teams effectively.
Previously, we used MLflow, ClearML, and TensorBoard, but they lacked the experimental tracking and model management features that Weights & Biases offers, so we switched to it for its end-to-end ML platforms and storage capacity. It stands out from others due to its open-source nature and stronger model registry with good deployment support.
In terms of return on investment, it has helped reduce manual efforts, especially in areas such as fraud detection. It provides accuracy and validation by giving us precision metrics, regression models, and more.
I evaluated various options including MLflow, Neptune.ai, and TensorBoard before settling on Weights & Biases.
My advice to others considering Weights & Biases is to leverage its storage registry and track all important metrics while using the model registry and production monitoring accurately. It maintains proper experiment tracking and is very useful for versioning and comparing features to make data-driven model decisions.
Regarding Weights & Biases' AI capabilities, I believe it has solid governance and security measures.
I find that audit logging is stronger than in other tools, but we still need to examine perspectives regarding unauthorized access and similar concerns.
As for accuracy and reliability of outputs from Weights & Biases, it does not directly help with model accuracy but improves model development through experiments and comparisons, making it easier to identify which models deliver the highest accuracy indirectly, as it optimizes the data in a better way.
I have given Weights & Biases an overall rating of 7 out of 10.
My main use case for Weights & Biases revolves around experiment tracking and model evaluation.
In my previous job, I used Weights & Biases for experiment tracking, model evaluation, visibility, and collaboration between the different teams that we had at the company, mostly in product and engineering, while we were working on AI-driven workflows and AI features.
Weights & Biases has positively impacted my organization by improving operational efficiency and functional visibility.
After adopting Weights & Biases, I noticed positive outcomes such as reduced time spent on debugging and rerunning experiments, allowing teams to quickly identify what configuration produced the best results.
One of the best features Weights & Biases offers is hyperparameter optimization because it lets us run large-scale hyperparameter searches using random or grid search.
Hyperparameter optimization from Weights & Biases helped my team significantly by reducing the manual trial and error and improving model performance much faster.
For improvement, I would say cost and scalability could be addressed, and visibility could be improved further on AI workflows.
I have used Weights & Biases for around a year in my last job.
Weights & Biases is stable.
Scalability of Weights & Biases has not become a bottleneck in our training workflow.
My experience with customer support for Weights & Biases was good.
Weights & Biases was the first solution I used for experiment tracking and model management, although we were considering Arise AI or BrainTrust at some point.
Before choosing Weights & Biases, I did evaluate other options, including Arise AI and BrainTrust.
I had a good experience with pricing, setup cost, and licensing, and everything was smooth.
While I cannot share specific metrics due to confidentiality, the return on investment from using Weights & Biases has been really good.
I had a good experience with pricing, setup cost, and licensing, and everything was smooth.
My advice for others looking into using Weights & Biases is that they should use it and experience the benefits of this product. I would rate this review as a 9 out of 10.
My main use case for Weights & Biases is experiment tracking.
Weights & Biases is a very handy library when I want to track experiments and find the optimal parameters for training models or determine which model is the best when experimenting with multiple models. This library is very useful.
When I need to find the optimal hyperparameter, I can use Weights & Biases to track different hyperparameters for training a model. Weights & Biases offers experiment tracking, hyperparameter optimization, and model artifact versioning.
I rely the most on hyperparameter optimization in my daily work because it is very useful for training models.
Weights & Biases is very useful when I need to review the past and see which model performed better or which parameters were the best. It provides good versioning and history, which is a feature I use frequently.
I think it provides easier collaboration. Even if I want to share my model with someone, they can see the metrics that I am getting in that model.
I think there are not enough tutorials or training available for Weights & Biases. That would be much more beneficial. A better integration with cloud providers would also help.
I have been using Weights & Biases for three years.
Weights & Biases is stable in my experience.
Weights & Biases is scalable.
I evaluated MLflow and TensorBoard before choosing Weights & Biases.
I chose a rating of 8 out of 10 for Weights & Biases because it is easy to use and a very good library for machine learning engineers. Weights & Biases is a very useful library if you want to track training experiments.
My main use case for Weights & Biases was for my end-of-studies project with the Ministry of the Economy and Finance.
As part of my end-of-studies project with the Ministry of the Economy and Finance, we used Weights & Biases mainly to track and compare our machine learning experiments in a structured way.
The main goal of our project was to choose the best possible embedding model for the Ministry of the Economy and Finance, and through metric visualization and quick comparison, we were able to decide in a smooth and helpful way which was the best model.
In my opinion, the best features that Weights & Biases offers are the most useful ones, such as experiment tracking, metric visualization via dashboards, and quick comparison between multiple runs.
Weights & Biases had a positive impact on my organization in that it allowed us to centralize our research, specifically centralizing our results, metric tracking, and visualization.
Weights & Biases allowed each person to run their tests and then we could decide directly what decision to make next.
In my opinion, Weights & Biases could be improved by enhancing the tool with artificial intelligence to allow for faster research and a more intuitive experimentation process.
I have been using this solution for a year.
Regarding the pricing, setup cost, and license management of Weights & Biases, we stayed on the free plan, which allowed us to explore this tool and test all the features.
My experience with Weights & Biases was very interesting and very intuitive. I do not have anything else to add about the features I appreciated in Weights & Biases. I do not have any other ideas or details about improvements that could be made to Weights & Biases. I have been able to cover everything, and I do not see any other areas for improvement for Weights & Biases. I would rate this product a 9 overall.
