# Best experiment management tools for machine learning **URL:** \ **Category:** Uncategorized\ **Created:** [December 13, 2019, 1:34pm UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977 "2019-12-13T13:34:59Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![Mohamed\_Ragab](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/mohamed_ragab/32/8127_2.png) [@Mohamed\_Ragab](https://discuss.pytorch.org/u/Mohamed_Ragab)\ **Post date:** [December 13, 2019, 1:34pm UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/1 "2019-12-13T13:34:59Z")
I will appreciate if anyone suggests a simple and efficient way to manage and save experiment results? ---
**Author:** ![ptrblck](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ptrblck/32/1823_2.png) [@ptrblck](https://discuss.pytorch.org/u/ptrblck)\ **Post date:** [December 13, 2019, 11:54pm UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/2 "2019-12-13T23:54:21Z")
What would you like to save? If you are referring to the model and optimizer, have a look at the [Serialization docs](https://pytorch.org/docs/stable/notes/serialization.html). ---
**Author:** ![Mohamed\_Ragab](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/mohamed_ragab/32/8127_2.png) [@Mohamed\_Ragab](https://discuss.pytorch.org/u/Mohamed_Ragab)\ **Post date:** [December 14, 2019, 3:27am UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/3 "2019-12-14T03:27:24Z")
Actually, my question was mainly about experiment management, how to monitor your model in organized way (e.g., hyper-parameters, loss, plots,). So far I use excel sheet to save my results and corresponding hyper parameters manually, I was wondering if there simple and effective tool to save results and help to do visualization also. ---
**Author:** ![Mohamed\_Ragab](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/mohamed_ragab/32/8127_2.png) [@Mohamed\_Ragab](https://discuss.pytorch.org/u/Mohamed_Ragab)\ **Post date:** [December 14, 2019, 3:29am UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/4 "2019-12-14T03:29:07Z")
Would appreciate, if you as an expert, present your best practices for managing ML experiment. ---
**Author:** ![ptrblck](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ptrblck/32/1823_2.png) [@ptrblck](https://discuss.pytorch.org/u/ptrblck)\ **Post date:** [December 14, 2019, 3:45am UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/5 "2019-12-14T03:45:33Z")
Oh, I’m no expert in managing ML experiments, so let’s wait for the real experts to give their opinion, which tools to use. 😉 ---
**Author:** ![Mauri](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/mauri/32/18927_2.png) [@Mauri](https://discuss.pytorch.org/u/Mauri)\ **Post date:** [December 19, 2019, 8:23pm UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/6 "2019-12-19T20:23:33Z")
[https://wandb.ai](https://wandb.ai) is a great tool for that. Hope it helps. ---
**Author:** ![Foivos\_Diakogiannis](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/foivos_diakogiannis/32/6787_2.png) [@Foivos\_Diakogiannis](https://discuss.pytorch.org/u/Foivos_Diakogiannis)\ **Post date:** [May 15, 2020, 7:36am UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/7 "2020-05-15T07:36:06Z")
A variety of tools is reported here: [https://neptune.ai/blog/best-ml-experiment-tracking-tools](https://neptune.ai/blog/best-ml-experiment-tracking-tools) Facing the same problem, getting lost in too many experiments… ---
**Author:** ![Mohamed\_Ragab](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/mohamed_ragab/32/8127_2.png) [@Mohamed\_Ragab](https://discuss.pytorch.org/u/Mohamed_Ragab)\ **Post date:** [June 4, 2020, 1:20pm UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/8 "2020-06-04T13:20:04Z")
I would like to thank you, for the last 3 months I have been using wandb.ai, and all what I can say that it is really amazing ---
**Author:** ![drewtao](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/drewtao/32/29709_2.png) [@drewtao](https://discuss.pytorch.org/u/drewtao)\ **Post date:** [October 12, 2020, 7:07pm UTC](https://discuss.pytorch.org/t/best-experiment-management-tools-for-machine-learning/63977/9 "2020-10-12T19:07:56Z")
I’d like to put in a plug for **runx** , which is very lightweight, and we use it in many of my group’s research projects. [https://github.com/NVIDIA/runx](https://github.com/NVIDIA/runx).