Can you please explain in steps how the derivate was calculated?
Course: Fundamentals of Machine Learning for Software Engineers - Learn Interactively
Lesson: Gradient Descent
Hello Arthur_Khakimov, I just happened to see your comment. I am not sure if you have questions about the derivation part. Here are more detailed steps, and I hope it can help.
2 Likes
Hi @Thea_Gong , thank you so much! Btw, a newbie’s question: is it required to know how to manually calculate derivatives? I suppose there could more complex loss functions and we can use special libraries for taking derivatives, or maybe the modern ML-related libs are already doing that under the hood?
You’re welcome. I am not sure about that because I learned this topic in an old-fashioned way and most of the time we calculated the derivate by hand. You’re right about the more complex loss functions, and as far as I know, some libraries in Python can provide ML model solutions such as PyTorch, scikit-learn, etc.