educative.io

How the master node is scaled in the Distributed File Systems?

Courses
,
#1

Hello,

I am just wondering, as the master node holds the global catalogue of the files/shards, what happens if the memory of the master node is full? Most probably this is a very unlikely case, but still I am wondering, how this case is being handled and how the master node is scaled accordingly?

Thanks,

Type your question above this line.

Course: https://www.educative.io/collection/10370001/4891237377638400
Lesson: https://www.educative.io/collection/page/10370001/4891237377638400/6119366154780672

#2

Hi Mustafa!
Basically there’s a very little possibility that we don’t have enough resources in a distributed system. A distributed system is comprised of multiple machines with data replicated on multiple nodes. It is generally more resilient to the failure of a part of the system. We determine the requested resources and set up autoscaling. We usually scale up the system using load balancing or caching in our system. Hence, the overall system continues to function, even if at a reduced capacity.

Hope it will clear your confusion. If you still have any queries please let us know.
Thank you.