educative.io

Design of a Blob Store - Grokking Modern System Design Interview for Engineers and Manager

In the design of Blob Store , I see that Process called Manager Node. I believe its again a cluster of node or its a service that’s running in a font end servers ?

Hi Jothimuthu_Palanisam,

The design that we presented consists of only a single manager node that runs a single manager process on it. A single manager with a global understanding of the state of all data nodes simplifies management tasks. Our design of the blob store is more like Google File System (GFS) which is designed with a single master node (same as our single manager node) and several chunkservers (same as our data nodes). The single-manager-based design of GFS works well for storing a few million files with a total of hundreds of terabytes of data.

The distributed manager design (a cluster of manager nodes) that you are proposing is more like Colossus File System developed by Google after GFS to meet the growing data needs.

You can read about both designs in detail on the provided links for the Google File System (https://www.educative.io/courses/grokking-the-principles-and-practices-of-advanced-system-design/gxZ8ZYg6lgG) and the Colossus File System (https://www.educative.io/courses/grokking-the-principles-and-practices-of-advanced-system-design/qZErqlG5Z3p). Let us know if you have any other questions or concerns. Thanks!

1 Like

Thank you , I will take a look at it.


Course: Grokking Modern System Design Interview for Engineers & Managers - Learn Interactively
Lesson: https://www.educative.io/courses/grokking-modern-system-design-interview-for-engineers-managers/qVnJ5pAJQ10