educative.io

Why are we using a blob storage only and not any other DB?

Courses
,
#1

While designing a Monitoring system for server-side errors why use blob storage and not any other DB that can perform test search efficiently like ElasticSearch or Solr? Why not use a columnar DB like Dynamo?
No explanation has been provided around that.

Course: Grokking Modern System Design Interview for Engineers & Managers - Learn Interactively
Lesson: Detailed Design of a Monitoring System - Grokking Modern System Design Interview for Engineers & Managers

#2

While the use of TSDB and rules DB apply to the most recent and relevant data, Blob store plays a key role because of the following reasons: in storing all the metrics that may be irrelevant with time.

However, its important to store this data for the following reasons:

  • All outdated but excessive data can be stored in a container like Blob
  • We can apply elastic search on and obtain data for visualizations from the Blob store
  • Past data stored in Blob stores can come in handy for compliance reasons and performing analysis for forecasting and future predictions

Since the data that needs to be stored is huge, Blob store serves the purpose very well.

We hope you will continue to provide us with healthy feedback and continue your learning journey with Educative!

1 Like