Elastic Sizing and Performance Tuning Part 1 with Michael Young

• Nathan Stacey interviews Michael Young about sizing in Elastic. They discuss the concept of distributed systems, the value of data tiering, and the challenges of split brain scenarios. They also touch on the different tiers in Elastic (hot, warm, cold, and frozen) and how they impact performance and cost. 

The conversation provides insights into the importance of understanding the resources and requirements of an Elastic cluster to optimize its performance.Where to see this video:

Youtube of this full video as well as the channel with the rest of our videoshttps://youtu.be/ND0mn6Xsu3E

Keywords

• Elastic, sizing, distributed systems, data tiering, split brain, hot tier, warm tier, cold tier, frozen tier, performance, cost optimization, elasticsearch, tuning

Takeaways

• Understanding the resources and requirements of an Elastic cluster is crucial for optimizing its performance.

• Data tiering in Elastic allows for the efficient management of data based on its value and performance needs.

• Split brain scenarios can occur in distributed systems and can lead to conflicts and inconsistencies in data.

• Elastic offers different tiers (hot, warm, cold, and frozen) to accommodate different performance and cost requirements.

• Proper sizing and configuration of an Elastic cluster can ensure efficient data management and high performance.

Quotes

• "Enabling people to think about the things that matter with sizing so they could be more informed."

• "A few tweaks here and there changes that cluster from ho-hum to crazy fast."

• "Elastic can actually get down to single-digit millisecond response times."

Chapters

00:00 Introduction and Background

02:18 The Importance of Sizing

08:57 Overview of the Series

11:38 Data Tiering in Elastic

31:42 Understanding Split Brain Scenarios