From the course: Azure Data Engineer Associate (DP-203) Cert Prep: 1 Design and Implement Data Storage
Join today to access over 24,000 courses taught by industry experts.
Partition strategy - Azure Tutorial
From the course: Azure Data Engineer Associate (DP-203) Cert Prep: 1 Design and Implement Data Storage
Partition strategy
- [Instructor] Let's talk through some common partitioning strategies for data, including horizontal, which is also referred to as sharding, vertical and functional. First, let's start with horizontal sharding. Really, in a nutshell, what this means is that you're dividing your inventory in a couple of different sections. Your customer records from A to G here are divided into one section and then your other customer records, let's say H to Z are in another section. And this is a fairly intuitive way to break things up here. And the idea here is that you're spreading the load over multiple computers. So one machine has that first section and then another machine has the other section and this reduces contention, also improves performance and a really important aspect of this is the sharding key. So, it can be difficult to change the key once you've already designed the system. So if you can architect things upfront,…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.