Master Storage Spaces Direct
Master Storage Spaces Direct
About the Book
The purpose of this book is to showcase the amazing expertise of our guest speakers at the North American MVPDays Community Roadshow. They have so much passion, expertise, and expert knowledge that it only seemed fitting to write it down in a book.
MVPDays was founded by Cristal and Dave Kawula back in 2013. It started as a simple idea; “There’s got to be a good way for Microsoft MVPs to reach the IT community and share their vast knowledge and experience in a fun and engaging way.” We wondered what the point was in recognizing these bright and inspiring individuals, and not leveraging them to inspire the community that they were a part of? If we didn’t yet have the right venue to help these individuals inspire and teach, why not create it?
Having established our soapbox, we often get asked the question “Who should attend MVPDays”?
The answer is simple. Anyone that has an interest in technology, is eager to learn, and wants to meet other like-minded individuals should attend. This Roadshow is not just for Microsoft MVP’s, but for anyone in the IT Community.
Make sure you check out the MVPDays website at: www.mvpdays.com. You never know, maybe the Roadshow will be coming to a city near you.
The goal of this particular book is to give you some amazing Storage Spaces Direct (S2D) tips from the experts you come to see in person at the MVPDays Roadshow. This book is used as a required reading prior to MVP Dave Kawula engaging on any Storage Spaces Direct project. From us at the MVPDays Publishing team we really hope you find immense value in this book and as always let us know what you think.
About the Authors
Bundles that include this book
Table of Contents
Acknowledgements iii
From Dave iii
About the Authors iv
Dave Kawula - MVP iv
Thomas Rayner - MVP v
Allan Rafuse – MVP vi
Cristal Kawula – MVP vii
Technical Editors / Reviewers vii
Emile Cabot - MVP vii
Cary Sun – CCIE No. 4531 viii
Kai Poynting viii
Clint Wyckoff - MVP ix
Contents x
Introduction 1
What is MVPDays? 1
North American MVPDays Community Roadshow 1
Structure of the Book 3
Sample Files 3
Additional Resources 4
Chapter 1 1
What is HyperConverged? 1
History of HyperConverged Infrastructure (HCI) 2
HyperConverged vs. Converged Infrastructure 3
Traditional infrastructure was not built for virtualization 4
HyperConverged Infrastructure 5
Chapter 2 8
Introducing Storage Spaces Direct (S2D) 8
Key Benefits of S2D 8
Simplicity 9
Performance 9
Fault Tolerance 9
Resource Efficiency 10
Manageability 10
Scalability 10
Deployment Options for S2D 11
Converged 11
Hyper-Converged 12
S2D Components 14
Networking Hardware 16
Storage Hardware 16
Failover Clustering 16
Software Storage Bus 16
SMB as transport 17
Software Storage Bus Bandwidth Management 19
Storage Bus Layer Cache 19
Storage Pool 19
Storage Spaces 19
Resilient File System (ReFS) 20
Cluster Shared Volumes 20
Scale-Out File Server 20
S2D Hardware Requirements 21
Windows Server Software Defined Program 21
Basic Requirements 21
Servers 22
CPU 22
Memory 22
Networking 22
Drives 23
Minimum Number of Drives 23
Maximum Size 24
Host-bus adapter (HBA) 24
Fault Tolerance and Efficiency 26
Mirroring 26
Two-way mirror 26
Three-way mirror 27
Parity – Erasure Coding 28
Single parity 28
Dual parity 29
Local reconstruction codes 31
When to use parity 31
Mixed resiliency 31
Storage efficiency 32
S2D Storage Calculator 33
When to use mixed resiliency 34
Sample Configurations 35
Examples where everything stays online 35
Examples where everything goes offline 38
Defining Resiliency Settings using PowerShell 38
S2D Cache 40
Drive Deployment Options 40
All-Flash 41
Hybrid 42
Cache Drive Selection 42
Cache behavior 44
Write-only caching for all-flash deployments 44
Read/write caching for hybrid deployments 46
Caching in deployments with drives of all three types 46
Cache Architecture 48
Drive bindings are dynamic 49
Handling cache drive failures 49
Relationship to other caches 50
Manual Cache configuration 50
Set cache behavior 51
Sizing the cache 52
Chapter 3 55
Windows Server 2016 Failover Clustering 55
What's new for Windows Server 2016 56
Cluster operating system rolling upgrades 56
Storage Replica 58
Cloud Witness for a Failover Cluster 59
Fault Domains 59
Virtual Machine Resiliency 63
Site-aware Failover Clusters 64
Workgroup and Multi-domain clusters 64
VM load balancing 64
Virtual Machine Start Order 65
Simplified SMB Multichannel and multi-NIC cluster networks 65
Diagnostic Improvements 66
Cluster Log Enhancements 66
Generating the Cluster.log 67
What’s New in Windows Server 2016 68
TimeZone Information 68
Cluster Objects 70
Diagnostic Verbose Logging 71
Events from Other Channels 73
Active Memory Dump 75
Configuring Active Memory Dump 76
Health Service 80
Prerequisites 80
Metrics 80
Metrics 80
Examples 81
Capacity Planning 81
Faults 82
Fault Coverage 83
Using the Health Service 85
Root Cause Analysis 86
Get-StorageHealthAction 87
Supported Components Document 90
Health Service Settings 93
Chapter 4 96
S2D Networking Primer 96
Windows Server 2016 Network Architecture 98
Teaming Configurations 98
Switch-independent teaming. 98
Switch-dependent teaming. 99
Algorithms for load distribution 101
Converged Network Interface Card (NIC) 103
Switch Independent / Address Hash 103
Switch Independent / Hyper-V Port 103
Switch Independent / Dynamic 104
Switch Embedded Teaming (SET) 105
SET Availability 106
SET Supported NICs 106
SET Compatibility 106
SET Modes and Settings 108
Member Adapters 108
Load Balancing Modes for SET 109
SET and Virtual Machine Queues (VMQs) 109
SET and Hyper-V Network Virtualization 110
SET and Live Migration 110
MAC Address Use on Transmitted Packets 110
SET vs. LBFO Teaming 112
Managing SET Teams 113
Creating a SET Team 113
Adding or removing a member of a SET team 113
Removing a SET team 114
Changing the load distribution algorithm of a SET team 114
Forcing the affinity of a VM or vNIC to a physical NIC 114
Setting up an affinity between a vNIC and a Physical NIC 115
Checking the affinity between a vNIC and a Physical NIC 115
Removing the affinity between a vNIC and a Physical NIC 116
Configuring RDMA for S2D 117
Enable Datacenter Bridging (DCB) 119
Create a Hyper-V Virtual Switch with SET and RDMA vNICs 120
Chapter 5 122
Deploying Storage Spaces Direct (S2D) 122
Cisco Nexus 9372x Switch Configuration 131
Powering on the S2D nodes 137
IPMI Configuration 137
Post-Configuration of the S2D Nodes 139
Building a 2-Node S2D Cluster 141
Install Core Windows Roles and features 141
Configuring Datacenter Bridging 143
Configuring the SET Team 144
Creating RDMA Enabled Virtual Adapters 147
Verifying RDMA Enabled Virtual Adapters 148
Creating Virtual Adapters for Live Migration and Cluster Heartbeat 149
Configuring the IP Addresses for the S2D Nodes 151
Download and Install all Windows Updates 152
Validate the Failover Cluster 152
Build the S2D Failover Cluster 155
Validate the Cluster prior to Configuring Storage Spaces Direct (S2D) 156
Enable Storage Spaces Direct (S2D) 157
Provision Storage Virtual Disks (CSV) 159
Viewing S2D Volume info with Show Pretty Volume 161
Expand the Virtual Disk 169
Expand the Pool by adding more disks 171
Chapter 6 177
Stress testing S2D using VMFleet 177
Overview of VMFleet Scripts 177
Master Control 181
Building VMFleet 182
Creating the Cluster Shared Volumes (CSV) for the tests 182
Install the VMFleet Scripts 183
Create the VMFleet Golden Image 183
Create the Fleet VMs 184
Run the VM Fleet 186
Storage QoS 186
Automated Sweeps 187
CPU Target Sweeps 189
Chapter 7 191
Deploying an 8 Node S2D Lab Using Hyper-V 191
Chapter 8 198
Factory Reset of Storage Spaces Direct 198
Clear-SDSConfig.PS1 198
Appendix A 207
BigDemo_S2D Script 207
Appendix B 237
Dave’s S2D Demo Build Script 237
Find our Experts 254
Join us at MVPDays and meet great MVP’s like this in person 254
Live Presentations 254
Video Training 254
Live Instructor-led Classes 255
Consulting Services 255
Twitter 256
Other books by these authors
The Leanpub 60 Day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
Now, this is technically risky for us, since you'll have the book or course files either way. But we're so confident in our products and services, and in our authors and readers, that we're happy to offer a full money back guarantee for everything we sell.
You can only find out how good something is by trying it, and because of our 100% money back guarantee there's literally no risk to do so!
So, there's no reason not to click the Add to Cart button, is there?
See full terms...
Earn $8 on a $10 Purchase, and $16 on a $20 Purchase
We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.
(Yes, some authors have already earned much more than that on Leanpub.)
In fact, authors have earnedover $14 millionwriting, publishing and selling on Leanpub.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
