Home Page Icon
Home Page
Table of Contents for
Strata
Close
Strata
by Sean Suchter, Chad Carson
Effective Multi-Tenant Distributed Systems
1. Introduction to Multi-Tenant Distributed Systems
The Benefits of Distributed Systems
Performance Problems in Distributed Systems
Scheduling
Hardware Bottlenecks
Lack of Visibility Within Multi-Tenant Distributed Systems
The Impact on Business from Performance Problems
Scope of This Book
Hadoop: An Example Distributed System
Terminology
2. Scheduling in Distributed Systems
Introduction
Dominant Resource Fairness Scheduling
Aggressive Scheduling for Busy Queues
Special Scheduling Treatment for Small Jobs
Workload-Specific Scheduling Considerations
Inefficiencies in Scheduling
The Need to be Conservative with Memory
Inability to Effectively Schedule the Use of Other Resources
Deadlock and Starvation
Waste Due to Speculative Execution
Summary
3. CPU Performance Considerations
Introduction
Algorithm Efficiency
Kernel Scheduling
Intentional or Accidental Bad Actors
Applying the Control Mechanisms in Multi-Tenant Distributed Systems
I/O Waiting and CPU Cache Impacts
Summary
4. Memory Usage in Distributed Systems
Introduction
Physical Versus Virtual Memory
Node Thrashing
Detecting and Avoiding Thrashing
Kernel Out-Of-Memory Killer
Implications of Memory-Intensive Workloads for Multi-Tenant Distributed Systems
Solutions
Summary
5. Disk Performance: Identifying and Eliminating Bottlenecks
Introduction
Overview of Disk Performance Limits
Disk Behavior When Using Multiple Disks
Disk Performance in Multi-Tenant Distributed Systems
Controlling Disk I/O Usage to Improve Performance for High-Priority Applications
Basic Disk I/O Prioritization Tools and Their Limitations
Effective Control of Disk I/O Usage
Solid-State Drives and Distributed Systems
Measuring Performance and Diagnosing Problems
Summary
6. Network Performance Limits: Causes and Solutions
Introduction
Bandwidth Problems in Distributed Systems
Hadoop’s Solution to Network Bottlenecks: Move Computation to the Data
Why Network Quality of Service Does Not Solve the Problem of Network Bottlenecks
Controlling Network Usage on a Per-Application Basis
Other Network-Related Bottlenecks and Problems
Measuring Network Performance and Debugging Problems
ping and mtr
Retransmissions
Summary
7. Other Bottlenecks in Distributed Systems
Introduction
NameNode Contention
ResourceManager Contention
ZooKeeper
Locks
External Databases and Related Systems
DNS Servers
Summary
8. Monitoring Performance: Challenges and Solutions
Introduction
Why Monitor?
What to Monitor
Systems and Performance Aspects of Monitoring
Handling Huge Amounts of Metrics Data
Reliability of the Monitoring System
Some Commonly Used Monitoring Systems
Algorithmic and Logical Aspects of Monitoring
Challenges Specific to Multi-Tenant Distributed Systems
Measuring the Effect of Attempted Improvements
Allocating Cluster Costs Across Tenants
Summary
9. Conclusion: Performance Challenges and Solutions for Effective Multi-Tenant Distributed Systems
Search in book...
Toggle Font Controls
Playlists
Add To
Create new playlist
Name your new playlist
Playlist description (optional)
Cancel
Create playlist
Sign In
Email address
Password
Forgot Password?
Create account
Login
or
Continue with Facebook
Continue with Google
Sign Up
Full Name
Email address
Confirm Email Address
Password
Login
Create account
or
Continue with Facebook
Continue with Google
Prev
Previous Chapter
Cover
Next
Next Chapter
Effective Multi-Tenant Distributed Systems
Strata
Add Highlight
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click
here
login for view all page.
Day Mode
Cloud Mode
Night Mode
Reset