Concept and architecture
Broker load balancer
Overview
Concepts
Load balancer
Bundle assignment (= dynamic assignments)
Bundle split
Bundle unloading (shedding)
Strategies
ThresholdShedder
OverloadShedder
UniformLoadShedder
Features
Benefits
Stability
Availability
Scalability
Performance
Types
Overview
Simple broker load balancer (deprecated)
Modular broker load balancer
Extensible broker load balancer
Comparisons
Commonalities
Differences
Architecture
Performance
Observability
Flexibility
Performance comparisons
Scalability
Publisher latency
Unload balance
Split balance
Architecture
Modular broker load balancer
Extensible broker load balancer
Workflow
Modular broker load balancer
Extensible broker load balancer
Use cases
Spread workloads for scaling
High availability with fault tolerance
Related topics
What is it? Who use it? Why use it? When use it?
Observability
Metrics
Broker load balancer
Broker load info metrics
Metrics
Best practice
Bundle assignment metrics
(Same as above)
Bundle unloading metrics
(Same as above)
Bundle splitting metrics
(Same as above)
Service unit state channel metrics
(Same as above)
Related topics
Administration
4️⃣ Broker load balancer
How to use it?
Manual
1. Pre-set (use configurations)
Modular broker load balancer
Extensible broker load balancer
Use different confs
2. Create namespace with assigned bundles
3. Lookup
4. Unload topics and bundles
5. Split
...
Use pulsar-admin commands
Automatic
1. Enable a load balancer
2. Verify a load balancer
3. Pre-set (use configurations)
...
Related topics
How to migrate it?
How to migrate from modular to extensible broker load balancer?
Steps
Related topics
How to migrate from extensible to modular broker load balancer?
Steps
Related topics
Considerations
If fail to roll back from extensible to modular, what will happen?
If use modular and extensible simultaneously, what will happen?
...
Related topics
How to monitor it?
Steps
Metrics
Related topics
How to use it?
Anti-affinity namespace
Development
Broker load balancer
Concepts
Working principles
Modular broker load balancer
Extensible broker load balancer
Steps
Modular broker load balancer
Extensible broker load balancer
Pulsar Doc Site (Old Doc)
Administration
Load balance
6️⃣ Dynamic assignments
7️⃣ Create namespaces with assigned bundles
8️⃣ Split namespace bundles
9️⃣ Shed load automatically
ThresholdShedder
OverloadShedder
Broker overload thresholds
UniformLoadShedder
🔟 Unload topics and bundles
1️⃣1️⃣ Distribute anti-affinity namespaces across failure domains
Create a failure domain and register brokers
Create an anti-affinity namespace group
Development
Modular load manager
Usage
Verification
Implementation
Data
Broker
Local broker data
Historical broker data
Bundle data
Traffic Distribution
Least long term message rate strategy
Pulsar Reference Site (New Doc)
Configuration
Pulsar
Broker
...
Reference topic
Task topic
Concept topic
Context