DBO Interactive Performance Model

Batch tokens —

EP ranks —

Latency —

Bandwidth —

Compute/tok —

Expert skew —

Execution Timeline

—

dispatch compute combine

Step Time vs Batch Size

—

comm (2×dispatch) compute no‑overlap DBO

Show math

Dispatch time:

Compute time:

No‑overlap total:

DBO steady‑state:

The widget uses effective terms: L_{\mathrm{eff}}, BW_{\mathrm{eff}}, and c_{\mathrm{tok},\mathrm{eff}}. Effects like VLLM_DBO_COMM_SMS are folded into these sliders (not modeled as a separate \rho control).