- withoutBG Open Weights
- Open weights · commercially permissiveLicense: Apache-2.0
- BiRefNet Massive
- Open weights · commercially permissiveLicense: MIT
withoutBG Open-Weight Model vs birefnet-massive
Quantitative comparison: 33 images scored against ground-truth mattes. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.
| Metric | withoutBG Open-Weight Model | birefnet-massive |
|---|---|---|
| MGE (Edge Quality) | 0.03457 ✓ | 0.03965 |
| MAE (Overall Accuracy) | 0.01317 ✓ | 0.02234 |
Disclosure: withoutBG includes BiRefNet
withoutBG Open Weights and Pro Model API are routed pipelines. A classifier sends fine strands, soft detail and transparency to withoutBG's own matting model, and hard opaque objects, flat scenes and vehicles to BiRefNet (MIT license), which is part of the pipeline. On this page, 8 of 33 images went to BiRefNet, so on those images this page partly compares BiRefNet with BiRefNet. The table splits the scores by route: the first group is what withoutBG's own matting model handled.
| Images | Metric | withoutBG Open-Weight Model | birefnet-massive |
|---|---|---|---|
| Routed to withoutBG matting (25) | MAE | 0.00988 ✓ | 0.01650 |
| MGE (edges) | 0.03128 ✓ | 0.03764 | |
| Routed to BiRefNet (8) | MAE | 0.02343 ✓ | 0.04059 |
| MGE (edges) | 0.04487 ✓ | 0.04592 |
Per-image averages, lower is better.
- MGE
- 0.07595
- MAE
- 0.02381✓
- MGE
- 0.05840✓
- MAE
- 0.03213
- MGE
- 0.03402✓
- MAE
- 0.02906✓
- MGE
- 0.03695
- MAE
- 0.22434
- MGE
- 0.04621
- MAE
- 0.01031
- MGE
- 0.03036✓
- MAE
- 0.00569✓
- MGE
- 0.01697✓
- MAE
- 0.00407✓
- MGE
- 0.01950
- MAE
- 0.00826
- MGE
- 0.01899
- MAE
- 0.00660
- MGE
- 0.01413✓
- MAE
- 0.00270✓
- MGE
- 0.04118✓
- MAE
- 0.01690✓
- MGE
- 0.05214
- MAE
- 0.02378
- MGE
- 0.01469✓
- MAE
- 0.00695✓
- MGE
- 0.02709
- MAE
- 0.01414
- MGE
- 0.06638
- MAE
- 0.01242✓
- MGE
- 0.06317✓
- MAE
- 0.01272
- MGE
- 0.02498
- MAE
- 0.00460
- MGE
- 0.01567✓
- MAE
- 0.00398✓
- MGE
- 0.03139
- MAE
- 0.00959
- MGE
- 0.03000✓
- MAE
- 0.00914✓
- MGE
- 0.03577✓
- MAE
- 0.00660✓
- MGE
- 0.03776
- MAE
- 0.01013
- MGE
- 0.01789✓
- MAE
- 0.00452✓
- MGE
- 0.01792
- MAE
- 0.00976
- MGE
- 0.03015
- MAE
- 0.01049
- MGE
- 0.01997✓
- MAE
- 0.00759✓
- MGE
- 0.05026✓
- MAE
- 0.01100✓
- MGE
- 0.05595
- MAE
- 0.01593
- MGE
- 0.01835✓
- MAE
- 0.00586✓
- MGE
- 0.04070
- MAE
- 0.02035
- MGE
- 0.01551✓
- MAE
- 0.00578✓
- MGE
- 0.02327
- MAE
- 0.01633
- MGE
- 0.05432✓
- MAE
- 0.02385✓
- MGE
- 0.06721
- MAE
- 0.03654
- MGE
- 0.02832
- MAE
- 0.01777
- MGE
- 0.01545✓
- MAE
- 0.00387✓
- MGE
- 0.02225✓
- MAE
- 0.00549✓
- MGE
- 0.02449
- MAE
- 0.00583
- MGE
- 0.01052
- MAE
- 0.00205✓
- MGE
- 0.00943✓
- MAE
- 0.00447
- MGE
- 0.02272✓
- MAE
- 0.00521✓
- MGE
- 0.05837
- MAE
- 0.04824
- MGE
- 0.03536✓
- MAE
- 0.00578✓
- MGE
- 0.03597
- MAE
- 0.00685
- MGE
- 0.02418✓
- MAE
- 0.02733✓
- MGE
- 0.03465
- MAE
- 0.03383
- MGE
- 0.02203
- MAE
- 0.00368✓
- MGE
- 0.01852✓
- MAE
- 0.00400
- MGE
- 0.01403✓
- MAE
- 0.00312✓
- MGE
- 0.01949
- MAE
- 0.00672
- MGE
- 0.02054✓
- MAE
- 0.00590✓
- MGE
- 0.04253
- MAE
- 0.01640
- MGE
- 0.02730✓
- MAE
- 0.00734✓
- MGE
- 0.03509
- MAE
- 0.01486
- MGE
- 0.02940✓
- MAE
- 0.01110✓
- MGE
- 0.09978
- MAE
- 0.04155
- MGE
- 0.07739
- MAE
- 0.09324
- MGE
- 0.06949✓
- MAE
- 0.01981✓
- MGE
- 0.13603
- MAE
- 0.02861
- MGE
- 0.08811✓
- MAE
- 0.01729✓
- MGE
- 0.02353✓
- MAE
- 0.00573✓
- MGE
- 0.04840
- MAE
- 0.01911
- MGE
- 0.03757✓
- MAE
- 0.01221✓
- MGE
- 0.07133
- MAE
- 0.02808
- MGE
- 0.01677✓
- MAE
- 0.00759✓
- MGE
- 0.02711
- MAE
- 0.01281
Methodology
- Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
- Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness and MAE measures pixel-level accuracy. Both are lower-is-better.
- Scored images come from Bench v0, where every image has a ground-truth matte. The benchmark page has the full methodology and per-image scores for every model (CSV / JSON).