- withoutBG Open Weights
- Open weights · commercially permissiveLicense: Apache-2.0
- BiRefNet General Lite
- Open weights · commercially permissiveLicense: MIT
withoutBG Open-Weight Model vs BiRefNet Lite
Quantitative comparison: 60 images scored against ground-truth mattes. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.
| Metric | withoutBG Open-Weight Model | BiRefNet Lite |
|---|---|---|
| MGE (Edge Quality) | 0.04523 ✓ | 0.05385 |
| MAE (Overall Accuracy) | 0.02923 ✓ | 0.05217 |
Disclosure: withoutBG includes BiRefNet
withoutBG Open Weights and Pro Model API are routed pipelines. A classifier sends fine strands, soft detail and transparency to withoutBG's own matting model, and hard opaque objects, flat scenes and vehicles to BiRefNet (MIT license), which is part of the pipeline. On this page, 17 of 58 images went to BiRefNet, so on those images this page partly compares BiRefNet with BiRefNet. The table splits the scores by route: the first group is what withoutBG's own matting model handled.
| Images | Metric | withoutBG Open-Weight Model | BiRefNet Lite |
|---|---|---|---|
| Routed to withoutBG matting (41) | MAE | 0.01846 ✓ | 0.04122 |
| MGE (edges) | 0.03773 ✓ | 0.04632 | |
| Routed to BiRefNet (17) | MAE | 0.01509 ✓ | 0.04320 |
| MGE (edges) | 0.04305 ✓ | 0.05337 |
Per-image averages, lower is better.
- MGE
- 0.03254✓
- MAE
- 0.00960✓
- MGE
- 0.03924
- MAE
- 0.01463
- MGE
- 0.06122✓
- MAE
- 0.02110✓
- MGE
- 0.10639
- MAE
- 0.14212
Photo by Alexander Dummer on Unsplash
- MGE
- 0.02084✓
- MAE
- 0.00601✓
- MGE
- 0.03618
- MAE
- 0.01648
- MGE
- 0.01262✓
- MAE
- 0.00461✓
- MGE
- 0.02007
- MAE
- 0.00703
- MGE
- 0.17462✓
- MAE
- 0.19712✓
- MGE
- 0.17816
- MAE
- 0.28074
Photo by Andreas Rasmussen on Unsplash
- MGE
- 0.07595
- MAE
- 0.02381
- MGE
- 0.03963✓
- MAE
- 0.00944✓
- MGE
- 0.03402✓
- MAE
- 0.02906✓
- MGE
- 0.03715
- MAE
- 0.22545
- MGE
- 0.04621
- MAE
- 0.01031
- MGE
- 0.03318✓
- MAE
- 0.00807✓
- MGE
- 0.01697
- MAE
- 0.00407✓
- MGE
- 0.01430✓
- MAE
- 0.00722
- MGE
- 0.01899
- MAE
- 0.00660
- MGE
- 0.01884✓
- MAE
- 0.00393✓
- MGE
- 0.04118✓
- MAE
- 0.01690✓
- MGE
- 0.05587
- MAE
- 0.03550
- MGE
- 0.04200✓
- MAE
- 0.01715✓
- MGE
- 0.08326
- MAE
- 0.13867
- MGE
- 0.05736✓
- MAE
- 0.08254✓
- MGE
- 0.07428
- MAE
- 0.14315
Photo by Camila Quintero Franco on Unsplash
- MGE
- 0.01469✓
- MAE
- 0.00695
- MGE
- 0.01924
- MAE
- 0.00693✓
- MGE
- 0.06638✓
- MAE
- 0.01242✓
- MGE
- 0.07091
- MAE
- 0.01466
- MGE
- 0.01093✓
- MAE
- 0.00177✓
- MGE
- 0.01785
- MAE
- 0.00438
Photo by Carlo Sierra on Unsplash
- MGE
- 0.02498
- MAE
- 0.00460
- MGE
- 0.01324✓
- MAE
- 0.00394✓
- MGE
- 0.03139✓
- MAE
- 0.00959✓
- MGE
- 0.03277
- MAE
- 0.01138
- MGE
- 0.02976✓
- MAE
- 0.00740✓
- MGE
- 0.03697
- MAE
- 0.02848
Photo by Conor Samuel on Unsplash
- MGE
- 0.07155✓
- MAE
- 0.01159✓
- MGE
- 0.08142
- MAE
- 0.01335
- MGE
- 0.03577✓
- MAE
- 0.00660✓
- MGE
- 0.03708
- MAE
- 0.00997
- MGE
- 0.01789
- MAE
- 0.00452✓
- MGE
- 0.01362✓
- MAE
- 0.00774
- MGE
- 0.03015
- MAE
- 0.01049
- MGE
- 0.02216✓
- MAE
- 0.00787✓
- MGE
- 0.05026✓
- MAE
- 0.01100✓
- MGE
- 0.05470
- MAE
- 0.01293
- MGE
- 0.01489✓
- MAE
- 0.00434✓
- MGE
- 0.05769
- MAE
- 0.02791
- MGE
- 0.01399✓
- MAE
- 0.00246✓
- MGE
- 0.02241
- MAE
- 0.00570
Photo by Lars Bo Nielsen on Unsplash
- MGE
- 0.05191✓
- MAE
- 0.01377✓
- MGE
- 0.07225
- MAE
- 0.09152
Photo by Mayer Tawfik on Unsplash
- MGE
- 0.01835
- MAE
- 0.00586✓
- MGE
- 0.01823✓
- MAE
- 0.00793
- MGE
- 0.01551✓
- MAE
- 0.00578✓
- MGE
- 0.02074
- MAE
- 0.02993
- MGE
- 0.02743✓
- MAE
- 0.00856✓
- MGE
- 0.03337
- MAE
- 0.01295
Photo by Niko Tsviliov on Unsplash
- MGE
- 0.14105✓
- MAE
- 0.05132✓
- MGE
- 0.24206
- MAE
- 0.14053
Photo by Norbert Braun on Unsplash
- MGE
- 0.01083✓
- MAE
- 0.00164✓
- MGE
- 0.01680
- MAE
- 0.00277
- MGE
- 0.05432✓
- MAE
- 0.02385✓
- MGE
- 0.06968
- MAE
- 0.28910
- MGE
- 0.03119✓
- MAE
- 0.02758✓
- MGE
- 0.06020
- MAE
- 0.10113
- MGE
- 0.02442✓
- MAE
- 0.01933✓
- MGE
- 0.03451
- MAE
- 0.03129
- MGE
- 0.02832
- MAE
- 0.01777
- MGE
- 0.01612✓
- MAE
- 0.00411✓
- MGE
- 0.37410✓
- MAE
- 0.49629
- MGE
- 0.38153
- MAE
- 0.49515✓
- MGE
- 0.02225✓
- MAE
- 0.00549✓
- MGE
- 0.02980
- MAE
- 0.00965
- MGE
- 0.01052
- MAE
- 0.00205✓
- MGE
- 0.00714✓
- MAE
- 0.00289
- MGE
- 0.02272
- MAE
- 0.00521✓
- MGE
- 0.02175✓
- MAE
- 0.00867
- MGE
- 0.03536✓
- MAE
- 0.00578✓
- MGE
- 0.03659
- MAE
- 0.00637
- MGE
- 0.02418✓
- MAE
- 0.02733✓
- MGE
- 0.02841
- MAE
- 0.04023
- MGE
- 0.02203
- MAE
- 0.00368
- MGE
- 0.01602✓
- MAE
- 0.00352✓
- MGE
- 0.01403
- MAE
- 0.00312✓
- MGE
- 0.01113✓
- MAE
- 0.00354
- MGE
- 0.02054✓
- MAE
- 0.00590✓
- MGE
- 0.02117
- MAE
- 0.01166
- MGE
- 0.00960✓
- MAE
- 0.00134✓
- MGE
- 0.00968
- MAE
- 0.00140
- MGE
- 0.02730✓
- MAE
- 0.00734✓
- MGE
- 0.04775
- MAE
- 0.08296
- MGE
- 0.02940✓
- MAE
- 0.01110✓
- MGE
- 0.08359
- MAE
- 0.04699
- MGE
- 0.18102✓
- MAE
- 0.03429✓
- MGE
- 0.23416
- MAE
- 0.05215
- MGE
- 0.07739
- MAE
- 0.09324
- MGE
- 0.07652✓
- MAE
- 0.02271✓
- MGE
- 0.13603
- MAE
- 0.02861
- MGE
- 0.09900✓
- MAE
- 0.01907✓
- MGE
- 0.02226✓
- MAE
- 0.00320✓
- MGE
- 0.02678
- MAE
- 0.00390
- MGE
- 0.03189✓
- MAE
- 0.00686✓
- MGE
- 0.06780
- MAE
- 0.04945
- MGE
- 0.01003✓
- MAE
- 0.01228✓
- MGE
- 0.01291
- MAE
- 0.02304
Photo by Vinicius Wiesehofer on Unsplash
- MGE
- 0.02822✓
- MAE
- 0.01994✓
- MGE
- 0.04678
- MAE
- 0.06849
- MGE
- 0.06085
- MAE
- 0.24387
- MGE
- 0.04286✓
- MAE
- 0.21065✓
- MGE
- 0.02557✓
- MAE
- 0.01326✓
- MGE
- 0.03015
- MAE
- 0.02950
- MGE
- 0.02353✓
- MAE
- 0.00573✓
- MGE
- 0.02943
- MAE
- 0.01016
- MGE
- 0.03757✓
- MAE
- 0.01221✓
- MGE
- 0.04942
- MAE
- 0.01924
- MGE
- 0.01677✓
- MAE
- 0.00759✓
- MGE
- 0.02008
- MAE
- 0.01003
Methodology
- Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
- Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness and MAE measures pixel-level accuracy. Both are lower-is-better.
- Scored images come from Bench v0, where every image has a ground-truth matte. The benchmark page has the full methodology and per-image scores for every model (CSV / JSON).
Photo Credits
Source images are courtesy of the photographers below via Unsplash.