- withoutBG Open Weights
- Open weights · commercially permissiveLicense: Apache-2.0
- IS-Net
- Open weights · commercially permissiveLicense: Apache-2.0
withoutBG Open-Weight Model vs IS-Net (isnet-general-use)
Quantitative comparison: 60 images scored against ground-truth mattes. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.
| Metric | withoutBG Open-Weight Model | IS-Net |
|---|---|---|
| MGE (Edge Quality) | 0.04523 ✓ | 0.06117 |
| MAE (Overall Accuracy) | 0.02923 ✓ | 0.09403 |
Disclosure: withoutBG includes BiRefNet
withoutBG Open Weights and Pro Model API are routed pipelines. A classifier sends fine strands, soft detail and transparency to withoutBG's own matting model, and hard opaque objects, flat scenes and vehicles to BiRefNet (MIT license), which is part of the pipeline. On this page, 17 of 58 images went to BiRefNet. The table splits the scores by route: the first group is what withoutBG's own matting model handled.
| Images | Metric | withoutBG Open-Weight Model | IS-Net |
|---|---|---|---|
| Routed to withoutBG matting (41) | MAE | 0.01846 ✓ | 0.09707 |
| MGE (edges) | 0.03773 ✓ | 0.05822 | |
| Routed to BiRefNet (17) | MAE | 0.01509 ✓ | 0.05130 |
| MGE (edges) | 0.04305 ✓ | 0.05359 |
Per-image averages, lower is better.
- MGE
- 0.03254✓
- MAE
- 0.00960✓
- MGE
- 0.05443
- MAE
- 0.03368
- MGE
- 0.06122✓
- MAE
- 0.02110✓
- MGE
- 0.10000
- MAE
- 0.08035
Photo by Alexander Dummer on Unsplash
- MGE
- 0.02084✓
- MAE
- 0.00601✓
- MGE
- 0.05612
- MAE
- 0.06709
- MGE
- 0.01262✓
- MAE
- 0.00461✓
- MGE
- 0.01499
- MAE
- 0.00909
- MGE
- 0.17462
- MAE
- 0.19712✓
- MGE
- 0.17298✓
- MAE
- 0.50163
Photo by Andreas Rasmussen on Unsplash
- MGE
- 0.07595✓
- MAE
- 0.02381✓
- MGE
- 0.07715
- MAE
- 0.06843
- MGE
- 0.03402✓
- MAE
- 0.02906✓
- MGE
- 0.03648
- MAE
- 0.22345
- MGE
- 0.04621✓
- MAE
- 0.01031✓
- MGE
- 0.04986
- MAE
- 0.04518
- MGE
- 0.01697✓
- MAE
- 0.00407✓
- MGE
- 0.02351
- MAE
- 0.01318
- MGE
- 0.01899
- MAE
- 0.00660
- MGE
- 0.01766✓
- MAE
- 0.00398✓
- MGE
- 0.04118✓
- MAE
- 0.01690✓
- MGE
- 0.06260
- MAE
- 0.03047
- MGE
- 0.04200✓
- MAE
- 0.01715✓
- MGE
- 0.11043
- MAE
- 0.53085
- MGE
- 0.05736✓
- MAE
- 0.08254✓
- MGE
- 0.13812
- MAE
- 0.52014
Photo by Camila Quintero Franco on Unsplash
- MGE
- 0.01469✓
- MAE
- 0.00695✓
- MGE
- 0.02829
- MAE
- 0.02992
- MGE
- 0.06638✓
- MAE
- 0.01242✓
- MGE
- 0.06714
- MAE
- 0.01656
- MGE
- 0.01093✓
- MAE
- 0.00177✓
- MGE
- 0.01995
- MAE
- 0.00657
Photo by Carlo Sierra on Unsplash
- MGE
- 0.02498
- MAE
- 0.00460✓
- MGE
- 0.01933✓
- MAE
- 0.05531
- MGE
- 0.03139✓
- MAE
- 0.00959✓
- MGE
- 0.04392
- MAE
- 0.02047
- MGE
- 0.02976✓
- MAE
- 0.00740✓
- MGE
- 0.06349
- MAE
- 0.12138
Photo by Conor Samuel on Unsplash
- MGE
- 0.07155✓
- MAE
- 0.01159✓
- MGE
- 0.09092
- MAE
- 0.01702
- MGE
- 0.03577✓
- MAE
- 0.00660✓
- MGE
- 0.03653
- MAE
- 0.00970
- MGE
- 0.01789
- MAE
- 0.00452✓
- MGE
- 0.01503✓
- MAE
- 0.00604
- MGE
- 0.03015
- MAE
- 0.01049✓
- MGE
- 0.02520✓
- MAE
- 0.01193
- MGE
- 0.05026✓
- MAE
- 0.01100✓
- MGE
- 0.07112
- MAE
- 0.08266
- MGE
- 0.01489✓
- MAE
- 0.00434✓
- MGE
- 0.04507
- MAE
- 0.02659
- MGE
- 0.01399✓
- MAE
- 0.00246✓
- MGE
- 0.03035
- MAE
- 0.01258
Photo by Lars Bo Nielsen on Unsplash
- MGE
- 0.05191✓
- MAE
- 0.01377✓
- MGE
- 0.07748
- MAE
- 0.09633
Photo by Mayer Tawfik on Unsplash
- MGE
- 0.01835✓
- MAE
- 0.00586✓
- MGE
- 0.04351
- MAE
- 0.02656
- MGE
- 0.01551✓
- MAE
- 0.00578✓
- MGE
- 0.03194
- MAE
- 0.02655
- MGE
- 0.02743✓
- MAE
- 0.00856✓
- MGE
- 0.04549
- MAE
- 0.02499
Photo by Niko Tsviliov on Unsplash
- MGE
- 0.14105✓
- MAE
- 0.05132✓
- MGE
- 0.19124
- MAE
- 0.13921
Photo by Norbert Braun on Unsplash
- MGE
- 0.01083✓
- MAE
- 0.00164✓
- MGE
- 0.04270
- MAE
- 0.06365
- MGE
- 0.05432✓
- MAE
- 0.02385✓
- MGE
- 0.10276
- MAE
- 0.25500
- MGE
- 0.03119✓
- MAE
- 0.02758✓
- MGE
- 0.05982
- MAE
- 0.10379
- MGE
- 0.02442✓
- MAE
- 0.01933✓
- MGE
- 0.13998
- MAE
- 0.28903
- MGE
- 0.02832✓
- MAE
- 0.01777✓
- MGE
- 0.04162
- MAE
- 0.05030
- MGE
- 0.37410
- MAE
- 0.49629
- MGE
- 0.32406✓
- MAE
- 0.46089✓
- MGE
- 0.02225✓
- MAE
- 0.00549✓
- MGE
- 0.03081
- MAE
- 0.01417
- MGE
- 0.01052✓
- MAE
- 0.00205✓
- MGE
- 0.01433
- MAE
- 0.01354
- MGE
- 0.02272✓
- MAE
- 0.00521✓
- MGE
- 0.03714
- MAE
- 0.02013
- MGE
- 0.03536✓
- MAE
- 0.00578✓
- MGE
- 0.03730
- MAE
- 0.00761
- MGE
- 0.02418
- MAE
- 0.02733✓
- MGE
- 0.02320✓
- MAE
- 0.03234
- MGE
- 0.02203
- MAE
- 0.00368✓
- MGE
- 0.01773✓
- MAE
- 0.00400
- MGE
- 0.01403✓
- MAE
- 0.00312✓
- MGE
- 0.01768
- MAE
- 0.00610
- MGE
- 0.02054✓
- MAE
- 0.00590✓
- MGE
- 0.03757
- MAE
- 0.02450
- MGE
- 0.00960
- MAE
- 0.00134
- MGE
- 0.00916✓
- MAE
- 0.00133✓
- MGE
- 0.02730✓
- MAE
- 0.00734✓
- MGE
- 0.04486
- MAE
- 0.02457
- MGE
- 0.02940✓
- MAE
- 0.01110✓
- MGE
- 0.09884
- MAE
- 0.05848
- MGE
- 0.18102
- MAE
- 0.03429
- MGE
- 0.11415✓
- MAE
- 0.02523✓
- MGE
- 0.07739✓
- MAE
- 0.09324
- MGE
- 0.07771
- MAE
- 0.02836✓
- MGE
- 0.13603
- MAE
- 0.02861
- MGE
- 0.09445✓
- MAE
- 0.01978✓
- MGE
- 0.02226
- MAE
- 0.00320
- MGE
- 0.01673✓
- MAE
- 0.00255✓
- MGE
- 0.03189✓
- MAE
- 0.00686✓
- MGE
- 0.08999
- MAE
- 0.04431
- MGE
- 0.01003✓
- MAE
- 0.01228✓
- MGE
- 0.02023
- MAE
- 0.05742
Photo by Vinicius Wiesehofer on Unsplash
- MGE
- 0.02822✓
- MAE
- 0.01994✓
- MGE
- 0.06374
- MAE
- 0.70768
- MGE
- 0.06085
- MAE
- 0.24387✓
- MGE
- 0.04792✓
- MAE
- 0.32880
- MGE
- 0.02557✓
- MAE
- 0.01326✓
- MGE
- 0.02564
- MAE
- 0.01765
- MGE
- 0.02353✓
- MAE
- 0.00573✓
- MGE
- 0.06352
- MAE
- 0.02465
- MGE
- 0.03757✓
- MAE
- 0.01221✓
- MGE
- 0.08990
- MAE
- 0.07705
- MGE
- 0.01677✓
- MAE
- 0.00759✓
- MGE
- 0.02635
- MAE
- 0.02086
Methodology
- Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
- Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness and MAE measures pixel-level accuracy. Both are lower-is-better.
- Scored images come from Bench v0, where every image has a ground-truth matte. The benchmark page has the full methodology and per-image scores for every model (CSV / JSON).
Photo Credits
Source images are courtesy of the photographers below via Unsplash.