withoutBG Open-Weight Model vs BiRefNet General
37 examples, 37 with ground truth. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.
| Metric | withoutBG Open-Weight Model | BiRefNet General |
|---|---|---|
| MGE (Edge Quality) | 0.07063 | 0.06476 ✓ |
| MAE (Overall Accuracy) | 0.06432 | 0.05694 ✓ |
| Connectivity | 0.06406 | 0.05636 ✓ |
- MGE
- 0.11187
- MAE
- 0.02393
- Conn.
- 0.02366
- MGE
- 0.05164✓
- MAE
- 0.01051✓
- Conn.
- 0.00860✓
- MGE
- 0.07491
- MAE
- 0.20595
- Conn.
- 0.20605
- MGE
- 0.06089✓
- MAE
- 0.03207✓
- Conn.
- 0.03135✓
- MGE
- 0.07847
- MAE
- 0.01629
- Conn.
- 0.01623
- MGE
- 0.06130✓
- MAE
- 0.01128✓
- Conn.
- 0.01096✓
- MGE
- 0.01863
- MAE
- 0.00476✓
- Conn.
- 0.00413✓
- MGE
- 0.01673✓
- MAE
- 0.00895
- Conn.
- 0.00713
- MGE
- 0.04704
- MAE
- 0.00841
- Conn.
- 0.00826
- MGE
- 0.02841✓
- MAE
- 0.00747✓
- Conn.
- 0.00708✓
- MGE
- 0.04385✓
- MAE
- 0.01141✓
- Conn.
- 0.01000✓
- MGE
- 0.04911
- MAE
- 0.01525
- Conn.
- 0.01362
- MGE
- 0.03629✓
- MAE
- 0.01250
- Conn.
- 0.01173
- MGE
- 0.03878
- MAE
- 0.01145✓
- Conn.
- 0.01170✓
- MGE
- 0.12069
- MAE
- 0.01999
- Conn.
- 0.01970
- MGE
- 0.08066✓
- MAE
- 0.01395✓
- Conn.
- 0.01311✓
- MGE
- 0.04500
- MAE
- 0.00749
- Conn.
- 0.00713
- MGE
- 0.02619✓
- MAE
- 0.00475✓
- Conn.
- 0.00359✓
- MGE
- 0.02821✓
- MAE
- 0.00834✓
- Conn.
- 0.00806✓
- MGE
- 0.03370
- MAE
- 0.01148
- Conn.
- 0.01015
- MGE
- 0.06872✓
- MAE
- 0.01673
- Conn.
- 0.01649
- MGE
- 0.07350
- MAE
- 0.01472✓
- Conn.
- 0.01452✓
- MGE
- 0.06195
- MAE
- 0.01177
- Conn.
- 0.01189
- MGE
- 0.04902✓
- MAE
- 0.00965✓
- Conn.
- 0.00845✓
- MGE
- 0.02073
- MAE
- 0.00482
- Conn.
- 0.00464
- MGE
- 0.01263✓
- MAE
- 0.00370✓
- Conn.
- 0.00266✓
- MGE
- 0.06311
- MAE
- 0.01859
- Conn.
- 0.01844
- MGE
- 0.04433✓
- MAE
- 0.00942✓
- Conn.
- 0.00934✓
- MGE
- 0.11979
- MAE
- 0.02627
- Conn.
- 0.02612
- MGE
- 0.07464✓
- MAE
- 0.01590✓
- Conn.
- 0.01520✓
- MGE
- 0.02311
- MAE
- 0.00796✓
- Conn.
- 0.00769
- MGE
- 0.01940✓
- MAE
- 0.00869
- Conn.
- 0.00767✓
- MGE
- 0.01507✓
- MAE
- 0.00650✓
- Conn.
- 0.00573✓
- MGE
- 0.01867
- MAE
- 0.01305
- Conn.
- 0.01152
- MGE
- 0.09111
- MAE
- 0.01771✓
- Conn.
- 0.01754✓
- MGE
- 0.08035✓
- MAE
- 0.02283
- Conn.
- 0.02099
- MGE
- 0.05274
- MAE
- 0.02840
- Conn.
- 0.02826
- MGE
- 0.02727✓
- MAE
- 0.00459✓
- Conn.
- 0.00401✓
- MGE
- 0.37456
- MAE
- 0.49888
- Conn.
- 0.49455
- MGE
- 0.34795✓
- MAE
- 0.46062✓
- Conn.
- 0.47012✓
- MGE
- 0.05988
- MAE
- 0.01390
- Conn.
- 0.01386
- MGE
- 0.03023✓
- MAE
- 0.00675✓
- Conn.
- 0.00548✓
- MGE
- 0.01330
- MAE
- 0.00272✓
- Conn.
- 0.00254✓
- MGE
- 0.01159✓
- MAE
- 0.00830
- Conn.
- 0.00688
- MGE
- 0.02282
- MAE
- 0.00565✓
- Conn.
- 0.00489✓
- MGE
- 0.01939✓
- MAE
- 0.00754
- Conn.
- 0.00501
- MGE
- 0.07366
- MAE
- 0.01213
- Conn.
- 0.01216
- MGE
- 0.05645✓
- MAE
- 0.00930✓
- Conn.
- 0.00850✓
- MGE
- 0.03789
- MAE
- 0.02922
- Conn.
- 0.03011
- MGE
- 0.03070✓
- MAE
- 0.01848✓
- Conn.
- 0.01790✓
- MGE
- 0.02475
- MAE
- 0.00395
- Conn.
- 0.00373
- MGE
- 0.01599✓
- MAE
- 0.00337✓
- Conn.
- 0.00219✓
- MGE
- 0.01271
- MAE
- 0.00301✓
- Conn.
- 0.00277
- MGE
- 0.01045✓
- MAE
- 0.00402
- Conn.
- 0.00262✓
- MGE
- 0.02503
- MAE
- 0.00752✓
- Conn.
- 0.00688
- MGE
- 0.02125✓
- MAE
- 0.00843
- Conn.
- 0.00666✓
- MGE
- 0.03017✓
- MAE
- 0.00736✓
- Conn.
- 0.00695✓
- MGE
- 0.05709
- MAE
- 0.02184
- Conn.
- 0.02052
- MGE
- 0.04226✓
- MAE
- 0.01824✓
- Conn.
- 0.01716✓
- MGE
- 0.08856
- MAE
- 0.06629
- Conn.
- 0.06887
- MGE
- 0.28577✓
- MAE
- 0.93281
- Conn.
- 0.93738
- MGE
- 0.45101
- MAE
- 0.90677✓
- Conn.
- 0.91173✓
- MGE
- 0.11198✓
- MAE
- 0.02944✓
- Conn.
- 0.02949✓
- MGE
- 0.12912
- MAE
- 0.08314
- Conn.
- 0.08233
- MGE
- 0.17475
- MAE
- 0.02962
- Conn.
- 0.02905
- MGE
- 0.12194✓
- MAE
- 0.02224✓
- Conn.
- 0.02147✓
- MGE
- 0.11440
- MAE
- 0.29795
- Conn.
- 0.29837
- MGE
- 0.06271✓
- MAE
- 0.21489✓
- Conn.
- 0.21447✓
- MGE
- 0.03113
- MAE
- 0.00814✓
- Conn.
- 0.00763✓
- MGE
- 0.03058✓
- MAE
- 0.00983
- Conn.
- 0.00802
- MGE
- 0.03992✓
- MAE
- 0.01483✓
- Conn.
- 0.01451✓
- MGE
- 0.04706
- MAE
- 0.01840
- Conn.
- 0.01632
- MGE
- 0.01719
- MAE
- 0.00674✓
- Conn.
- 0.00642
- MGE
- 0.01689✓
- MAE
- 0.00690
- Conn.
- 0.00444✓
Methodology
- Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
- Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness, MAE measures pixel-level accuracy, and Connectivity penalises fragmented foreground regions. All three are lower-is-better.
- Scores are shown as ? when no ground-truth matte is available for that image. See the alpha matting evaluation benchmark for details on the evaluation methodology.