withoutBG Open Weights
Open weights · commercially permissiveLicense: Apache-2.0
BiRefNet Portrait
Open weights · commercially permissiveLicense: MIT

withoutBG Open-Weight Model vs birefnet-portrait

Quantitative comparison: 33 images scored against ground-truth mattes. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.

MetricwithoutBG Open-Weight Modelbirefnet-portrait
MGE (Edge Quality)0.03457 ✓0.04243
MAE (Overall Accuracy)0.01317 ✓0.05090

Disclosure: withoutBG includes BiRefNet

withoutBG Open Weights and Pro Model API are routed pipelines. A classifier sends fine strands, soft detail and transparency to withoutBG's own matting model, and hard opaque objects, flat scenes and vehicles to BiRefNet (MIT license), which is part of the pipeline. On this page, 8 of 33 images went to BiRefNet, so on those images this page partly compares BiRefNet with BiRefNet. The table splits the scores by route: the first group is what withoutBG's own matting model handled.

ImagesMetricwithoutBG Open-Weight Modelbirefnet-portrait
Routed to withoutBG matting (25)MAE0.00988 ✓0.01900
MGE (edges)0.03128 ✓0.03427
Routed to BiRefNet (8)MAE0.02343 ✓0.15057
MGE (edges)0.04487 ✓0.06794

Per-image averages, lower is better.

Original photo: autumn bouquet vase
Ground Truth alpha matte: autumn bouquet vase
Alpha matte
withoutBG Open-Weight Model alpha matte: autumn bouquet vase
Alpha matte
birefnet-portrait alpha matte: autumn bouquet vase
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.07595✓
MAE
0.02381✓
birefnet-portrait
MGE
0.08386
MAE
0.09753
Original photo: balcony flower planter bokeh
Ground Truth alpha matte: balcony flower planter bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: balcony flower planter bokeh
Alpha matte
birefnet-portrait alpha matte: balcony flower planter bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03402✓
MAE
0.02906✓
birefnet-portrait
MGE
0.03811
MAE
0.22692
Original photo: balcony plant bokeh
Ground Truth alpha matte: balcony plant bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: balcony plant bokeh
Alpha matte
birefnet-portrait alpha matte: balcony plant bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04621
MAE
0.01031
birefnet-portrait
MGE
0.04008✓
MAE
0.00974✓
Original photo: bearded man portrait
Ground Truth alpha matte: bearded man portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: bearded man portrait
Alpha matte
birefnet-portrait alpha matte: bearded man portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01697
MAE
0.00407✓
birefnet-portrait
MGE
0.01560✓
MAE
0.00698
Original photo: bike handlebar near beach
Ground Truth alpha matte: bike handlebar near beach
Alpha matte
withoutBG Open-Weight Model alpha matte: bike handlebar near beach
Alpha matte
birefnet-portrait alpha matte: bike handlebar near beach
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01899✓
MAE
0.00660✓
birefnet-portrait
MGE
0.04045
MAE
0.02887
Original photo: blowing dandelion seeds
Ground Truth alpha matte: blowing dandelion seeds
Alpha matte
withoutBG Open-Weight Model alpha matte: blowing dandelion seeds
Alpha matte
birefnet-portrait alpha matte: blowing dandelion seeds
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04118✓
MAE
0.01690✓
birefnet-portrait
MGE
0.05656
MAE
0.03090
Original photo: campfire flames night
Ground Truth alpha matte: campfire flames night
Alpha matte
withoutBG Open-Weight Model alpha matte: campfire flames night
Alpha matte
birefnet-portrait alpha matte: campfire flames night
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01469✓
MAE
0.00695✓
birefnet-portrait
MGE
0.02176
MAE
0.01088
Original photo: cargo ebike park tracks
Ground Truth alpha matte: cargo ebike park tracks
Alpha matte
withoutBG Open-Weight Model alpha matte: cargo ebike park tracks
Alpha matte
birefnet-portrait alpha matte: cargo ebike park tracks
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.06638✓
MAE
0.01242✓
birefnet-portrait
MGE
0.10133
MAE
0.10167
Original photo: compound leaf raindrops
Ground Truth alpha matte: compound leaf raindrops
Alpha matte
withoutBG Open-Weight Model alpha matte: compound leaf raindrops
Alpha matte
birefnet-portrait alpha matte: compound leaf raindrops
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02498
MAE
0.00460
birefnet-portrait
MGE
0.02262✓
MAE
0.00455✓
Original photo: confetti sunset portrait
Ground Truth alpha matte: confetti sunset portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: confetti sunset portrait
Alpha matte
birefnet-portrait alpha matte: confetti sunset portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03139
MAE
0.00959✓
birefnet-portrait
MGE
0.03076✓
MAE
0.00979
Original photo: dried flowers clay vase
Ground Truth alpha matte: dried flowers clay vase
Alpha matte
withoutBG Open-Weight Model alpha matte: dried flowers clay vase
Alpha matte
birefnet-portrait alpha matte: dried flowers clay vase
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03577✓
MAE
0.00660✓
birefnet-portrait
MGE
0.04891
MAE
0.01535
Original photo: elderly man running blur
Ground Truth alpha matte: elderly man running blur
Alpha matte
withoutBG Open-Weight Model alpha matte: elderly man running blur
Alpha matte
birefnet-portrait alpha matte: elderly man running blur
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01789
MAE
0.00452
birefnet-portrait
MGE
0.01050✓
MAE
0.00324✓
Original photo: grass seed stem bokeh
Ground Truth alpha matte: grass seed stem bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: grass seed stem bokeh
Alpha matte
birefnet-portrait alpha matte: grass seed stem bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03015✓
MAE
0.01049✓
birefnet-portrait
MGE
0.03766
MAE
0.02335
Original photo: hanging plant window
Ground Truth alpha matte: hanging plant window
Alpha matte
withoutBG Open-Weight Model alpha matte: hanging plant window
Alpha matte
birefnet-portrait alpha matte: hanging plant window
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.05026✓
MAE
0.01100✓
birefnet-portrait
MGE
0.09709
MAE
0.04888
Original photo: messy bun cityscape
Ground Truth alpha matte: messy bun cityscape
Alpha matte
withoutBG Open-Weight Model alpha matte: messy bun cityscape
Alpha matte
birefnet-portrait alpha matte: messy bun cityscape
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01835✓
MAE
0.00586✓
birefnet-portrait
MGE
0.01919
MAE
0.00875
Original photo: messy hair bearded portrait
Ground Truth alpha matte: messy hair bearded portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: messy hair bearded portrait
Alpha matte
birefnet-portrait alpha matte: messy hair bearded portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01551✓
MAE
0.00578✓
birefnet-portrait
MGE
0.02099
MAE
0.01246
Original photo: orange berries branch
Ground Truth alpha matte: orange berries branch
Alpha matte
withoutBG Open-Weight Model alpha matte: orange berries branch
Alpha matte
birefnet-portrait alpha matte: orange berries branch
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.05432✓
MAE
0.02385✓
birefnet-portrait
MGE
0.07146
MAE
0.22746
Original photo: red flower balcony bokeh
Ground Truth alpha matte: red flower balcony bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: red flower balcony bokeh
Alpha matte
birefnet-portrait alpha matte: red flower balcony bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02832
MAE
0.01777
birefnet-portrait
MGE
0.02543✓
MAE
0.00925✓
Original photo: small fishing boat bw
Ground Truth alpha matte: small fishing boat bw
Alpha matte
withoutBG Open-Weight Model alpha matte: small fishing boat bw
Alpha matte
birefnet-portrait alpha matte: small fishing boat bw
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02225✓
MAE
0.00549✓
birefnet-portrait
MGE
0.05887
MAE
0.32245
Original photo: smiling man seaside sunset
Ground Truth alpha matte: smiling man seaside sunset
Alpha matte
withoutBG Open-Weight Model alpha matte: smiling man seaside sunset
Alpha matte
birefnet-portrait alpha matte: smiling man seaside sunset
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01052
MAE
0.00205✓
birefnet-portrait
MGE
0.00747✓
MAE
0.00291
Original photo: smiling woman seaside
Ground Truth alpha matte: smiling woman seaside
Alpha matte
withoutBG Open-Weight Model alpha matte: smiling woman seaside
Alpha matte
birefnet-portrait alpha matte: smiling woman seaside
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02272
MAE
0.00521✓
birefnet-portrait
MGE
0.02263✓
MAE
0.00842
Original photo: spoked bike wheel
Ground Truth alpha matte: spoked bike wheel
Alpha matte
withoutBG Open-Weight Model alpha matte: spoked bike wheel
Alpha matte
birefnet-portrait alpha matte: spoked bike wheel
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03536✓
MAE
0.00578✓
birefnet-portrait
MGE
0.05296
MAE
0.02716
Original photo: sprinter motion blur
Ground Truth alpha matte: sprinter motion blur
Alpha matte
withoutBG Open-Weight Model alpha matte: sprinter motion blur
Alpha matte
birefnet-portrait alpha matte: sprinter motion blur
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02418
MAE
0.02733
birefnet-portrait
MGE
0.02091✓
MAE
0.02130✓
Original photo: street dancer studio pose
Ground Truth alpha matte: street dancer studio pose
Alpha matte
withoutBG Open-Weight Model alpha matte: street dancer studio pose
Alpha matte
birefnet-portrait alpha matte: street dancer studio pose
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02203
MAE
0.00368
birefnet-portrait
MGE
0.01334✓
MAE
0.00231✓
Original photo: street portrait man
Ground Truth alpha matte: street portrait man
Alpha matte
withoutBG Open-Weight Model alpha matte: street portrait man
Alpha matte
birefnet-portrait alpha matte: street portrait man
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01403
MAE
0.00312✓
birefnet-portrait
MGE
0.01116✓
MAE
0.00319
Original photo: sunset field portrait
Ground Truth alpha matte: sunset field portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: sunset field portrait
Alpha matte
birefnet-portrait alpha matte: sunset field portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02054✓
MAE
0.00590✓
birefnet-portrait
MGE
0.02111
MAE
0.00942
Original photo: tabby cat portrait
Ground Truth alpha matte: tabby cat portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: tabby cat portrait
Alpha matte
birefnet-portrait alpha matte: tabby cat portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02730✓
MAE
0.00734✓
birefnet-portrait
MGE
0.02939
MAE
0.01078
Original photo: terrier dog mugshot
Ground Truth alpha matte: terrier dog mugshot
Alpha matte
withoutBG Open-Weight Model alpha matte: terrier dog mugshot
Alpha matte
birefnet-portrait alpha matte: terrier dog mugshot
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02940✓
MAE
0.01110✓
birefnet-portrait
MGE
0.03867
MAE
0.02312
Original photo: two bikes field
Ground Truth alpha matte: two bikes field
Alpha matte
withoutBG Open-Weight Model alpha matte: two bikes field
Alpha matte
birefnet-portrait alpha matte: two bikes field
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.07739✓
MAE
0.09324✓
birefnet-portrait
MGE
0.08326
MAE
0.22116
Original photo: two gravel bikes park
Ground Truth alpha matte: two gravel bikes park
Alpha matte
withoutBG Open-Weight Model alpha matte: two gravel bikes park
Alpha matte
birefnet-portrait alpha matte: two gravel bikes park
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.13603✓
MAE
0.02861✓
birefnet-portrait
MGE
0.15441
MAE
0.10118
Original photo: windblown curly hair backpack
Ground Truth alpha matte: windblown curly hair backpack
Alpha matte
withoutBG Open-Weight Model alpha matte: windblown curly hair backpack
Alpha matte
birefnet-portrait alpha matte: windblown curly hair backpack
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02353✓
MAE
0.00573✓
birefnet-portrait
MGE
0.03066
MAE
0.01006
Original photo: windblown curly portrait
Ground Truth alpha matte: windblown curly portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: windblown curly portrait
Alpha matte
birefnet-portrait alpha matte: windblown curly portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03757✓
MAE
0.01221✓
birefnet-portrait
MGE
0.05210
MAE
0.02417
Original photo: woman street portrait glasses
Ground Truth alpha matte: woman street portrait glasses
Alpha matte
withoutBG Open-Weight Model alpha matte: woman street portrait glasses
Alpha matte
birefnet-portrait alpha matte: woman street portrait glasses
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01677✓
MAE
0.00759✓
birefnet-portrait
MGE
0.02091
MAE
0.01539

Methodology

  • Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
  • Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness and MAE measures pixel-level accuracy. Both are lower-is-better.
  • Scored images come from Bench v0, where every image has a ground-truth matte. The benchmark page has the full methodology and per-image scores for every model (CSV / JSON).