withoutBG Open Weights
Open weights · commercially permissiveLicense: Apache-2.0
BiRefNet General
Open weights · commercially permissiveLicense: MIT

withoutBG Open-Weight Model vs BiRefNet General

Quantitative comparison: 33 images scored against ground-truth mattes. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.

MetricwithoutBG Open-Weight ModelBiRefNet General
MGE (Edge Quality)0.034570.03384 ✓
MAE (Overall Accuracy)0.01317 ✓0.01691

Disclosure: withoutBG includes BiRefNet

withoutBG Open Weights and Pro Model API are routed pipelines. A classifier sends fine strands, soft detail and transparency to withoutBG's own matting model, and hard opaque objects, flat scenes and vehicles to BiRefNet (MIT license), which is part of the pipeline. On this page, 8 of 33 images went to BiRefNet, so on those images this page partly compares BiRefNet with BiRefNet. The table splits the scores by route: the first group is what withoutBG's own matting model handled.

ImagesMetricwithoutBG Open-Weight ModelBiRefNet General
Routed to withoutBG matting (25)MAE0.00988 ✓0.01464
MGE (edges)0.031280.03039 ✓
Routed to BiRefNet (8)MAE0.02343 ✓0.02400
MGE (edges)0.044870.04462 ✓

Per-image averages, lower is better.

Original photo: autumn bouquet vase
Ground Truth alpha matte: autumn bouquet vase
Alpha matte
withoutBG Open-Weight Model alpha matte: autumn bouquet vase
Alpha matte
BiRefNet General alpha matte: autumn bouquet vase
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.07595
MAE
0.02381
BiRefNet General
MGE
0.03450✓
MAE
0.00754✓
Original photo: balcony flower planter bokeh
Ground Truth alpha matte: balcony flower planter bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: balcony flower planter bokeh
Alpha matte
BiRefNet General alpha matte: balcony flower planter bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03402
MAE
0.02906
BiRefNet General
MGE
0.03391✓
MAE
0.02906✓
Original photo: balcony plant bokeh
Ground Truth alpha matte: balcony plant bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: balcony plant bokeh
Alpha matte
BiRefNet General alpha matte: balcony plant bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04621
MAE
0.01031
BiRefNet General
MGE
0.03369✓
MAE
0.00657✓
Original photo: bearded man portrait
Ground Truth alpha matte: bearded man portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: bearded man portrait
Alpha matte
BiRefNet General alpha matte: bearded man portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01697
MAE
0.00407✓
BiRefNet General
MGE
0.01534✓
MAE
0.00932
Original photo: bike handlebar near beach
Ground Truth alpha matte: bike handlebar near beach
Alpha matte
withoutBG Open-Weight Model alpha matte: bike handlebar near beach
Alpha matte
BiRefNet General alpha matte: bike handlebar near beach
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01899
MAE
0.00660✓
BiRefNet General
MGE
0.01776✓
MAE
0.00662
Original photo: blowing dandelion seeds
Ground Truth alpha matte: blowing dandelion seeds
Alpha matte
withoutBG Open-Weight Model alpha matte: blowing dandelion seeds
Alpha matte
BiRefNet General alpha matte: blowing dandelion seeds
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04118✓
MAE
0.01690✓
BiRefNet General
MGE
0.05518
MAE
0.02445
Original photo: campfire flames night
Ground Truth alpha matte: campfire flames night
Alpha matte
withoutBG Open-Weight Model alpha matte: campfire flames night
Alpha matte
BiRefNet General alpha matte: campfire flames night
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01469✓
MAE
0.00695✓
BiRefNet General
MGE
0.02070
MAE
0.00960
Original photo: cargo ebike park tracks
Ground Truth alpha matte: cargo ebike park tracks
Alpha matte
withoutBG Open-Weight Model alpha matte: cargo ebike park tracks
Alpha matte
BiRefNet General alpha matte: cargo ebike park tracks
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.06638
MAE
0.01242✓
BiRefNet General
MGE
0.06499✓
MAE
0.01274
Original photo: compound leaf raindrops
Ground Truth alpha matte: compound leaf raindrops
Alpha matte
withoutBG Open-Weight Model alpha matte: compound leaf raindrops
Alpha matte
BiRefNet General alpha matte: compound leaf raindrops
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02498
MAE
0.00460
BiRefNet General
MGE
0.01420✓
MAE
0.00333✓
Original photo: confetti sunset portrait
Ground Truth alpha matte: confetti sunset portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: confetti sunset portrait
Alpha matte
BiRefNet General alpha matte: confetti sunset portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03139✓
MAE
0.00959✓
BiRefNet General
MGE
0.03582
MAE
0.01162
Original photo: dried flowers clay vase
Ground Truth alpha matte: dried flowers clay vase
Alpha matte
withoutBG Open-Weight Model alpha matte: dried flowers clay vase
Alpha matte
BiRefNet General alpha matte: dried flowers clay vase
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03577
MAE
0.00660✓
BiRefNet General
MGE
0.02967✓
MAE
0.00716
Original photo: elderly man running blur
Ground Truth alpha matte: elderly man running blur
Alpha matte
withoutBG Open-Weight Model alpha matte: elderly man running blur
Alpha matte
BiRefNet General alpha matte: elderly man running blur
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01789
MAE
0.00452✓
BiRefNet General
MGE
0.01780✓
MAE
0.00511
Original photo: grass seed stem bokeh
Ground Truth alpha matte: grass seed stem bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: grass seed stem bokeh
Alpha matte
BiRefNet General alpha matte: grass seed stem bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03015
MAE
0.01049
BiRefNet General
MGE
0.02221✓
MAE
0.00778✓
Original photo: hanging plant window
Ground Truth alpha matte: hanging plant window
Alpha matte
withoutBG Open-Weight Model alpha matte: hanging plant window
Alpha matte
BiRefNet General alpha matte: hanging plant window
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.05026
MAE
0.01100✓
BiRefNet General
MGE
0.04873✓
MAE
0.01122
Original photo: messy bun cityscape
Ground Truth alpha matte: messy bun cityscape
Alpha matte
withoutBG Open-Weight Model alpha matte: messy bun cityscape
Alpha matte
BiRefNet General alpha matte: messy bun cityscape
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01835
MAE
0.00586✓
BiRefNet General
MGE
0.01818✓
MAE
0.00827
Original photo: messy hair bearded portrait
Ground Truth alpha matte: messy hair bearded portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: messy hair bearded portrait
Alpha matte
BiRefNet General alpha matte: messy hair bearded portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01551✓
MAE
0.00578✓
BiRefNet General
MGE
0.01969
MAE
0.01374
Original photo: orange berries branch
Ground Truth alpha matte: orange berries branch
Alpha matte
withoutBG Open-Weight Model alpha matte: orange berries branch
Alpha matte
BiRefNet General alpha matte: orange berries branch
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.05432✓
MAE
0.02385✓
BiRefNet General
MGE
0.05570
MAE
0.02558
Original photo: red flower balcony bokeh
Ground Truth alpha matte: red flower balcony bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: red flower balcony bokeh
Alpha matte
BiRefNet General alpha matte: red flower balcony bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02832
MAE
0.01777
BiRefNet General
MGE
0.01467✓
MAE
0.00332✓
Original photo: small fishing boat bw
Ground Truth alpha matte: small fishing boat bw
Alpha matte
withoutBG Open-Weight Model alpha matte: small fishing boat bw
Alpha matte
BiRefNet General alpha matte: small fishing boat bw
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02225
MAE
0.00549✓
BiRefNet General
MGE
0.02090✓
MAE
0.00612
Original photo: smiling man seaside sunset
Ground Truth alpha matte: smiling man seaside sunset
Alpha matte
withoutBG Open-Weight Model alpha matte: smiling man seaside sunset
Alpha matte
BiRefNet General alpha matte: smiling man seaside sunset
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01052
MAE
0.00205✓
BiRefNet General
MGE
0.00619✓
MAE
0.00277
Original photo: smiling woman seaside
Ground Truth alpha matte: smiling woman seaside
Alpha matte
withoutBG Open-Weight Model alpha matte: smiling woman seaside
Alpha matte
BiRefNet General alpha matte: smiling woman seaside
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02272
MAE
0.00521✓
BiRefNet General
MGE
0.01810✓
MAE
0.00714
Original photo: spoked bike wheel
Ground Truth alpha matte: spoked bike wheel
Alpha matte
withoutBG Open-Weight Model alpha matte: spoked bike wheel
Alpha matte
BiRefNet General alpha matte: spoked bike wheel
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03536
MAE
0.00578✓
BiRefNet General
MGE
0.03517✓
MAE
0.00648
Original photo: sprinter motion blur
Ground Truth alpha matte: sprinter motion blur
Alpha matte
withoutBG Open-Weight Model alpha matte: sprinter motion blur
Alpha matte
BiRefNet General alpha matte: sprinter motion blur
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02418✓
MAE
0.02733✓
BiRefNet General
MGE
0.02895
MAE
0.02783
Original photo: street dancer studio pose
Ground Truth alpha matte: street dancer studio pose
Alpha matte
withoutBG Open-Weight Model alpha matte: street dancer studio pose
Alpha matte
BiRefNet General alpha matte: street dancer studio pose
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02203
MAE
0.00368
BiRefNet General
MGE
0.01442✓
MAE
0.00315✓
Original photo: street portrait man
Ground Truth alpha matte: street portrait man
Alpha matte
withoutBG Open-Weight Model alpha matte: street portrait man
Alpha matte
BiRefNet General alpha matte: street portrait man
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01403
MAE
0.00312✓
BiRefNet General
MGE
0.01079✓
MAE
0.00372
Original photo: sunset field portrait
Ground Truth alpha matte: sunset field portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: sunset field portrait
Alpha matte
BiRefNet General alpha matte: sunset field portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02054
MAE
0.00590✓
BiRefNet General
MGE
0.01879✓
MAE
0.00851
Original photo: tabby cat portrait
Ground Truth alpha matte: tabby cat portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: tabby cat portrait
Alpha matte
BiRefNet General alpha matte: tabby cat portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02730✓
MAE
0.00734✓
BiRefNet General
MGE
0.04204
MAE
0.07583
Original photo: terrier dog mugshot
Ground Truth alpha matte: terrier dog mugshot
Alpha matte
withoutBG Open-Weight Model alpha matte: terrier dog mugshot
Alpha matte
BiRefNet General alpha matte: terrier dog mugshot
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02940✓
MAE
0.01110✓
BiRefNet General
MGE
0.09392
MAE
0.06015
Original photo: two bikes field
Ground Truth alpha matte: two bikes field
Alpha matte
withoutBG Open-Weight Model alpha matte: two bikes field
Alpha matte
BiRefNet General alpha matte: two bikes field
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.07739✓
MAE
0.09324✓
BiRefNet General
MGE
0.07979
MAE
0.09417
Original photo: two gravel bikes park
Ground Truth alpha matte: two gravel bikes park
Alpha matte
withoutBG Open-Weight Model alpha matte: two gravel bikes park
Alpha matte
BiRefNet General alpha matte: two gravel bikes park
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.13603
MAE
0.02861
BiRefNet General
MGE
0.09319✓
MAE
0.01831✓
Original photo: windblown curly hair backpack
Ground Truth alpha matte: windblown curly hair backpack
Alpha matte
withoutBG Open-Weight Model alpha matte: windblown curly hair backpack
Alpha matte
BiRefNet General alpha matte: windblown curly hair backpack
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02353✓
MAE
0.00573✓
BiRefNet General
MGE
0.03339
MAE
0.01185
Original photo: windblown curly portrait
Ground Truth alpha matte: windblown curly portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: windblown curly portrait
Alpha matte
BiRefNet General alpha matte: windblown curly portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03757✓
MAE
0.01221✓
BiRefNet General
MGE
0.04978
MAE
0.01930
Original photo: woman street portrait glasses
Ground Truth alpha matte: woman street portrait glasses
Alpha matte
withoutBG Open-Weight Model alpha matte: woman street portrait glasses
Alpha matte
BiRefNet General alpha matte: woman street portrait glasses
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01677✓
MAE
0.00759✓
BiRefNet General
MGE
0.01854
MAE
0.00954

Methodology

  • Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
  • Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness and MAE measures pixel-level accuracy. Both are lower-is-better.
  • Scored images come from Bench v0, where every image has a ground-truth matte. The benchmark page has the full methodology and per-image scores for every model (CSV / JSON).