Pro Model Self-Host vs Pro Model API

Quantitative comparison: 33 images scored against ground-truth mattes. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.

MetricPro Model Self-HostwithoutBG Pro Model API
MGE (Edge Quality)0.027300.02452 ✓
MAE (Overall Accuracy)0.01113 ✓0.01155

Disclosure: withoutBG includes BiRefNet

withoutBG Open Weights and Pro Model API are routed pipelines. A classifier sends fine strands, soft detail and transparency to withoutBG's own matting model, and hard opaque objects, flat scenes and vehicles to BiRefNet (MIT license), which is part of the pipeline. On this page, 8 of 33 images went to BiRefNet. Pro Model API also runs an edge refiner on the result of either branch, so its BiRefNet-routed images are refined BiRefNet output, not raw BiRefNet. The table splits the scores by route: the first group is what withoutBG's own matting model handled.

ImagesMetricPro Model Self-HostwithoutBG Pro Model API
Routed to withoutBG matting (25)MAE0.00710 ✓0.00804
MGE (edges)0.021070.01973 ✓
Routed to BiRefNet (8)MAE0.023720.02251 ✓
MGE (edges)0.046770.03948 ✓

Per-image averages, lower is better.

Original photo: autumn bouquet vase
Ground Truth alpha matte: autumn bouquet vase
Alpha matte
Pro Model Self-Host alpha matte: autumn bouquet vase
Alpha matte
withoutBG Pro Model API alpha matte: autumn bouquet vase
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.04235✓
MAE
0.00729✓
withoutBG Pro Model API
MGE
0.04883
MAE
0.02657
Original photo: balcony flower planter bokeh
Ground Truth alpha matte: balcony flower planter bokeh
Alpha matte
Pro Model Self-Host alpha matte: balcony flower planter bokeh
Alpha matte
withoutBG Pro Model API alpha matte: balcony flower planter bokeh
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.03079
MAE
0.02759✓
withoutBG Pro Model API
MGE
0.02718✓
MAE
0.02784
Original photo: balcony plant bokeh
Ground Truth alpha matte: balcony plant bokeh
Alpha matte
Pro Model Self-Host alpha matte: balcony plant bokeh
Alpha matte
withoutBG Pro Model API alpha matte: balcony plant bokeh
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.04103
MAE
0.00914
withoutBG Pro Model API
MGE
0.03109✓
MAE
0.00737✓
Original photo: bearded man portrait
Ground Truth alpha matte: bearded man portrait
Alpha matte
Pro Model Self-Host alpha matte: bearded man portrait
Alpha matte
withoutBG Pro Model API alpha matte: bearded man portrait
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.00787✓
MAE
0.00233✓
withoutBG Pro Model API
MGE
0.01019
MAE
0.00417
Original photo: bike handlebar near beach
Ground Truth alpha matte: bike handlebar near beach
Alpha matte
Pro Model Self-Host alpha matte: bike handlebar near beach
Alpha matte
withoutBG Pro Model API alpha matte: bike handlebar near beach
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.02477
MAE
0.00826
withoutBG Pro Model API
MGE
0.01637✓
MAE
0.00623✓
Original photo: blowing dandelion seeds
Ground Truth alpha matte: blowing dandelion seeds
Alpha matte
Pro Model Self-Host alpha matte: blowing dandelion seeds
Alpha matte
withoutBG Pro Model API alpha matte: blowing dandelion seeds
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.02389
MAE
0.01407
withoutBG Pro Model API
MGE
0.01948✓
MAE
0.01161✓
Original photo: campfire flames night
Ground Truth alpha matte: campfire flames night
Alpha matte
Pro Model Self-Host alpha matte: campfire flames night
Alpha matte
withoutBG Pro Model API alpha matte: campfire flames night
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01250
MAE
0.00669
withoutBG Pro Model API
MGE
0.00847✓
MAE
0.00568✓
Original photo: cargo ebike park tracks
Ground Truth alpha matte: cargo ebike park tracks
Alpha matte
Pro Model Self-Host alpha matte: cargo ebike park tracks
Alpha matte
withoutBG Pro Model API alpha matte: cargo ebike park tracks
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.07267
MAE
0.01349
withoutBG Pro Model API
MGE
0.05622✓
MAE
0.01045✓
Original photo: compound leaf raindrops
Ground Truth alpha matte: compound leaf raindrops
Alpha matte
Pro Model Self-Host alpha matte: compound leaf raindrops
Alpha matte
withoutBG Pro Model API alpha matte: compound leaf raindrops
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01961
MAE
0.00347
withoutBG Pro Model API
MGE
0.01093✓
MAE
0.00269✓
Original photo: confetti sunset portrait
Ground Truth alpha matte: confetti sunset portrait
Alpha matte
Pro Model Self-Host alpha matte: confetti sunset portrait
Alpha matte
withoutBG Pro Model API alpha matte: confetti sunset portrait
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.02067
MAE
0.00736
withoutBG Pro Model API
MGE
0.01840✓
MAE
0.00573✓
Original photo: dried flowers clay vase
Ground Truth alpha matte: dried flowers clay vase
Alpha matte
Pro Model Self-Host alpha matte: dried flowers clay vase
Alpha matte
withoutBG Pro Model API alpha matte: dried flowers clay vase
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01451✓
MAE
0.00288✓
withoutBG Pro Model API
MGE
0.03249
MAE
0.00736
Original photo: elderly man running blur
Ground Truth alpha matte: elderly man running blur
Alpha matte
Pro Model Self-Host alpha matte: elderly man running blur
Alpha matte
withoutBG Pro Model API alpha matte: elderly man running blur
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01127
MAE
0.00337
withoutBG Pro Model API
MGE
0.00875✓
MAE
0.00277✓
Original photo: grass seed stem bokeh
Ground Truth alpha matte: grass seed stem bokeh
Alpha matte
Pro Model Self-Host alpha matte: grass seed stem bokeh
Alpha matte
withoutBG Pro Model API alpha matte: grass seed stem bokeh
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.02593
MAE
0.00883
withoutBG Pro Model API
MGE
0.01731✓
MAE
0.00686✓
Original photo: hanging plant window
Ground Truth alpha matte: hanging plant window
Alpha matte
Pro Model Self-Host alpha matte: hanging plant window
Alpha matte
withoutBG Pro Model API alpha matte: hanging plant window
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.05422
MAE
0.01279
withoutBG Pro Model API
MGE
0.03829✓
MAE
0.00902✓
Original photo: messy bun cityscape
Ground Truth alpha matte: messy bun cityscape
Alpha matte
Pro Model Self-Host alpha matte: messy bun cityscape
Alpha matte
withoutBG Pro Model API alpha matte: messy bun cityscape
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.00720✓
MAE
0.00366✓
withoutBG Pro Model API
MGE
0.01169
MAE
0.00809
Original photo: messy hair bearded portrait
Ground Truth alpha matte: messy hair bearded portrait
Alpha matte
Pro Model Self-Host alpha matte: messy hair bearded portrait
Alpha matte
withoutBG Pro Model API alpha matte: messy hair bearded portrait
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.00829✓
MAE
0.00407✓
withoutBG Pro Model API
MGE
0.01494
MAE
0.00935
Original photo: orange berries branch
Ground Truth alpha matte: orange berries branch
Alpha matte
Pro Model Self-Host alpha matte: orange berries branch
Alpha matte
withoutBG Pro Model API alpha matte: orange berries branch
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.05502
MAE
0.02375
withoutBG Pro Model API
MGE
0.04750✓
MAE
0.02279✓
Original photo: red flower balcony bokeh
Ground Truth alpha matte: red flower balcony bokeh
Alpha matte
Pro Model Self-Host alpha matte: red flower balcony bokeh
Alpha matte
withoutBG Pro Model API alpha matte: red flower balcony bokeh
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.02213
MAE
0.00621
withoutBG Pro Model API
MGE
0.01295✓
MAE
0.00349✓
Original photo: small fishing boat bw
Ground Truth alpha matte: small fishing boat bw
Alpha matte
Pro Model Self-Host alpha matte: small fishing boat bw
Alpha matte
withoutBG Pro Model API alpha matte: small fishing boat bw
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.02146
MAE
0.00546
withoutBG Pro Model API
MGE
0.01832✓
MAE
0.00467✓
Original photo: smiling man seaside sunset
Ground Truth alpha matte: smiling man seaside sunset
Alpha matte
Pro Model Self-Host alpha matte: smiling man seaside sunset
Alpha matte
withoutBG Pro Model API alpha matte: smiling man seaside sunset
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.00508✓
MAE
0.00117✓
withoutBG Pro Model API
MGE
0.00538
MAE
0.00156
Original photo: smiling woman seaside
Ground Truth alpha matte: smiling woman seaside
Alpha matte
Pro Model Self-Host alpha matte: smiling woman seaside
Alpha matte
withoutBG Pro Model API alpha matte: smiling woman seaside
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.00974✓
MAE
0.00278✓
withoutBG Pro Model API
MGE
0.01100
MAE
0.00401
Original photo: spoked bike wheel
Ground Truth alpha matte: spoked bike wheel
Alpha matte
Pro Model Self-Host alpha matte: spoked bike wheel
Alpha matte
withoutBG Pro Model API alpha matte: spoked bike wheel
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.04221
MAE
0.00769
withoutBG Pro Model API
MGE
0.03351✓
MAE
0.00533✓
Original photo: sprinter motion blur
Ground Truth alpha matte: sprinter motion blur
Alpha matte
Pro Model Self-Host alpha matte: sprinter motion blur
Alpha matte
withoutBG Pro Model API alpha matte: sprinter motion blur
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.02093
MAE
0.02595
withoutBG Pro Model API
MGE
0.01620✓
MAE
0.01785✓
Original photo: street dancer studio pose
Ground Truth alpha matte: street dancer studio pose
Alpha matte
Pro Model Self-Host alpha matte: street dancer studio pose
Alpha matte
withoutBG Pro Model API alpha matte: street dancer studio pose
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01223
MAE
0.00217
withoutBG Pro Model API
MGE
0.01196✓
MAE
0.00207✓
Original photo: street portrait man
Ground Truth alpha matte: street portrait man
Alpha matte
Pro Model Self-Host alpha matte: street portrait man
Alpha matte
withoutBG Pro Model API alpha matte: street portrait man
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.00706
MAE
0.00208
withoutBG Pro Model API
MGE
0.00331✓
MAE
0.00072✓
Original photo: sunset field portrait
Ground Truth alpha matte: sunset field portrait
Alpha matte
Pro Model Self-Host alpha matte: sunset field portrait
Alpha matte
withoutBG Pro Model API alpha matte: sunset field portrait
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01306✓
MAE
0.00461✓
withoutBG Pro Model API
MGE
0.01312
MAE
0.00520
Original photo: tabby cat portrait
Ground Truth alpha matte: tabby cat portrait
Alpha matte
Pro Model Self-Host alpha matte: tabby cat portrait
Alpha matte
withoutBG Pro Model API alpha matte: tabby cat portrait
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.02230
MAE
0.00585
withoutBG Pro Model API
MGE
0.01019✓
MAE
0.00435✓
Original photo: terrier dog mugshot
Ground Truth alpha matte: terrier dog mugshot
Alpha matte
Pro Model Self-Host alpha matte: terrier dog mugshot
Alpha matte
withoutBG Pro Model API alpha matte: terrier dog mugshot
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01365✓
MAE
0.00765✓
withoutBG Pro Model API
MGE
0.02308
MAE
0.01728
Original photo: two bikes field
Ground Truth alpha matte: two bikes field
Alpha matte
Pro Model Self-Host alpha matte: two bikes field
Alpha matte
withoutBG Pro Model API alpha matte: two bikes field
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.07300✓
MAE
0.09074✓
withoutBG Pro Model API
MGE
0.07849
MAE
0.09378
Original photo: two gravel bikes park
Ground Truth alpha matte: two gravel bikes park
Alpha matte
Pro Model Self-Host alpha matte: two gravel bikes park
Alpha matte
withoutBG Pro Model API alpha matte: two gravel bikes park
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.12568
MAE
0.02596✓
withoutBG Pro Model API
MGE
0.11914✓
MAE
0.02727
Original photo: windblown curly hair backpack
Ground Truth alpha matte: windblown curly hair backpack
Alpha matte
Pro Model Self-Host alpha matte: windblown curly hair backpack
Alpha matte
withoutBG Pro Model API alpha matte: windblown curly hair backpack
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.00738
MAE
0.00313
withoutBG Pro Model API
MGE
0.00481✓
MAE
0.00187✓
Original photo: windblown curly portrait
Ground Truth alpha matte: windblown curly portrait
Alpha matte
Pro Model Self-Host alpha matte: windblown curly portrait
Alpha matte
withoutBG Pro Model API alpha matte: windblown curly portrait
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01874
MAE
0.00986
withoutBG Pro Model API
MGE
0.01195✓
MAE
0.00431✓
Original photo: woman street portrait glasses
Ground Truth alpha matte: woman street portrait glasses
Alpha matte
Pro Model Self-Host alpha matte: woman street portrait glasses
Alpha matte
withoutBG Pro Model API alpha matte: woman street portrait glasses
Alpha matte
Original
Ground Truth
Pro Model Self-Host
MGE
0.01355✓
MAE
0.00682✓
withoutBG Pro Model API
MGE
0.01769
MAE
0.01273

Methodology

  • Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
  • Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness and MAE measures pixel-level accuracy. Both are lower-is-better.
  • Scored images come from Bench v0, where every image has a ground-truth matte. The benchmark page has the full methodology and per-image scores for every model (CSV / JSON).