BiRefNet General
Open weights · commercially permissiveLicense: MIT
IS-Net
Open weights · commercially permissiveLicense: Apache-2.0

BiRefNet General vs IS-Net

Quantitative comparison: 33 images scored against ground-truth mattes. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.

MetricBiRefNet GeneralIS-Net
MGE (Edge Quality)0.03384 ✓0.04561
MAE (Overall Accuracy)0.01691 ✓0.04096
Original photo: autumn bouquet vase
Ground Truth alpha matte: autumn bouquet vase
Alpha matte
BiRefNet General alpha matte: autumn bouquet vase
Alpha matte
IS-Net alpha matte: autumn bouquet vase
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.03450✓
MAE
0.00754✓
IS-Net
MGE
0.07715
MAE
0.06843
Original photo: balcony flower planter bokeh
Ground Truth alpha matte: balcony flower planter bokeh
Alpha matte
BiRefNet General alpha matte: balcony flower planter bokeh
Alpha matte
IS-Net alpha matte: balcony flower planter bokeh
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.03391✓
MAE
0.02906✓
IS-Net
MGE
0.03648
MAE
0.22345
Original photo: balcony plant bokeh
Ground Truth alpha matte: balcony plant bokeh
Alpha matte
BiRefNet General alpha matte: balcony plant bokeh
Alpha matte
IS-Net alpha matte: balcony plant bokeh
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.03369✓
MAE
0.00657✓
IS-Net
MGE
0.04986
MAE
0.04518
Original photo: bearded man portrait
Ground Truth alpha matte: bearded man portrait
Alpha matte
BiRefNet General alpha matte: bearded man portrait
Alpha matte
IS-Net alpha matte: bearded man portrait
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01534✓
MAE
0.00932✓
IS-Net
MGE
0.02351
MAE
0.01318
Original photo: bike handlebar near beach
Ground Truth alpha matte: bike handlebar near beach
Alpha matte
BiRefNet General alpha matte: bike handlebar near beach
Alpha matte
IS-Net alpha matte: bike handlebar near beach
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01776
MAE
0.00662
IS-Net
MGE
0.01766✓
MAE
0.00398✓
Original photo: blowing dandelion seeds
Ground Truth alpha matte: blowing dandelion seeds
Alpha matte
BiRefNet General alpha matte: blowing dandelion seeds
Alpha matte
IS-Net alpha matte: blowing dandelion seeds
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.05518✓
MAE
0.02445✓
IS-Net
MGE
0.06260
MAE
0.03047
Original photo: campfire flames night
Ground Truth alpha matte: campfire flames night
Alpha matte
BiRefNet General alpha matte: campfire flames night
Alpha matte
IS-Net alpha matte: campfire flames night
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.02070✓
MAE
0.00960✓
IS-Net
MGE
0.02829
MAE
0.02992
Original photo: cargo ebike park tracks
Ground Truth alpha matte: cargo ebike park tracks
Alpha matte
BiRefNet General alpha matte: cargo ebike park tracks
Alpha matte
IS-Net alpha matte: cargo ebike park tracks
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.06499✓
MAE
0.01274✓
IS-Net
MGE
0.06714
MAE
0.01656
Original photo: compound leaf raindrops
Ground Truth alpha matte: compound leaf raindrops
Alpha matte
BiRefNet General alpha matte: compound leaf raindrops
Alpha matte
IS-Net alpha matte: compound leaf raindrops
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01420✓
MAE
0.00333✓
IS-Net
MGE
0.01933
MAE
0.05531
Original photo: confetti sunset portrait
Ground Truth alpha matte: confetti sunset portrait
Alpha matte
BiRefNet General alpha matte: confetti sunset portrait
Alpha matte
IS-Net alpha matte: confetti sunset portrait
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.03582✓
MAE
0.01162✓
IS-Net
MGE
0.04392
MAE
0.02047
Original photo: dried flowers clay vase
Ground Truth alpha matte: dried flowers clay vase
Alpha matte
BiRefNet General alpha matte: dried flowers clay vase
Alpha matte
IS-Net alpha matte: dried flowers clay vase
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.02967✓
MAE
0.00716✓
IS-Net
MGE
0.03653
MAE
0.00970
Original photo: elderly man running blur
Ground Truth alpha matte: elderly man running blur
Alpha matte
BiRefNet General alpha matte: elderly man running blur
Alpha matte
IS-Net alpha matte: elderly man running blur
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01780
MAE
0.00511✓
IS-Net
MGE
0.01503✓
MAE
0.00604
Original photo: grass seed stem bokeh
Ground Truth alpha matte: grass seed stem bokeh
Alpha matte
BiRefNet General alpha matte: grass seed stem bokeh
Alpha matte
IS-Net alpha matte: grass seed stem bokeh
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.02221✓
MAE
0.00778✓
IS-Net
MGE
0.02520
MAE
0.01193
Original photo: hanging plant window
Ground Truth alpha matte: hanging plant window
Alpha matte
BiRefNet General alpha matte: hanging plant window
Alpha matte
IS-Net alpha matte: hanging plant window
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.04873✓
MAE
0.01122✓
IS-Net
MGE
0.07112
MAE
0.08266
Original photo: messy bun cityscape
Ground Truth alpha matte: messy bun cityscape
Alpha matte
BiRefNet General alpha matte: messy bun cityscape
Alpha matte
IS-Net alpha matte: messy bun cityscape
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01818✓
MAE
0.00827✓
IS-Net
MGE
0.04351
MAE
0.02656
Original photo: messy hair bearded portrait
Ground Truth alpha matte: messy hair bearded portrait
Alpha matte
BiRefNet General alpha matte: messy hair bearded portrait
Alpha matte
IS-Net alpha matte: messy hair bearded portrait
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01969✓
MAE
0.01374✓
IS-Net
MGE
0.03194
MAE
0.02655
Original photo: orange berries branch
Ground Truth alpha matte: orange berries branch
Alpha matte
BiRefNet General alpha matte: orange berries branch
Alpha matte
IS-Net alpha matte: orange berries branch
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.05570✓
MAE
0.02558✓
IS-Net
MGE
0.10276
MAE
0.25500
Original photo: red flower balcony bokeh
Ground Truth alpha matte: red flower balcony bokeh
Alpha matte
BiRefNet General alpha matte: red flower balcony bokeh
Alpha matte
IS-Net alpha matte: red flower balcony bokeh
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01467✓
MAE
0.00332✓
IS-Net
MGE
0.04162
MAE
0.05030
Original photo: small fishing boat bw
Ground Truth alpha matte: small fishing boat bw
Alpha matte
BiRefNet General alpha matte: small fishing boat bw
Alpha matte
IS-Net alpha matte: small fishing boat bw
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.02090✓
MAE
0.00612✓
IS-Net
MGE
0.03081
MAE
0.01417
Original photo: smiling man seaside sunset
Ground Truth alpha matte: smiling man seaside sunset
Alpha matte
BiRefNet General alpha matte: smiling man seaside sunset
Alpha matte
IS-Net alpha matte: smiling man seaside sunset
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.00619✓
MAE
0.00277✓
IS-Net
MGE
0.01433
MAE
0.01354
Original photo: smiling woman seaside
Ground Truth alpha matte: smiling woman seaside
Alpha matte
BiRefNet General alpha matte: smiling woman seaside
Alpha matte
IS-Net alpha matte: smiling woman seaside
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01810✓
MAE
0.00714✓
IS-Net
MGE
0.03714
MAE
0.02013
Original photo: spoked bike wheel
Ground Truth alpha matte: spoked bike wheel
Alpha matte
BiRefNet General alpha matte: spoked bike wheel
Alpha matte
IS-Net alpha matte: spoked bike wheel
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.03517✓
MAE
0.00648✓
IS-Net
MGE
0.03730
MAE
0.00761
Original photo: sprinter motion blur
Ground Truth alpha matte: sprinter motion blur
Alpha matte
BiRefNet General alpha matte: sprinter motion blur
Alpha matte
IS-Net alpha matte: sprinter motion blur
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.02895
MAE
0.02783✓
IS-Net
MGE
0.02320✓
MAE
0.03234
Original photo: street dancer studio pose
Ground Truth alpha matte: street dancer studio pose
Alpha matte
BiRefNet General alpha matte: street dancer studio pose
Alpha matte
IS-Net alpha matte: street dancer studio pose
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01442✓
MAE
0.00315✓
IS-Net
MGE
0.01773
MAE
0.00400
Original photo: street portrait man
Ground Truth alpha matte: street portrait man
Alpha matte
BiRefNet General alpha matte: street portrait man
Alpha matte
IS-Net alpha matte: street portrait man
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01079✓
MAE
0.00372✓
IS-Net
MGE
0.01768
MAE
0.00610
Original photo: sunset field portrait
Ground Truth alpha matte: sunset field portrait
Alpha matte
BiRefNet General alpha matte: sunset field portrait
Alpha matte
IS-Net alpha matte: sunset field portrait
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01879✓
MAE
0.00851✓
IS-Net
MGE
0.03757
MAE
0.02450
Original photo: tabby cat portrait
Ground Truth alpha matte: tabby cat portrait
Alpha matte
BiRefNet General alpha matte: tabby cat portrait
Alpha matte
IS-Net alpha matte: tabby cat portrait
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.04204✓
MAE
0.07583
IS-Net
MGE
0.04486
MAE
0.02457✓
Original photo: terrier dog mugshot
Ground Truth alpha matte: terrier dog mugshot
Alpha matte
BiRefNet General alpha matte: terrier dog mugshot
Alpha matte
IS-Net alpha matte: terrier dog mugshot
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.09392✓
MAE
0.06015
IS-Net
MGE
0.09884
MAE
0.05848✓
Original photo: two bikes field
Ground Truth alpha matte: two bikes field
Alpha matte
BiRefNet General alpha matte: two bikes field
Alpha matte
IS-Net alpha matte: two bikes field
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.07979
MAE
0.09417
IS-Net
MGE
0.07771✓
MAE
0.02836✓
Original photo: two gravel bikes park
Ground Truth alpha matte: two gravel bikes park
Alpha matte
BiRefNet General alpha matte: two gravel bikes park
Alpha matte
IS-Net alpha matte: two gravel bikes park
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.09319✓
MAE
0.01831✓
IS-Net
MGE
0.09445
MAE
0.01978
Original photo: windblown curly hair backpack
Ground Truth alpha matte: windblown curly hair backpack
Alpha matte
BiRefNet General alpha matte: windblown curly hair backpack
Alpha matte
IS-Net alpha matte: windblown curly hair backpack
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.03339✓
MAE
0.01185✓
IS-Net
MGE
0.06352
MAE
0.02465
Original photo: windblown curly portrait
Ground Truth alpha matte: windblown curly portrait
Alpha matte
BiRefNet General alpha matte: windblown curly portrait
Alpha matte
IS-Net alpha matte: windblown curly portrait
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.04978✓
MAE
0.01930✓
IS-Net
MGE
0.08990
MAE
0.07705
Original photo: woman street portrait glasses
Ground Truth alpha matte: woman street portrait glasses
Alpha matte
BiRefNet General alpha matte: woman street portrait glasses
Alpha matte
IS-Net alpha matte: woman street portrait glasses
Alpha matte
Original
Ground Truth
BiRefNet General
MGE
0.01854✓
MAE
0.00954✓
IS-Net
MGE
0.02635
MAE
0.02086

Methodology

  • Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
  • Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness and MAE measures pixel-level accuracy. Both are lower-is-better.
  • Scored images come from Bench v0, where every image has a ground-truth matte. The benchmark page has the full methodology and per-image scores for every model (CSV / JSON).