withoutBG Open-Weight Model vs BiRefNet Lite

37 examples, 37 with ground truth. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.

MetricwithoutBG Open-Weight ModelBiRefNet Lite
MGE (Edge Quality)0.070630.06471
MAE (Overall Accuracy)0.064320.07023
Connectivity0.064060.06953
Original photo: autumn bouquet vase
Ground Truth alpha matte: autumn bouquet vase
Alpha matte
withoutBG Open-Weight Model alpha matte: autumn bouquet vase
Alpha matte
BiRefNet Lite alpha matte: autumn bouquet vase
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.11187
MAE
0.02393
Conn.
0.02366
BiRefNet Lite
MGE
0.09405
MAE
0.05412
Conn.
0.05286
Original photo: balcony flower planter bokeh
Ground Truth alpha matte: balcony flower planter bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: balcony flower planter bokeh
Alpha matte
BiRefNet Lite alpha matte: balcony flower planter bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.07491
MAE
0.20595
Conn.
0.20605
BiRefNet Lite
MGE
0.06966
MAE
0.22546
Conn.
0.22514
Original photo: balcony plant bokeh
Ground Truth alpha matte: balcony plant bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: balcony plant bokeh
Alpha matte
BiRefNet Lite alpha matte: balcony plant bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.07847
MAE
0.01629
Conn.
0.01623
BiRefNet Lite
MGE
0.05811
MAE
0.01380
Conn.
0.01352
Original photo: bearded man portrait
Ground Truth alpha matte: bearded man portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: bearded man portrait
Alpha matte
BiRefNet Lite alpha matte: bearded man portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01863
MAE
0.00476
Conn.
0.00413
BiRefNet Lite
MGE
0.01603
MAE
0.00675
Conn.
0.00448
Original photo: bike handlebar near beach
Ground Truth alpha matte: bike handlebar near beach
Alpha matte
withoutBG Open-Weight Model alpha matte: bike handlebar near beach
Alpha matte
BiRefNet Lite alpha matte: bike handlebar near beach
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04704
MAE
0.00841
Conn.
0.00826
BiRefNet Lite
MGE
0.02569
MAE
0.00423
Conn.
0.00388
Original photo: blowing dandelion seeds
Ground Truth alpha matte: blowing dandelion seeds
Alpha matte
withoutBG Open-Weight Model alpha matte: blowing dandelion seeds
Alpha matte
BiRefNet Lite alpha matte: blowing dandelion seeds
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04385
MAE
0.01141
Conn.
0.01000
BiRefNet Lite
MGE
0.05057
MAE
0.02603
Conn.
0.02438
Original photo: campfire flames night
Ground Truth alpha matte: campfire flames night
Alpha matte
withoutBG Open-Weight Model alpha matte: campfire flames night
Alpha matte
BiRefNet Lite alpha matte: campfire flames night
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03629
MAE
0.01250
Conn.
0.01173
BiRefNet Lite
MGE
0.02148
MAE
0.00553
Conn.
0.00531
Original photo: cargo ebike park tracks
Ground Truth alpha matte: cargo ebike park tracks
Alpha matte
withoutBG Open-Weight Model alpha matte: cargo ebike park tracks
Alpha matte
BiRefNet Lite alpha matte: cargo ebike park tracks
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.12069
MAE
0.01999
Conn.
0.01970
BiRefNet Lite
MGE
0.09089
MAE
0.01577
Conn.
0.01505
Original photo: compound leaf raindrops
Ground Truth alpha matte: compound leaf raindrops
Alpha matte
withoutBG Open-Weight Model alpha matte: compound leaf raindrops
Alpha matte
BiRefNet Lite alpha matte: compound leaf raindrops
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04500
MAE
0.00749
Conn.
0.00713
BiRefNet Lite
MGE
0.02300
MAE
0.00515
Conn.
0.00363
Original photo: confetti sunset portrait
Ground Truth alpha matte: confetti sunset portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: confetti sunset portrait
Alpha matte
BiRefNet Lite alpha matte: confetti sunset portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02821
MAE
0.00834
Conn.
0.00806
BiRefNet Lite
MGE
0.03349
MAE
0.01220
Conn.
0.01098
Original photo: cyclist motion blur field
Ground Truth alpha matte: cyclist motion blur field
Alpha matte
withoutBG Open-Weight Model alpha matte: cyclist motion blur field
Alpha matte
BiRefNet Lite alpha matte: cyclist motion blur field
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.06872
MAE
0.01673
Conn.
0.01649
BiRefNet Lite
MGE
0.06227
MAE
0.01513
Conn.
0.01492
Original photo: dried flowers clay vase
Ground Truth alpha matte: dried flowers clay vase
Alpha matte
withoutBG Open-Weight Model alpha matte: dried flowers clay vase
Alpha matte
BiRefNet Lite alpha matte: dried flowers clay vase
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.06195
MAE
0.01177
Conn.
0.01189
BiRefNet Lite
MGE
0.04786
MAE
0.00988
Conn.
0.00881
Original photo: elderly man running blur
Ground Truth alpha matte: elderly man running blur
Alpha matte
withoutBG Open-Weight Model alpha matte: elderly man running blur
Alpha matte
BiRefNet Lite alpha matte: elderly man running blur
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02073
MAE
0.00482
Conn.
0.00464
BiRefNet Lite
MGE
0.01651
MAE
0.00767
Conn.
0.00683
Original photo: grass seed stem bokeh
Ground Truth alpha matte: grass seed stem bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: grass seed stem bokeh
Alpha matte
BiRefNet Lite alpha matte: grass seed stem bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.06311
MAE
0.01859
Conn.
0.01844
BiRefNet Lite
MGE
0.04112
MAE
0.00958
Conn.
0.00951
Original photo: hanging plant window
Ground Truth alpha matte: hanging plant window
Alpha matte
withoutBG Open-Weight Model alpha matte: hanging plant window
Alpha matte
BiRefNet Lite alpha matte: hanging plant window
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.11979
MAE
0.02627
Conn.
0.02612
BiRefNet Lite
MGE
0.09596
MAE
0.02129
Conn.
0.02087
Original photo: messy bun cityscape
Ground Truth alpha matte: messy bun cityscape
Alpha matte
withoutBG Open-Weight Model alpha matte: messy bun cityscape
Alpha matte
BiRefNet Lite alpha matte: messy bun cityscape
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02311
MAE
0.00796
Conn.
0.00769
BiRefNet Lite
MGE
0.02104
MAE
0.00978
Conn.
0.00873
Original photo: messy hair bearded portrait
Ground Truth alpha matte: messy hair bearded portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: messy hair bearded portrait
Alpha matte
BiRefNet Lite alpha matte: messy hair bearded portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01507
MAE
0.00650
Conn.
0.00573
BiRefNet Lite
MGE
0.01566
MAE
0.00924
Conn.
0.00709
Original photo: orange berries branch
Ground Truth alpha matte: orange berries branch
Alpha matte
withoutBG Open-Weight Model alpha matte: orange berries branch
Alpha matte
BiRefNet Lite alpha matte: orange berries branch
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.09111
MAE
0.01771
Conn.
0.01754
BiRefNet Lite
MGE
0.13572
MAE
0.28887
Conn.
0.28794
Original photo: red flower balcony bokeh
Ground Truth alpha matte: red flower balcony bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: red flower balcony bokeh
Alpha matte
BiRefNet Lite alpha matte: red flower balcony bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.05274
MAE
0.02840
Conn.
0.02826
BiRefNet Lite
MGE
0.02964
MAE
0.00516
Conn.
0.00458
Original photo: rocky coast bush foreground
Ground Truth alpha matte: rocky coast bush foreground
Alpha matte
withoutBG Open-Weight Model alpha matte: rocky coast bush foreground
Alpha matte
BiRefNet Lite alpha matte: rocky coast bush foreground
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.37456
MAE
0.49888
Conn.
0.49455
BiRefNet Lite
MGE
0.38143
MAE
0.49054
Conn.
0.48684
Original photo: small fishing boat bw
Ground Truth alpha matte: small fishing boat bw
Alpha matte
withoutBG Open-Weight Model alpha matte: small fishing boat bw
Alpha matte
BiRefNet Lite alpha matte: small fishing boat bw
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.05988
MAE
0.01390
Conn.
0.01386
BiRefNet Lite
MGE
0.03789
MAE
0.01105
Conn.
0.00982
Original photo: smiling man seaside sunset
Ground Truth alpha matte: smiling man seaside sunset
Alpha matte
withoutBG Open-Weight Model alpha matte: smiling man seaside sunset
Alpha matte
BiRefNet Lite alpha matte: smiling man seaside sunset
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01330
MAE
0.00272
Conn.
0.00254
BiRefNet Lite
MGE
0.01218
MAE
0.00823
Conn.
0.00688
Original photo: smiling woman seaside
Ground Truth alpha matte: smiling woman seaside
Alpha matte
withoutBG Open-Weight Model alpha matte: smiling woman seaside
Alpha matte
BiRefNet Lite alpha matte: smiling woman seaside
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02282
MAE
0.00565
Conn.
0.00489
BiRefNet Lite
MGE
0.02048
MAE
0.00721
Conn.
0.00483
Original photo: spoked bike wheel
Ground Truth alpha matte: spoked bike wheel
Alpha matte
withoutBG Open-Weight Model alpha matte: spoked bike wheel
Alpha matte
BiRefNet Lite alpha matte: spoked bike wheel
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.07366
MAE
0.01213
Conn.
0.01216
BiRefNet Lite
MGE
0.06244
MAE
0.00997
Conn.
0.00914
Original photo: sprinter motion blur
Ground Truth alpha matte: sprinter motion blur
Alpha matte
withoutBG Open-Weight Model alpha matte: sprinter motion blur
Alpha matte
BiRefNet Lite alpha matte: sprinter motion blur
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03789
MAE
0.02922
Conn.
0.03011
BiRefNet Lite
MGE
0.02690
MAE
0.01743
Conn.
0.01636
Original photo: street dancer studio pose
Ground Truth alpha matte: street dancer studio pose
Alpha matte
withoutBG Open-Weight Model alpha matte: street dancer studio pose
Alpha matte
BiRefNet Lite alpha matte: street dancer studio pose
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02475
MAE
0.00395
Conn.
0.00373
BiRefNet Lite
MGE
0.01948
MAE
0.00387
Conn.
0.00284
Original photo: street portrait man
Ground Truth alpha matte: street portrait man
Alpha matte
withoutBG Open-Weight Model alpha matte: street portrait man
Alpha matte
BiRefNet Lite alpha matte: street portrait man
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01271
MAE
0.00301
Conn.
0.00277
BiRefNet Lite
MGE
0.00986
MAE
0.00333
Conn.
0.00184
Original photo: sunset field portrait
Ground Truth alpha matte: sunset field portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: sunset field portrait
Alpha matte
BiRefNet Lite alpha matte: sunset field portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02503
MAE
0.00752
Conn.
0.00688
BiRefNet Lite
MGE
0.02136
MAE
0.00763
Conn.
0.00590
Original photo: tabby cat portrait
Ground Truth alpha matte: tabby cat portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: tabby cat portrait
Alpha matte
BiRefNet Lite alpha matte: tabby cat portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03017
MAE
0.00736
Conn.
0.00695
BiRefNet Lite
MGE
0.05747
MAE
0.04569
Conn.
0.04453
Original photo: terrier dog mugshot
Ground Truth alpha matte: terrier dog mugshot
Alpha matte
withoutBG Open-Weight Model alpha matte: terrier dog mugshot
Alpha matte
BiRefNet Lite alpha matte: terrier dog mugshot
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04226
MAE
0.01824
Conn.
0.01716
BiRefNet Lite
MGE
0.04755
MAE
0.02372
Conn.
0.02280
Original photo: trigonometry notes whiteboard
Ground Truth alpha matte: trigonometry notes whiteboard
Alpha matte
withoutBG Open-Weight Model alpha matte: trigonometry notes whiteboard
Alpha matte
BiRefNet Lite alpha matte: trigonometry notes whiteboard
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.28577
MAE
0.93281
Conn.
0.93738
BiRefNet Lite
MGE
0.34229
MAE
0.92167
Conn.
0.93601
Original photo: two bikes field
Ground Truth alpha matte: two bikes field
Alpha matte
withoutBG Open-Weight Model alpha matte: two bikes field
Alpha matte
BiRefNet Lite alpha matte: two bikes field
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.11198
MAE
0.02944
Conn.
0.02949
BiRefNet Lite
MGE
0.11147
MAE
0.02414
Conn.
0.02336
Original photo: two gravel bikes park
Ground Truth alpha matte: two gravel bikes park
Alpha matte
withoutBG Open-Weight Model alpha matte: two gravel bikes park
Alpha matte
BiRefNet Lite alpha matte: two gravel bikes park
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.17475
MAE
0.02962
Conn.
0.02905
BiRefNet Lite
MGE
0.12671
MAE
0.02217
Conn.
0.02146
Original photo: white chess pieces tournament
Ground Truth alpha matte: white chess pieces tournament
Alpha matte
withoutBG Open-Weight Model alpha matte: white chess pieces tournament
Alpha matte
BiRefNet Lite alpha matte: white chess pieces tournament
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.11440
MAE
0.29795
Conn.
0.29837
BiRefNet Lite
MGE
0.06813
MAE
0.21584
Conn.
0.21544
Original photo: windblown curly hair backpack
Ground Truth alpha matte: windblown curly hair backpack
Alpha matte
withoutBG Open-Weight Model alpha matte: windblown curly hair backpack
Alpha matte
BiRefNet Lite alpha matte: windblown curly hair backpack
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03113
MAE
0.00814
Conn.
0.00763
BiRefNet Lite
MGE
0.03082
MAE
0.01021
Conn.
0.00890
Original photo: windblown curly portrait
Ground Truth alpha matte: windblown curly portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: windblown curly portrait
Alpha matte
BiRefNet Lite alpha matte: windblown curly portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03992
MAE
0.01483
Conn.
0.01451
BiRefNet Lite
MGE
0.04995
MAE
0.02004
Conn.
0.01839
Original photo: woman street portrait glasses
Ground Truth alpha matte: woman street portrait glasses
Alpha matte
withoutBG Open-Weight Model alpha matte: woman street portrait glasses
Alpha matte
BiRefNet Lite alpha matte: woman street portrait glasses
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01719
MAE
0.00674
Conn.
0.00642
BiRefNet Lite
MGE
0.01926
MAE
0.01031
Conn.
0.00875

Methodology

  • Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
  • Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness, MAE measures pixel-level accuracy, and Connectivity penalises fragmented foreground regions. All three are lower-is-better.
  • Scores are shown as ? when no ground-truth matte is available for that image. See the alpha matting evaluation benchmark for details on the evaluation methodology.