withoutBG Open-Weight Model vs BiRefNet Lite

37 examples, 36 with ground truth. Lower is better. Use the view controls on each row to switch between transparency, chroma key, and alpha matte on all outputs.

MetricwithoutBG Open-Weight ModelBiRefNet Lite
MGE (Edge Quality)0.03887 ✓0.05700
MAE (Overall Accuracy)0.03281 ✓0.04658
Connectivity0.03238 ✓0.04546
Original photo: autumn bouquet vase
Ground Truth alpha matte: autumn bouquet vase
Alpha matte
withoutBG Open-Weight Model alpha matte: autumn bouquet vase
Alpha matte
BiRefNet Lite alpha matte: autumn bouquet vase
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03827✓
MAE
0.00801✓
Conn.
0.00745✓
BiRefNet Lite
MGE
0.09405
MAE
0.05412
Conn.
0.05286
Original photo: balcony flower planter bokeh
Ground Truth alpha matte: balcony flower planter bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: balcony flower planter bokeh
Alpha matte
BiRefNet Lite alpha matte: balcony flower planter bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02810✓
MAE
0.02909✓
Conn.
0.02904✓
BiRefNet Lite
MGE
0.06966
MAE
0.22546
Conn.
0.22514
Original photo: balcony plant bokeh
Ground Truth alpha matte: balcony plant bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: balcony plant bokeh
Alpha matte
BiRefNet Lite alpha matte: balcony plant bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03931✓
MAE
0.01038✓
Conn.
0.01018✓
BiRefNet Lite
MGE
0.05811
MAE
0.01380
Conn.
0.01352
Original photo: bearded man portrait
Ground Truth alpha matte: bearded man portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: bearded man portrait
Alpha matte
BiRefNet Lite alpha matte: bearded man portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01556✓
MAE
0.00499✓
Conn.
0.00447✓
BiRefNet Lite
MGE
0.01603
MAE
0.00675
Conn.
0.00448
Original photo: bike handlebar near beach
Ground Truth alpha matte: bike handlebar near beach
Alpha matte
withoutBG Open-Weight Model alpha matte: bike handlebar near beach
Alpha matte
BiRefNet Lite alpha matte: bike handlebar near beach
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01735✓
MAE
0.00687
Conn.
0.00668
BiRefNet Lite
MGE
0.02569
MAE
0.00423✓
Conn.
0.00388✓
Original photo: blowing dandelion seeds
Ground Truth alpha matte: blowing dandelion seeds
Alpha matte
withoutBG Open-Weight Model alpha matte: blowing dandelion seeds
Alpha matte
BiRefNet Lite alpha matte: blowing dandelion seeds
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03203✓
MAE
0.01223✓
Conn.
0.01087✓
BiRefNet Lite
MGE
0.05057
MAE
0.02603
Conn.
0.02438
Original photo: campfire flames night
Ground Truth alpha matte: campfire flames night
Alpha matte
withoutBG Open-Weight Model alpha matte: campfire flames night
Alpha matte
BiRefNet Lite alpha matte: campfire flames night
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01712✓
MAE
0.01079
Conn.
0.01024
BiRefNet Lite
MGE
0.02148
MAE
0.00553✓
Conn.
0.00531✓
Original photo: cargo ebike park tracks
Ground Truth alpha matte: cargo ebike park tracks
Alpha matte
withoutBG Open-Weight Model alpha matte: cargo ebike park tracks
Alpha matte
BiRefNet Lite alpha matte: cargo ebike park tracks
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.06369✓
MAE
0.01273✓
Conn.
0.01265✓
BiRefNet Lite
MGE
0.09089
MAE
0.01577
Conn.
0.01505
Original photo: compound leaf raindrops
Ground Truth alpha matte: compound leaf raindrops
Alpha matte
withoutBG Open-Weight Model alpha matte: compound leaf raindrops
Alpha matte
BiRefNet Lite alpha matte: compound leaf raindrops
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02636
MAE
0.00503✓
Conn.
0.00479
BiRefNet Lite
MGE
0.02300✓
MAE
0.00515
Conn.
0.00363✓
Original photo: confetti sunset portrait
Ground Truth alpha matte: confetti sunset portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: confetti sunset portrait
Alpha matte
BiRefNet Lite alpha matte: confetti sunset portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01869✓
MAE
0.00816✓
Conn.
0.00786✓
BiRefNet Lite
MGE
0.03349
MAE
0.01220
Conn.
0.01098
Original photo: cyclist motion blur field
Ground Truth alpha matte: cyclist motion blur field
Alpha matte
withoutBG Open-Weight Model alpha matte: cyclist motion blur field
Alpha matte
BiRefNet Lite alpha matte: cyclist motion blur field
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02853✓
MAE
0.00936✓
Conn.
0.00923✓
BiRefNet Lite
MGE
0.06227
MAE
0.01513
Conn.
0.01492
Original photo: dried flowers clay vase
Ground Truth alpha matte: dried flowers clay vase
Alpha matte
withoutBG Open-Weight Model alpha matte: dried flowers clay vase
Alpha matte
BiRefNet Lite alpha matte: dried flowers clay vase
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04587✓
MAE
0.01240
Conn.
0.01258
BiRefNet Lite
MGE
0.04786
MAE
0.00988✓
Conn.
0.00881✓
Original photo: elderly man running blur
Ground Truth alpha matte: elderly man running blur
Alpha matte
withoutBG Open-Weight Model alpha matte: elderly man running blur
Alpha matte
BiRefNet Lite alpha matte: elderly man running blur
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01224✓
MAE
0.00520✓
Conn.
0.00515✓
BiRefNet Lite
MGE
0.01651
MAE
0.00767
Conn.
0.00683
Original photo: grass seed stem bokeh
Ground Truth alpha matte: grass seed stem bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: grass seed stem bokeh
Alpha matte
BiRefNet Lite alpha matte: grass seed stem bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03009✓
MAE
0.01084
Conn.
0.01069
BiRefNet Lite
MGE
0.04112
MAE
0.00958✓
Conn.
0.00951✓
Original photo: hanging plant window
Ground Truth alpha matte: hanging plant window
Alpha matte
withoutBG Open-Weight Model alpha matte: hanging plant window
Alpha matte
BiRefNet Lite alpha matte: hanging plant window
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04795✓
MAE
0.01123✓
Conn.
0.01103✓
BiRefNet Lite
MGE
0.09596
MAE
0.02129
Conn.
0.02087
Original photo: messy bun cityscape
Ground Truth alpha matte: messy bun cityscape
Alpha matte
withoutBG Open-Weight Model alpha matte: messy bun cityscape
Alpha matte
BiRefNet Lite alpha matte: messy bun cityscape
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01477✓
MAE
0.00731✓
Conn.
0.00697✓
BiRefNet Lite
MGE
0.02104
MAE
0.00978
Conn.
0.00873
Original photo: messy hair bearded portrait
Ground Truth alpha matte: messy hair bearded portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: messy hair bearded portrait
Alpha matte
BiRefNet Lite alpha matte: messy hair bearded portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01251✓
MAE
0.00568✓
Conn.
0.00480✓
BiRefNet Lite
MGE
0.01566
MAE
0.00924
Conn.
0.00709
Original photo: orange berries branch
Ground Truth alpha matte: orange berries branch
Alpha matte
withoutBG Open-Weight Model alpha matte: orange berries branch
Alpha matte
BiRefNet Lite alpha matte: orange berries branch
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.05039✓
MAE
0.02393✓
Conn.
0.02378✓
BiRefNet Lite
MGE
0.13572
MAE
0.28887
Conn.
0.28794
Original photo: red flower balcony bokeh
Ground Truth alpha matte: red flower balcony bokeh
Alpha matte
withoutBG Open-Weight Model alpha matte: red flower balcony bokeh
Alpha matte
BiRefNet Lite alpha matte: red flower balcony bokeh
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03115
MAE
0.01899
Conn.
0.01896
BiRefNet Lite
MGE
0.02964✓
MAE
0.00516✓
Conn.
0.00458✓
Original photo: rocky coast bush foreground
Ground Truth alpha matte: rocky coast bush foreground
Alpha matte
withoutBG Open-Weight Model alpha matte: rocky coast bush foreground
Alpha matte
BiRefNet Lite alpha matte: rocky coast bush foreground
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.37414✓
MAE
0.49631
Conn.
0.49210
BiRefNet Lite
MGE
0.38143
MAE
0.49054✓
Conn.
0.48684✓
Original photo: small fishing boat bw
Ground Truth alpha matte: small fishing boat bw
Alpha matte
withoutBG Open-Weight Model alpha matte: small fishing boat bw
Alpha matte
BiRefNet Lite alpha matte: small fishing boat bw
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02245✓
MAE
0.00523✓
Conn.
0.00503✓
BiRefNet Lite
MGE
0.03789
MAE
0.01105
Conn.
0.00982
Original photo: smiling man seaside sunset
Ground Truth alpha matte: smiling man seaside sunset
Alpha matte
withoutBG Open-Weight Model alpha matte: smiling man seaside sunset
Alpha matte
BiRefNet Lite alpha matte: smiling man seaside sunset
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.00932✓
MAE
0.00731✓
Conn.
0.00723
BiRefNet Lite
MGE
0.01218
MAE
0.00823
Conn.
0.00688✓
Original photo: smiling woman seaside
Ground Truth alpha matte: smiling woman seaside
Alpha matte
withoutBG Open-Weight Model alpha matte: smiling woman seaside
Alpha matte
BiRefNet Lite alpha matte: smiling woman seaside
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01754✓
MAE
0.00608✓
Conn.
0.00528
BiRefNet Lite
MGE
0.02048
MAE
0.00721
Conn.
0.00483✓
Original photo: spoked bike wheel
Ground Truth alpha matte: spoked bike wheel
Alpha matte
withoutBG Open-Weight Model alpha matte: spoked bike wheel
Alpha matte
BiRefNet Lite alpha matte: spoked bike wheel
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03535✓
MAE
0.00615✓
Conn.
0.00610✓
BiRefNet Lite
MGE
0.06244
MAE
0.00997
Conn.
0.00914
Original photo: sprinter motion blur
Ground Truth alpha matte: sprinter motion blur
Alpha matte
withoutBG Open-Weight Model alpha matte: sprinter motion blur
Alpha matte
BiRefNet Lite alpha matte: sprinter motion blur
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01507✓
MAE
0.02355
Conn.
0.02418
BiRefNet Lite
MGE
0.02690
MAE
0.01743✓
Conn.
0.01636✓
Original photo: street dancer studio pose
Ground Truth alpha matte: street dancer studio pose
Alpha matte
withoutBG Open-Weight Model alpha matte: street dancer studio pose
Alpha matte
BiRefNet Lite alpha matte: street dancer studio pose
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01807✓
MAE
0.00420
Conn.
0.00401
BiRefNet Lite
MGE
0.01948
MAE
0.00387✓
Conn.
0.00284✓
Original photo: street portrait man
Ground Truth alpha matte: street portrait man
Alpha matte
withoutBG Open-Weight Model alpha matte: street portrait man
Alpha matte
BiRefNet Lite alpha matte: street portrait man
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01089
MAE
0.00275✓
Conn.
0.00248
BiRefNet Lite
MGE
0.00986✓
MAE
0.00333
Conn.
0.00184✓
Original photo: sunset field portrait
Ground Truth alpha matte: sunset field portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: sunset field portrait
Alpha matte
BiRefNet Lite alpha matte: sunset field portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01419✓
MAE
0.00609✓
Conn.
0.00537✓
BiRefNet Lite
MGE
0.02136
MAE
0.00763
Conn.
0.00590
Original photo: tabby cat portrait
Ground Truth alpha matte: tabby cat portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: tabby cat portrait
Alpha matte
BiRefNet Lite alpha matte: tabby cat portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02140✓
MAE
0.00739✓
Conn.
0.00718✓
BiRefNet Lite
MGE
0.05747
MAE
0.04569
Conn.
0.04453
Original photo: terrier dog mugshot
Ground Truth alpha matte: terrier dog mugshot
Alpha matte
withoutBG Open-Weight Model alpha matte: terrier dog mugshot
Alpha matte
BiRefNet Lite alpha matte: terrier dog mugshot
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.03300✓
MAE
0.01786✓
Conn.
0.01614✓
BiRefNet Lite
MGE
0.04755
MAE
0.02372
Conn.
0.02280
Original photo: trigonometry notes whiteboard
Ground Truth alpha matte: trigonometry notes whiteboard
Alpha matte
withoutBG Open-Weight Model alpha matte: trigonometry notes whiteboard
Alpha matte
BiRefNet Lite alpha matte: trigonometry notes whiteboard
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
?
MAE
?
Conn.
?
BiRefNet Lite
MGE
0.34229
MAE
0.92167
Conn.
0.93601
Original photo: two bikes field
Ground Truth alpha matte: two bikes field
Alpha matte
withoutBG Open-Weight Model alpha matte: two bikes field
Alpha matte
BiRefNet Lite alpha matte: two bikes field
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.06131✓
MAE
0.09372
Conn.
0.09310
BiRefNet Lite
MGE
0.11147
MAE
0.02414✓
Conn.
0.02336✓
Original photo: two gravel bikes park
Ground Truth alpha matte: two gravel bikes park
Alpha matte
withoutBG Open-Weight Model alpha matte: two gravel bikes park
Alpha matte
BiRefNet Lite alpha matte: two gravel bikes park
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.09468✓
MAE
0.01882✓
Conn.
0.01849✓
BiRefNet Lite
MGE
0.12671
MAE
0.02217
Conn.
0.02146
Original photo: white chess pieces tournament
Ground Truth alpha matte: white chess pieces tournament
Alpha matte
withoutBG Open-Weight Model alpha matte: white chess pieces tournament
Alpha matte
BiRefNet Lite alpha matte: white chess pieces tournament
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.04716✓
MAE
0.24497
Conn.
0.24520
BiRefNet Lite
MGE
0.06813
MAE
0.21584✓
Conn.
0.21544✓
Original photo: windblown curly hair backpack
Ground Truth alpha matte: windblown curly hair backpack
Alpha matte
withoutBG Open-Weight Model alpha matte: windblown curly hair backpack
Alpha matte
BiRefNet Lite alpha matte: windblown curly hair backpack
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01980✓
MAE
0.00724✓
Conn.
0.00659✓
BiRefNet Lite
MGE
0.03082
MAE
0.01021
Conn.
0.00890
Original photo: windblown curly portrait
Ground Truth alpha matte: windblown curly portrait
Alpha matte
withoutBG Open-Weight Model alpha matte: windblown curly portrait
Alpha matte
BiRefNet Lite alpha matte: windblown curly portrait
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.02499✓
MAE
0.01318✓
Conn.
0.01269✓
BiRefNet Lite
MGE
0.04995
MAE
0.02004
Conn.
0.01839
Original photo: woman street portrait glasses
Ground Truth alpha matte: woman street portrait glasses
Alpha matte
withoutBG Open-Weight Model alpha matte: woman street portrait glasses
Alpha matte
BiRefNet Lite alpha matte: woman street portrait glasses
Alpha matte
Original
Ground Truth
withoutBG Open-Weight Model
MGE
0.01003✓
MAE
0.00726✓
Conn.
0.00712✓
BiRefNet Lite
MGE
0.01926
MAE
0.01031
Conn.
0.00875

Methodology

  • Alpha mattes are grayscale masks encoding per-pixel foreground probability. They capture fine edge detail (hair, fur, semi-transparent regions) that binary masks discard.
  • Metrics are computed by comparing predicted mattes against a ground-truth reference: MGE measures edge sharpness, MAE measures pixel-level accuracy, and Connectivity penalises fragmented foreground regions. All three are lower-is-better.
  • Scores are shown as ? when no ground-truth matte is available for that image. See the alpha matting evaluation benchmark for details on the evaluation methodology.