SAM 2: Segment Anything in Images and Videos
We present Segment Anything Model 2 (SAM 2), a foundation model towards
solving promptable visual segmentation in images and videos. We build a data
engine, which improves model and data via user interaction, to collect the
largest video segmentation dataset to date. Our model is a simple transformer
architecture with streaming memory for real-time video processing. SAM 2
trained on our data provides strong performance across a wide range of tasks.
In video segmentation, we observe better accuracy, using 3x fewer interactions
than prior approaches. In image segmentation, our model is more accurate and 6x
faster than the Segment Anything Model (SAM). We believe that our data, model,
and insights will serve as a significant milestone for video segmentation and
related perception tasks. We are releasing a version of our model, the dataset
and an interactive demo.
66ac44657746f1e5ff6b7149
Nikhila Ravi
admin_assigned
2024-08-02T08:07:54.071Z
64fb530435a7fc7d4f109549
/avatars/e5a8b35fc19f842365e8d1e537ed496f.svg
NR
user
nikhilaravi
66ac44657746f1e5ff6b714a
Valentin Gabeur
admin_assigned
2024-08-02T08:08:07.804Z
6464fbbf02a171e703b085bc
/avatars/6fc8b7e1e252383a7e56ab6b6a162a88.svg
Valentin Gabeur
user
gabeur
66ac44657746f1e5ff6b714b
Yuan-Ting Hu
66ac44657746f1e5ff6b714c
Ronghang Hu
admin_assigned
2024-08-02T08:08:22.836Z
628ce5e686d23ad156069514
https://cdn-avatars.huggingface.co/v1/production/uploads/1653401079719-628ce5e686d23ad156069514.png
Ronghang Hu
user
ronghanghu
66ac44657746f1e5ff6b714d
Chaitanya Ryali
66ac44657746f1e5ff6b714e
Tengyu Ma
admin_assigned
2024-08-02T08:08:42.916Z
6679338e6a685a4ffbe3d920
/avatars/4c2f726b1edd442b4ece97d8644dfd2b.svg
Tengyu Ma
user
tengyuma
66ac44657746f1e5ff6b714f
Haitham Khedr
claimed_verified
2024-08-03T08:25:53.814Z
64960b6a702e0239e303bd8a
/avatars/f460f8630d9e4ff23aee79147bd220ce.svg
Haitham Khedr
user
hkhedr
66ac44657746f1e5ff6b7150
Roman Rädle
admin_assigned
2024-08-02T08:10:41.358Z
613271f29342334f6683f962
/avatars/b2eb8adf09ff3a7a445d6bad67d2eca5.svg
Roman Rädle
user
raedle
66ac44657746f1e5ff6b7151
Chloe Rolland
admin_assigned
2024-08-02T08:10:47.794Z
6463d03f38083255f6754152
/avatars/a158e36e0a24ece399b8ec26a2084444.svg
Chloe Rolland
user
crolland
66ac44657746f1e5ff6b7152
Laura Gustafson
66ac44657746f1e5ff6b7153
Eric Mintun
66ac44657746f1e5ff6b7154
Junting Pan
admin_assigned
2024-08-02T08:11:14.386Z
639c2d36e62c431aa8d834a7
/avatars/a23d57dcb190711494a2a7e75e4cb9a8.svg
Junting Pan
user
juntingpan
66ac44657746f1e5ff6b7155
Kalyan Vasudev Alwala
66ac44657746f1e5ff6b7156
Nicolas Carion
admin_assigned
2024-08-02T08:11:26.738Z
6253c57927a8414d3bbe6d50
/avatars/9d7cb38db7831a05e35c157a71f5be4a.svg
Nicolas Carion
user
alcinos
66ac44657746f1e5ff6b7157
Chao-Yuan Wu
admin_assigned
2024-08-02T08:11:32.419Z
64652670611ae99d14d3baf8
/avatars/eaa9594fe1b0072a4cd255bc508d0b85.svg
Chao-Yuan Wu
user
cywu
66ac44657746f1e5ff6b7158
Ross Girshick
admin_assigned
2024-08-02T08:11:38.265Z
645a98a777d040cfd6500e14
/avatars/9695beb63f88952064936c7345d09ee2.svg
Ross Girshick
user
inkynumbers
66ac44657746f1e5ff6b7159
Piotr Dollár
66ac44657746f1e5ff6b715a
Christoph Feichtenhofer
SAM 2: Segment Anything in Images and Videos
We present Segment Anything Model 2 (SAM 2), a foundation model towards
solving promptable visual segmentation in images and videos. We build a data
engine, which improves model and data via user interaction, to collect the
largest video segmentation dataset to date. Our model is a simple transformer
architecture with streaming memory for real-time video processing. SAM 2
trained on our data provides strong performance across a wide range of tasks.
In video segmentation, we observe better accuracy, using 3x fewer interactions
than prior approaches. In image segmentation, our model is more accurate and 6x
faster than the Segment Anything Model (SAM). We believe that our data, model,
and insights will serve as a significant milestone for video segmentation and
related perception tasks. We are releasing a version of our model, the dataset
and an interactive demo.
Segment Anything Model 2 (SAM 2) uses a transformer architecture with streaming memory to achieve high performance in image and video segmentation, requiring fewer interactions and faster processing than previous models.
transformer architecture streaming memory video segmentation image segmentation