content.raw: SegGPT is a vision generalist on image segmentation, quite like GPTs for computer vision ✨
content.type: text
content.value: SegGPT is a vision generalist on image segmentation, quite like GPTs for computer vision ✨
content.type: new_line
content.raw: It comes with the last release of transformers 🎁  Demo and more in this post!
content.type: text
content.value: It comes with the last release of transformers 🎁  Demo and more in this post!
content.type: new_line
content.raw: SegGPT is an extension of the Painter, where you speak to images with images: the model takes in an image prompt, transformed version of the image prompt, the actual image you want to see the same transform, and expected to output the transformed image. 
content.type: text
content.value: SegGPT is an extension of the Painter, where you speak to images with images: the model takes in an image prompt, transformed version of the image prompt, the actual image you want to see the same transform, and expected to output the transformed image. 
content.type: new_line
content.raw: SegGPT consists of a vanilla ViT with a decoder on top (linear, conv, linear).
content.type: text
content.value: SegGPT consists of a vanilla ViT with a decoder on top (linear, conv, linear).
content.type: new_line
content.raw: The model is trained on diverse segmentation examples, where they provide example image-mask pairs, the actual input to be segmented, and the decoder head learns to reconstruct the mask output.
content.type: text
content.value: The model is trained on diverse segmentation examples, where they provide example image-mask pairs, the actual input to be segmented, and the decoder head learns to reconstruct the mask output.
content.type: new_line
content.raw: This generalizes pretty well! 
content.type: text
content.value: This generalizes pretty well! 
content.type: new_line
content.raw: The authors do not claim state-of-the-art results as the model is mainly used zero-shot and few-shot inference. They also do prompt tuning, where they freeze the parameters of the model and only optimize the image tensor (the input context). 
content.type: text
content.value: The authors do not claim state-of-the-art results as the model is mainly used zero-shot and few-shot inference. They also do prompt tuning, where they freeze the parameters of the model and only optimize the image tensor (the input context). 
content.type: new_line
content.raw: Thanks to 🤗 transformers you can use this model easily!
content.type: text
content.value: Thanks to 🤗 transformers you can use this model easily!
content.type: new_line
content.raw: See here 
content.type: text
content.value: See here 
content.href: https://huggingface.co/docs/transformers/en/model_doc/seggpt
content.raw: https://huggingface.co/docs/transformers/en/model_doc/seggpt
content.type: link
content.type: new_line
content.raw: I have built an app for you to try it out. I combined SegGPT with Depth Anything Model, so you don't have to upload image mask prompts in your prompt pair 🤗
content.type: text
content.value: I have built an app for you to try it out. I combined SegGPT with Depth Anything Model, so you don't have to upload image mask prompts in your prompt pair 🤗
content.type: new_line
content.raw: Try it here 
content.type: text
content.value: Try it here 
content.raw: https://huggingface.co/spaces/merve/seggpt-depth-anything
content.id: merve/seggpt-depth-anything
content.type: space
content.type: resource
content.url: https://huggingface.co/spaces/merve/seggpt-depth-anything
content.type: new_line
content.raw: Also check out the collection 
content.type: text
content.value: Also check out the collection 
content.raw: https://huggingface.co/collections/merve/seggpt-660466a303bc3cd7559d271b
content.id: merve/seggpt-660466a303bc3cd7559d271b
content.type: collection
content.type: resource
content.url: https://huggingface.co/collections/merve/seggpt-660466a303bc3cd7559d271b
rawContent: SegGPT is a vision generalist on image segmentation, quite like GPTs for computer vision ✨
  It comes with the last release of transformers 🎁  Demo and more in this post!
  SegGPT is an extension of the Painter, where you speak to images with images: the model takes in an image prompt, transformed version of the image prompt, the actual image you want to see the same transform, and expected to output the transformed image. 
  SegGPT consists of a vanilla ViT with a decoder on top (linear, conv, linear).
  The model is trained on diverse segmentation examples, where they provide example image-mask pairs, the actual input to be segmented, and the decoder head learns to reconstruct the mask output.
  This generalizes pretty well! 
  The authors do not claim state-of-the-art results as the model is mainly used zero-shot and few-shot inference. They also do prompt tuning, where they freeze the parameters of the model and only optimize the image tensor (the input context). 
  Thanks to 🤗 transformers you can use this model easily!
  See here https://huggingface.co/docs/transformers/en/model_doc/seggpt
  I have built an app for you to try it out. I combined SegGPT with Depth Anything Model, so you don't have to upload image mask prompts in your prompt pair 🤗
  Try it here https://huggingface.co/spaces/merve/seggpt-depth-anything
  Also check out the collection https://huggingface.co/collections/merve/seggpt-660466a303bc3cd7559d271b
reactions.reaction: ❤️
reactions.users: samusenps osanseviero clem lunarflu talaviyabhavik
reactions.reaction: 😎
reactions.users: samusenps osanseviero clem lunarflu
reactions.reaction: 🚀
reactions.users: Tonic