Answers.Body: <p>Depending on the accuracy of your model this might be normal and you could use more traditional algorithms like ecc to refine the homography.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-28T09:57:29.640Z
Answers.LastActivityDate: 2022-07-28T09:57:29.640Z
Answers.UserDisplayName: JosephMcDonnell
Body: <p>I'm using a Spatial Transformer Networks (STN) to align an image by optimization using L1 loss between prediction and target, they works great for large mismatch, but not so much for small misalignment. For example, in this image below you could see it warped them to close as the target, but some lines still out of its place (the green pointing arrow).
  <a href="https://i.sstatic.net/T5na2.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/T5na2.png" alt="enter image description here" /></a></p>
  <p>I'm trying further fine tune them, is there a technique/networks that I could use that I might not be aware of that could be used in-place or extended from STN?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-06-13T09:52:15.160Z
Comments.Text: mate Can you share my a link or codes about, how to use the STN to address image alignment? I am very interested about it. Thanks.
Comments.UserDisplayName: nengzhang
Tags: <convolutional-neural-networks><sampling>
Title: Is there a way to further fine tune image alignment homography after using Spatial Transformer Networks?
UserDisplayName: Ryan
ThreadText: # Is there a way to further fine tune image alignment homography after using Spatial Transformer Networks?
  
  (Asked by: username_0 on 2022-04-22)
  
  I'm using a Spatial Transformer Networks (STN) to align an image by optimization using L1 loss between prediction and target, they works great for large mismatch, but not so much for small misalignment. For example, in this image below you could see it warped them to close as the target, but some lines still out of its place (the green pointing arrow).
  [![enter image description here](https://i.sstatic.net/T5na2.png)](https://i.sstatic.net/T5na2.png)
  
  I'm trying further fine tune them, is there a technique/networks that I could use that I might not be aware of that could be used in-place or extended from STN?
  
  **Tags:** convolutional-neural-networks, sampling
  
  > **Comments:**
  > **username_1**: mate Can you share my a link or codes about, how to use the STN to address image alignment? I am very interested about it. Thanks.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2022-07-28. Score: 1
  
  Depending on the accuracy of your model this might be normal and you could use more traditional algorithms like ecc to refine the homography.
  
  
  ---
  
  