Answers.Body: <p>It is enlightening to look at how the training data is created. For the purses and shoes they took real purses and shoes and then performed some thing like a county edge on them. They trained the learner using the simpler image to infer texture and color.</p>
  <p>There are plenty of folks in the fields like “visual design“ that want to turn a sketch into something more realistic, and the elements of form, and lighting, and space, are important to how they go about doing that. They would use something like this trained pix2pix in their explorations of the transition between the architectural sketch and the real world.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-04-12T04:48:41.480Z
Answers.LastActivityDate: 2022-04-12T04:48:41.480Z
Answers.UserDisplayName: EngrStudent
Body: <p>In <a href="https://arxiv.org/pdf/1611.07004.pdf" rel="nofollow noreferrer">Pix2Pix</a> by Isola et al. they translate images from different pairs of image categories to one another. While most other example applications for the algorithm make sense to me, I'm having difficulties understanding why one would translate facade labels to facade images. As the title says, I already don't see how labeling a facade would help solving any real world problem.</p>
  <p>I skimmed the related work of the paper and found little about what &quot;facade parsing&quot; could be used for, except maybe reconstruction from images. Where are facades reconstructed from facade labels? Can anyone tell me other example applications for facade labels and translating them to images?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-08-30T12:52:04.207Z
Comments.Text: Does it have to be facade labels? They are just labels into images. The same technique could be used to convert other labels into other images.
Comments.UserDisplayName: Criticize SE actions means ban
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-08-30T12:52:55.643Z
Comments.Text: although maybe facades are useful for a computer game in a city!
Comments.UserDisplayName: Criticize SE actions means ban
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-08-30T14:20:08.980Z
Comments.Text: I guess computer games is the best possible use case. However, I don't know any game that was made using facade labels. The same technique can in fact be used for autonomous driving. Labeling traffic scenes is another example in the paper. But facades? It's probably because labeling facades is a comparably easy computer vision task.
Comments.UserDisplayName: General Guest
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-08-31T00:28:59.493Z
Comments.Text: Welcome to SE:AI!  This seems like a great question on theory.
Comments.UserDisplayName: DukeZhou
Tags: <machine-learning><image-generation>
Title: Why labeling facades?
UserDisplayName: General Guest
ThreadText: # Why labeling facades?
  
  (Asked by: username_0 on 2021-08-30)
  
  In [Pix2Pix](https://arxiv.org/pdf/1611.07004.pdf) by Isola et al. they translate images from different pairs of image categories to one another. While most other example applications for the algorithm make sense to me, I'm having difficulties understanding why one would translate facade labels to facade images. As the title says, I already don't see how labeling a facade would help solving any real world problem.
  
  I skimmed the related work of the paper and found little about what "facade parsing" could be used for, except maybe reconstruction from images. Where are facades reconstructed from facade labels? Can anyone tell me other example applications for facade labels and translating them to images?
  
  **Tags:** machine-learning, image-generation
  
  > **Comments:**
  > **username_1**: Does it have to be facade labels? They are just labels into images. The same technique could be used to convert other labels into other images.  
  > **username_1**: although maybe facades are useful for a computer game in a city!  
  > **username_0**: I guess computer games is the best possible use case. However, I don't know any game that was made using facade labels. The same technique can in fact be used for autonomous driving. Labeling traffic scenes is another example in the paper. But facades? It's probably because labeling facades is a comparably easy computer vision task.  
  > **username_2**: Welcome to SE:AI!  This seems like a great question on theory.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_3 on 2022-04-12. Score: 0
  
  It is enlightening to look at how the training data is created. For the purses and shoes they took real purses and shoes and then performed some thing like a county edge on them. They trained the learner using the simpler image to infer texture and color.
  
  There are plenty of folks in the fields like “visual design“ that want to turn a sketch into something more realistic, and the elements of form, and lighting, and space, are important to how they go about doing that. They would use something like this trained pix2pix in their explorations of the transition between the architectural sketch and the real world.
  
  
  ---
  
  