Answers.Body: <p>They are not tracking anything, instead they are trying to find an object which satisfies free fall equation. Gravity acts the same regardless of object's properties - at least in vacuum. </p>
  
  <p>"In this paper, we model prior knowledge on the structure
  of the outputs by providing a weighted constraint function
  g used to penalize “structures” that are not
  consistent with our prior knowledge."</p>
  
  <p>There is a restriction to the possible parabola that is given in the last equation on page 2. They are training the Network to learn time dependence of that equation, which is the same for all objects.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-09-19T09:50:32.273Z
Answers.LastActivityDate: 2019-09-19T09:50:32.273Z
Answers.UserDisplayName: serali
Body: <p>I was reading the paper <a href="https://arxiv.org/pdf/1609.05566.pdf" rel="nofollow noreferrer">Label-Free Supervision of Neural Networks with Physics and Domain Knowledge</a>, published at AAAI 2017, which won the best paper award.</p>
  
  <p>I understand the math and it makes sense. Consider the first application shown in the paper of tracking falling objects. They train only on multiple trajectories of the said pillow, and during the evaluation, they claim that they can track any other falling object (which may not be pillows).</p>
  
  <p>I am unable to understand how that happens? How does the network know which object to track? Even during the training, how does it know that it's the pillow that it's supposed to track?</p>
  
  <p>The network is trained to fit a parabola. But any parabola could fit it. There are infinite such parabolas.</p>
  
Tags: <neural-networks><machine-learning><unsupervised-learning><papers>
Title: How does the network know which objects to track in the paper "Label-Free Supervision of Neural Networks with Physics and Domain Knowledge"?
UserDisplayName: sanjeev mk
ThreadText: # How does the network know which objects to track in the paper "Label-Free Supervision of Neural Networks with Physics and Domain Knowledge"?
  
  (Asked by: username_0 on 2019-09-18)
  
  I was reading the paper [Label-Free Supervision of Neural Networks with Physics and Domain Knowledge](https://arxiv.org/pdf/1609.05566.pdf), published at AAAI 2017, which won the best paper award.
  
  I understand the math and it makes sense. Consider the first application shown in the paper of tracking falling objects. They train only on multiple trajectories of the said pillow, and during the evaluation, they claim that they can track any other falling object (which may not be pillows).
  
  I am unable to understand how that happens? How does the network know which object to track? Even during the training, how does it know that it's the pillow that it's supposed to track?
  
  The network is trained to fit a parabola. But any parabola could fit it. There are infinite such parabolas.
  
  **Tags:** neural-networks, machine-learning, unsupervised-learning, papers
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-09-19. Score: 0
  
  They are not tracking anything, instead they are trying to find an object which satisfies free fall equation. Gravity acts the same regardless of object's properties - at least in vacuum.
  
  "In this paper, we model prior knowledge on the structure
  of the outputs by providing a weighted constraint function
  g used to penalize “structures” that are not
  consistent with our prior knowledge."
  
  There is a restriction to the possible parabola that is given in the last equation on page 2. They are training the Network to learn time dependence of that equation, which is the same for all objects.
  
  
  ---
  
  