Body: <p>My goal is to perform regression over a set of data coming from the &quot;real world&quot; (sensors).</p>
  <p>The data is in tabular format. There are 6 independent features with very different values (scaling is necessary). Additionally, the dependent variable has a large variability (potential scaling needed?).</p>
  <p>An initial classical training shows weaknesses in the prediction when one of the variables (Let's say X1) is low in absolute value.</p>
  <p>Experts tell me that the value to be predicted (let's call it Y) in this specific region (where X1 is low) can be approximated by a linear regression. So if all other features are constant, X1 and Y have a linear dependency of the type Y= a * X1 + b.</p>
  <p>The problem is that coefficients &quot;a&quot; and &quot;b&quot; depends on the other features a = f(X2,X3,X4,X5), b=g(X2,X3,X4,X5)...</p>
  <p>Note that I have a table of the coefficient &quot;a&quot; and &quot;b&quot; for several combinations of the 5 other features.</p>
  <p>I would like to integrate the linearization that is &quot;physics informed&quot; into the training process. But how can I do that? I had a look on Physics Informed Neural Network, but they are oriented for PDE only and not closed form equation like the one I have.</p>
  <p>For me, a natural thing to do would be to generate fake data in this area through the equation. Would it be considered as Physics Informed Machine Learning? I won't see the difference between adding &quot;physics informed&quot; data, and adding a loss which would try to fulfill the equation.</p>
  <p>Many thanks,</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-06-27T11:33:33.430Z
Comments.Text: You can use mathjax to format your formulas.
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-06-28T14:53:41.893Z
Comments.Text: Thanks, for the tip ! Any other tip for my problem though ?
Comments.UserDisplayName: user19296578
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-06-28T23:24:20.277Z
Comments.Text: Sorry I am not familiar with physics-informed ML and right now I don't have time to get informed about it. Maybe you can clarify what is meant by "physics-informed" in general and in your context, though, but I guess you also don't know exactly what that is because you're asking that question
Comments.UserDisplayName: nbro
Tags: <neural-networks><machine-learning>
Title: How to deal with "real" data and closed formed equation in machine learning?
UserDisplayName: user19296578
ThreadText: # How to deal with "real" data and closed formed equation in machine learning?
  
  (Asked by: username_0 on 2024-06-24)
  
  My goal is to perform regression over a set of data coming from the "real world" (sensors).
  
  The data is in tabular format. There are 6 independent features with very different values (scaling is necessary). Additionally, the dependent variable has a large variability (potential scaling needed?).
  
  An initial classical training shows weaknesses in the prediction when one of the variables (Let's say X1) is low in absolute value.
  
  Experts tell me that the value to be predicted (let's call it Y) in this specific region (where X1 is low) can be approximated by a linear regression. So if all other features are constant, X1 and Y have a linear dependency of the type Y= a \* X1 + b.
  
  The problem is that coefficients "a" and "b" depends on the other features a = f(X2,X3,X4,X5), b=g(X2,X3,X4,X5)...
  
  Note that I have a table of the coefficient "a" and "b" for several combinations of the 5 other features.
  
  I would like to integrate the linearization that is "physics informed" into the training process. But how can I do that? I had a look on Physics Informed Neural Network, but they are oriented for PDE only and not closed form equation like the one I have.
  
  For me, a natural thing to do would be to generate fake data in this area through the equation. Would it be considered as Physics Informed Machine Learning? I won't see the difference between adding "physics informed" data, and adding a loss which would try to fulfill the equation.
  
  Many thanks,
  
  **Tags:** neural-networks, machine-learning
  
  > **Comments:**
  > **username_1**: You can use mathjax to format your formulas.  
  > **username_0**: Thanks, for the tip ! Any other tip for my problem though ?  
  > **username_1**: Sorry I am not familiar with physics-informed ML and right now I don't have time to get informed about it. Maybe you can clarify what is meant by "physics-informed" in general and in your context, though, but I guess you also don't know exactly what that is because you're asking that question  
  
  ---
  
  ## 0 answers
  
  