Answers.Body: <p>I can see several challenges, and the list below is not exhaustive:</p>
  
  <p>i. The main problem is how to model a problem of translating a language test into a formal language. It will probably be something like the automatic translators, but with some guarantees that the proof semantics will be preserved. If you are more interested in this path, I recommend researching what PAC, Information Theory, Computational Proof theory, Complexity theory can contribute to this modeling.</p>
  
  <p>ii. Another problem is how to get the data reliable. You commented that as people used it they would generate this data. But the problem is not just collecting the data. How much you will trust the data and how you will measure the model's performance in translation.</p>
  
  <p>iii. Another problem is more humane, how do you get mathematicians to use such a system? And how to make the model self-explainable.</p>
  
  <p>I believe that this is one of the most difficult problems in machine learning. I once saw this <a href="https://youtu.be/ZhmjCPdZwxk" rel="nofollow noreferrer">video</a> a while ago and I don't know if it can help anything. I also recommend the <a href="https://cstheory.stackexchange.com/">stack exchange of theoretical computer science</a>, there you will probably have a more complete answer.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-19T17:59:09.820Z
Answers.LastActivityDate: 2020-04-19T17:59:09.820Z
Answers.UserDisplayName: Raphael Augusto
Body: <p>From what I've figured</p>
  
  <p>(a) converting mathematical theorems and proofs from English to formal logic is a straightforward job for mathematicians with sufficient background, except that it takes time. </p>
  
  <p>(b) once converted to formal logic, computer verification of the proof becomes straightforward.  </p>
  
  <p>If we can automate (a), a lot of time and intellectual labour (that could be dedicated elsewhere) is saved in doing (b) on published research papers. </p>
  
  <p>Note that if solving (a) in its entirety is hard, we could expect the mathematicians to meet the computer system halfway and avoid writing lengthy English paras that are hard to convert. If it becomes doable enough, submitting a formal logical version of your paper could even become a standard procedure that is expected. </p>
  
  <p>Additional benefit of solving (a) would be to do the process in reverse: mathematicians could delegate smaller tasks and lemmas (both trivial and non-trivial tasks) to an automated theorem prover (ATP). Assisted theorem proving will become more popular and boost productivity, maybe even surprise us once in a while by coming up with proofs that the paper writer couldn't. This is further of value if we predict a sharp upward trajectory of the capability of ATPs in the future. If anything, this could be self-fulfilling, as the demonstration of potential for good ATPs combined by a large corpus of proofs and problems in formal logical format could drive an increase in research on ATPs.</p>
  
  <p>Forgive me if I sound like a salesman, but how doable is this? <strong>What will be the main challenges faced in developing NLP-based AI to convert papers, and how tractable are these challenges given today's state of the field?</strong></p>
  
  <p>P.s. I understand that proofs generated by ATPs are often hard to understand intuitively and can end up proving results without clearly exposing the underlying proof method used. But it is still a benefit to be able to use the final results</p>
  
Tags: <natural-language-processing><math><logic><natural-language-understanding><automated-theorem-proving>
Title: What are the challenges faced by using NLP to convert mathematical texts into formal logic?
UserDisplayName: ghosts_in_the_code
ThreadText: # What are the challenges faced by using NLP to convert mathematical texts into formal logic?
  
  (Asked by: username_0 on 2020-04-06)
  
  From what I've figured
  
  (a) converting mathematical theorems and proofs from English to formal logic is a straightforward job for mathematicians with sufficient background, except that it takes time.
  
  (b) once converted to formal logic, computer verification of the proof becomes straightforward.
  
  If we can automate (a), a lot of time and intellectual labour (that could be dedicated elsewhere) is saved in doing (b) on published research papers.
  
  Note that if solving (a) in its entirety is hard, we could expect the mathematicians to meet the computer system halfway and avoid writing lengthy English paras that are hard to convert. If it becomes doable enough, submitting a formal logical version of your paper could even become a standard procedure that is expected.
  
  Additional benefit of solving (a) would be to do the process in reverse: mathematicians could delegate smaller tasks and lemmas (both trivial and non-trivial tasks) to an automated theorem prover (ATP). Assisted theorem proving will become more popular and boost productivity, maybe even surprise us once in a while by coming up with proofs that the paper writer couldn't. This is further of value if we predict a sharp upward trajectory of the capability of ATPs in the future. If anything, this could be self-fulfilling, as the demonstration of potential for good ATPs combined by a large corpus of proofs and problems in formal logical format could drive an increase in research on ATPs.
  
  Forgive me if I sound like a salesman, but how doable is this? **What will be the main challenges faced in developing NLP-based AI to convert papers, and how tractable are these challenges given today's state of the field?**
  
  P.s. I understand that proofs generated by ATPs are often hard to understand intuitively and can end up proving results without clearly exposing the underlying proof method used. But it is still a benefit to be able to use the final results
  
  **Tags:** natural-language-processing, math, logic, natural-language-understanding, automated-theorem-proving
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-04-19. Score: 1
  
  I can see several challenges, and the list below is not exhaustive:
  
  i. The main problem is how to model a problem of translating a language test into a formal language. It will probably be something like the automatic translators, but with some guarantees that the proof semantics will be preserved. If you are more interested in this path, I recommend researching what PAC, Information Theory, Computational Proof theory, Complexity theory can contribute to this modeling.
  
  ii. Another problem is how to get the data reliable. You commented that as people used it they would generate this data. But the problem is not just collecting the data. How much you will trust the data and how you will measure the model's performance in translation.
  
  iii. Another problem is more humane, how do you get mathematicians to use such a system? And how to make the model self-explainable.
  
  I believe that this is one of the most difficult problems in machine learning. I once saw this [video](https://youtu.be/ZhmjCPdZwxk) a while ago and I don't know if it can help anything. I also recommend the [stack exchange of theoretical computer science](https://cstheory.stackexchange.com/), there you will probably have a more complete answer.
  
  
  ---
  
  