Answers.Body: <p>If you don't have non-examples of your pattern and don't have some kind of heuristic guide, unfortunately the answer is that you can't. "All sentences" will always be 100% compatible with your examples, and you'll never be able to collect evidence that disconfirms (or even decreases the likelihood) of that hypothesis. Even if you rule out that hypothesis by fiat, the hypothesis that the only non-accepted sentence is</p>
  
  <blockquote>
    <p>The answers for “I have a bunch of books and want to infer topics” and “I have a set of contextless sentences that fit a pattern and another set of contextless sentences that don’t fit that pattern and want to find the pattern” are extremely different.</p>
  </blockquote>
  
  <p>will be impossible to rule out</p>
  
  <p>With a good enough heuristic guide, you might be able to do something, but that would require knowing statistical facts about examples and non-examples and then sampling from the world IID, and just happening to not get any non-examples. That doesn't seem like the situation you're in. If you really have nothing to quantify the non-examples in any way, there's nothing that can be done.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-09-15T23:15:38.667Z
Answers.LastActivityDate: 2018-09-17T13:34:21.757Z
Answers.LastEditDate: 2018-09-17T13:34:21.757Z
Answers.UserDisplayName: Stella Biderman
Body: <p>We have data in text format as sentences.
  The goal is to detect rules which exist in this set of sentences.</p>
  
  <p>I have a limited set of contextless sentences that fit a pattern and want to find the pattern.
  I might not have sentences that don't fit the pattern.</p>
  
  <p>What should be an approach to do that?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-09-15T20:35:03.500Z
Comments.Text: This I really to vague to answer. What’s the context? Where’s the data coming from? What kind of rules do you want to find? The answers for “I have a bunch of books and want to infer topics” and “I have a set of contextless sentences that fit a pattern and another set of contextless sentences that don’t fit that pattern and want to find the pattern” are extremely different.
Comments.UserDisplayName: Stella Biderman
Tags: <machine-learning><learning-algorithms><unsupervised-learning>
Title: What is the approach to deduce formal rules based on data?
UserDisplayName: Artem
ThreadText: # What is the approach to deduce formal rules based on data?
  
  (Asked by: username_0 on 2018-09-15)
  
  We have data in text format as sentences.
  The goal is to detect rules which exist in this set of sentences.
  
  I have a limited set of contextless sentences that fit a pattern and want to find the pattern.
  I might not have sentences that don't fit the pattern.
  
  What should be an approach to do that?
  
  **Tags:** machine-learning, learning-algorithms, unsupervised-learning
  > **Comments:**
  > **username_1**: This I really to vague to answer. What’s the context? Where’s the data coming from? What kind of rules do you want to find? The answers for “I have a bunch of books and want to infer topics” and “I have a set of contextless sentences that fit a pattern and another set of contextless sentences that don’t fit that pattern and want to find the pattern” are extremely different.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2018-09-15. Score: 1
  
  If you don't have non-examples of your pattern and don't have some kind of heuristic guide, unfortunately the answer is that you can't. "All sentences" will always be 100% compatible with your examples, and you'll never be able to collect evidence that disconfirms (or even decreases the likelihood) of that hypothesis. Even if you rule out that hypothesis by fiat, the hypothesis that the only non-accepted sentence is
  
  > The answers for “I have a bunch of books and want to infer topics” and “I have a set of contextless sentences that fit a pattern and another set of contextless sentences that don’t fit that pattern and want to find the pattern” are extremely different.
  
  will be impossible to rule out
  
  With a good enough heuristic guide, you might be able to do something, but that would require knowing statistical facts about examples and non-examples and then sampling from the world IID, and just happening to not get any non-examples. That doesn't seem like the situation you're in. If you really have nothing to quantify the non-examples in any way, there's nothing that can be done.
  
  
  ---
  
  