Answers.Body: <p>Found it! After a lot of searching and reading through different papers, this was the exact one I needed.</p>
  <p>&quot;<a href="https://arxiv.org/pdf/1902.10909.pdf" rel="nofollow noreferrer">BERT for Joint Intent Classification and Slot Filling</a>&quot;</p>
  <p>There's also an example dataset based on Snips that shows how to create custom intents, entities, slots and train different kinds of transformers to classify text and extract words to fill the appropriate slots.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-03-22T06:11:12.913Z
Answers.LastActivityDate: 2023-03-22T06:11:12.913Z
Answers.UserDisplayName: Ani
Body: <p>I've been working on text -&gt; intent -&gt; command execution for a particular application and while I've found many papers and code that work well for intent classification (<a href="https://paperswithcode.com/paper/generalized-intent-discovery-learning-from" rel="nofollow noreferrer">1</a>, <a href="https://paperswithcode.com/paper/z-bert-a-a-zero-shot-pipeline-for-unknown" rel="nofollow noreferrer">2</a>, etc.), they stop there. For example, given a standard music intent &quot;<em>Play some music by U2</em>&quot; such classifiers return me an intent class <code>play_music</code>. But the information about the artist, track requested aren't part of it. Everytime I search for papers on text -&gt; intent, I end up with classifiers instead of any deep learning models that can not only classify, but maybe give me an importance vector to extract the key parameters from my intents to pass onto the intent class.</p>
  <p>Does anyone know of any papers or implementations like this?</p>
  <p>Note: I'm not looking to make a voice assistant but a text-&gt;command execution engine for a very specific purpose.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-04-13T20:47:54.837Z
Comments.Text: Can you please put your **specific question** in the title?
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-04-18T17:34:00.080Z
Comments.Text: @nbro changed it to better reflect the intent.
Comments.UserDisplayName: Ani
Tags: <classification><transformer><attention><bert>
Title: How can I not only classify an intent, but also identify slots and values in it?
UserDisplayName: Ani
ThreadText: # How can I not only classify an intent, but also identify slots and values in it?
  
  (Asked by: username_0 on 2023-03-20)
  
  I've been working on text -> intent -> command execution for a particular application and while I've found many papers and code that work well for intent classification ([1](https://paperswithcode.com/paper/generalized-intent-discovery-learning-from), [2](https://paperswithcode.com/paper/z-bert-a-a-zero-shot-pipeline-for-unknown), etc.), they stop there. For example, given a standard music intent "*Play some music by U2*" such classifiers return me an intent class `play_music`. But the information about the artist, track requested aren't part of it. Everytime I search for papers on text -> intent, I end up with classifiers instead of any deep learning models that can not only classify, but maybe give me an importance vector to extract the key parameters from my intents to pass onto the intent class.
  
  Does anyone know of any papers or implementations like this?
  
  Note: I'm not looking to make a voice assistant but a text->command execution engine for a very specific purpose.
  
  **Tags:** classification, transformer, attention, bert
  
  > **Comments:**
  > **username_1**: Can you please put your **specific question** in the title?  
  > **username_0**: @username_1 changed it to better reflect the intent.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_0 on 2023-03-22. Score: 0 | Accepted answer
  
  Found it! After a lot of searching and reading through different papers, this was the exact one I needed.
  
  "[BERT for Joint Intent Classification and Slot Filling](https://arxiv.org/pdf/1902.10909.pdf)"
  
  There's also an example dataset based on Snips that shows how to create custom intents, entities, slots and train different kinds of transformers to classify text and extract words to fill the appropriate slots.
  
  
  ---
  
  