Answers.Body: <p>Yes.</p>
  <p>The <a href="https://www.europarl.europa.eu/news/en/headlines/society/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence" rel="nofollow noreferrer">EU AI act</a> has a specific section about generative AI. I'll quote it.</p>
  <blockquote>
  <p>Generative AI, like ChatGPT, would have to comply with transparency requirements:</p>
  <ul>
  <li>Disclosing that the content was generated by AI</li>
  <li>Designing the model to prevent it from generating illegal content</li>
  <li>Publishing summaries of copyrighted data used for training</li>
  </ul>
  </blockquote>
  <p>So, clearly, LLMs (open or closed) are subject to the EU AI Act. So, I don't really know why you have doubts about it. Have you maybe read some unofficial document or are you referring to a different act?</p>
  <p>Moreover, in <a href="https://www.europarl.europa.eu/news/en/headlines/society/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence" rel="nofollow noreferrer">the official linked document</a>, these rules are not placed under the &quot;High risk&quot; section, but I suppose generative AI is also high-risk because in the &quot;High risk&quot; section we also have e.g. &quot;Education and vocational training&quot;, which generative AI has been used for.</p>
  <p>The act will probably evolve in the next months or years. See also the previous detailed one <a href="https://artificialintelligenceact.eu/the-act/" rel="nofollow noreferrer">here</a>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-12-15T10:34:06.063Z
Answers.Text: My question related to open LLM (Mistral AI distributing weights), for which the provider  might be someone else. As such its not entirely clear that those bullet points apply to mistral / the entity using weights or both.
Answers.UserDisplayName: Lucas Morin
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-12-15T13:01:18.410Z
Answers.Text: I think the AI Act and these rules still apply (there's nothing that suggests otherwise). I think your question is different. Your question is "who is responsible for ensuring this specific generative AI complies with these rules". If this is not your question, then I think that's the most interesting question anyway.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-12-13T11:59:29.227Z
Answers.LastActivityDate: 2023-12-13T12:13:51.813Z
Answers.LastEditDate: 2023-12-13T12:13:51.813Z
Answers.UserDisplayName: nbro
Body: <p>As I was reading the AI act I was wondering how it will apply to current open LLM (say Mixtral of Mistal AI).</p>
  <p>It seems that there are some specific arguments regarding open LLM that would put them outside of the AI act scope:</p>
  <ul>
  <li>They are free (are they still &quot;put on the market&quot; ?)</li>
  <li>They are tools (not an AI system with a usage), it's there reusage in an AI system that would</li>
  </ul>
  <p>Was the topic of LLM covered somewhere that I am missing ?
  Bonus question: given their prevalence and potential impact, will they be considered high risk ? (or its their reusage ?)</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-12-12T11:15:03.770Z
Comments.Text: I don't see a fundamental boundary in LLMs as tools or agents. If the system only answers questions, but does it always to the best of their "knowledge" it is a tool. But if it sometimes asks questions out of some curiosity (objectively describable as missing information "wanted"), sometimes answers but sometimes refuses to answer or lies on purpose due to some game constraint, is it an agent? I don't think the changes needed for those very different behaviours are any deep.
Comments.UserDisplayName: Jaume Oliver Lafont
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-12-13T00:59:56.750Z
Comments.Text: By "AI act", are you referring to https://www.europarl.europa.eu/news/en/headlines/society/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence? Can you please include the link to the AI act in your own question? Thanks.
Comments.UserDisplayName: nbro
Tags: <large-language-models><legal>
Title: Will open LLM be subject to AI act / considered High Risk?
UserDisplayName: Lucas Morin
ThreadText: # Will open LLM be subject to AI act / considered High Risk?
  
  (Asked by: username_0 on 2023-12-11)
  
  As I was reading the AI act I was wondering how it will apply to current open LLM (say Mixtral of Mistal AI).
  
  It seems that there are some specific arguments regarding open LLM that would put them outside of the AI act scope:
  
  * They are free (are they still "put on the market" ?)
  * They are tools (not an AI system with a usage), it's there reusage in an AI system that would
  
  Was the topic of LLM covered somewhere that I am missing ?
  Bonus question: given their prevalence and potential impact, will they be considered high risk ? (or its their reusage ?)
  
  **Tags:** large-language-models, legal
  
  > **Comments:**
  > **username_1**: I don't see a fundamental boundary in LLMs as tools or agents. If the system only answers questions, but does it always to the best of their "knowledge" it is a tool. But if it sometimes asks questions out of some curiosity (objectively describable as missing information "wanted"), sometimes answers but sometimes refuses to answer or lies on purpose due to some game constraint, is it an agent? I don't think the changes needed for those very different behaviours are any deep.  
  > **username_2**: By "AI act", are you referring to https://www.europarl.europa.eu/news/en/headlines/society/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence? Can you please include the link to the AI act in your own question? Thanks.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2023-12-13. Score: 1
  
  Yes.
  
  The [EU AI act](https://www.europarl.europa.eu/news/en/headlines/society/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence) has a specific section about generative AI. I'll quote it.
  
  > Generative AI, like ChatGPT, would have to comply with transparency requirements:
  >
  > * Disclosing that the content was generated by AI
  > * Designing the model to prevent it from generating illegal content
  > * Publishing summaries of copyrighted data used for training
  
  So, clearly, LLMs (open or closed) are subject to the EU AI Act. So, I don't really know why you have doubts about it. Have you maybe read some unofficial document or are you referring to a different act?
  
  Moreover, in [the official linked document](https://www.europarl.europa.eu/news/en/headlines/society/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence), these rules are not placed under the "High risk" section, but I suppose generative AI is also high-risk because in the "High risk" section we also have e.g. "Education and vocational training", which generative AI has been used for.
  
  The act will probably evolve in the next months or years. See also the previous detailed one [here](https://artificialintelligenceact.eu/the-act/).
  
  > **Comments:**
  > **username_0**: My question related to open LLM (Mistral AI distributing weights), for which the provider  might be someone else. As such its not entirely clear that those bullet points apply to mistral / the entity using weights or both.  
  > **username_2**: I think the AI Act and these rules still apply (there's nothing that suggests otherwise). I think your question is different. Your question is "who is responsible for ensuring this specific generative AI complies with these rules". If this is not your question, then I think that's the most interesting question anyway.  
  
  ---
  
  