Answers.Body: <p>Censorship in OpenAI's GPT models is implemented at the post-processing stage, after the model has generated its response. The censorship policies and criteria are defined by OpenAI, and they are applied to the output of the model before it is displayed to the user. The policies and criteria are designed to prevent the generation of harmful, abusive, or otherwise inappropriate content. The exact details of how censorship is implemented and enforced by OpenAI are proprietary and not publicly disclosed.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-05T18:11:08.847Z
Answers.Text: Thanks, did you read the paragraph before the question? What motivated the question was not really answered. That is my mistake though, I should have explicitly stated that in the italics. I edited it.
Answers.UserDisplayName: Wolphram jonny
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-05T18:25:50.610Z
Answers.Text: "There is no censorship mechanism within the transformer.". It answered GPT-3 itself.
Answers.UserDisplayName: Andrea Ianni
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-05T18:44:48.213Z
Answers.Text: I would not trust GPT-3 answers. Also, you didn't address my question: why my attempt to bypass it failed?
Answers.UserDisplayName: Wolphram jonny
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-05T21:07:06.903Z
Answers.Text: Even with old mechanisms like word2vec it was really simple to identify clusters of offensive words, all in the same vector spaces. I think GPT-3 is trained to avoid those clusters in the answer or recognizing questions with answers falling in those dangerous spaces. So, I think it's all inside the transformers and there isn't a way to bypass it. It creates "polite" answers and then adds the special character $ to the text.
Answers.UserDisplayName: Andrea Ianni
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-05T21:33:29.323Z
Answers.Text: Can you provide a source that supports this claim "Censorship in OpenAI's GPT models is implemented at the post-processing stage". I know OpenAI has some kind of "moderation" API, but I'd like to see some sources that support any claim about ChatGPT, because we see a lot of speculation.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-05T11:42:55.720Z
Answers.LastActivityDate: 2023-02-05T11:42:55.720Z
Answers.UserDisplayName: Andrea Ianni
Body: <p>My assumption is that after the transformer is trained, some other software analyzes the answer for anti-wokeness and modifies it accordingly, rather than being trained using woke material.</p>
  <p>I don't think this is correct though. I asked ChatGPT  to answer every question by inserting a <code>$</code> (dollar sign) character in between each character of the otherwise normal answer, to make it unreadable, or at least, difficult to interpret by what I call the censorship layer. The output had these inserted characters; however, this had no effect on the censorship. But maybe the censorship layer is smart enough to read in between lines.</p>
  <p><strong>Question:</strong> Does the censorship come from within the transformer or after it? (and, if it comes after, why did my attempt to bypass it fail?)</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-02-05T01:21:07.107Z
Comments.Text: This is impossible to answer because there is no publicly available information about inner workings of ChatGPT.
Comments.UserDisplayName: Dr. Snoopy
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-03-14T20:48:44.687Z
Comments.Text: There is no way to know why your personal attempts to bypass the filters have failed, and it is a ridiculous question since you have given no details about what you've attempted. Additionally, the question is deliberately inflammatory by using "woke" as some sort of aspersion. There is nothing "woke" about making a tool publicly available to children not write erotica or use racist epithets. While the question has attracted one unsourced answer about a proprietary system, that may or may not be correct, the overall question certainly does not live up to SE's standards in multiple ways..
Comments.UserDisplayName: Ben I.
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-03-15T03:50:16.577Z
Comments.Text: Dr. Snoopy is correct - any answer to this question as it is currently posed is mere speculation, unless somebody from OpenAI is willing to respond and provide actual insider knowledge. I would encourage you to reword this in such a way that it's not asking for information that is basically "unavailable by definition".  
  
  Ben I. is also correct. I'd encourage you to drop the use of "woke" as a pejorative and keep this neutral and mostly technology focused. Otherwise this is at risk of being closed.
Comments.UserDisplayName: mindcrime
Tags: <chatgpt>
Title: How does censorship work in ChatGPT?
UserDisplayName: Wolphram jonny
ThreadText: # How does censorship work in ChatGPT?
  
  (Asked by: username_0 on 2023-02-05)
  
  My assumption is that after the transformer is trained, some other software analyzes the answer for anti-wokeness and modifies it accordingly, rather than being trained using woke material.
  
  I don't think this is correct though. I asked ChatGPT to answer every question by inserting a `$` (dollar sign) character in between each character of the otherwise normal answer, to make it unreadable, or at least, difficult to interpret by what I call the censorship layer. The output had these inserted characters; however, this had no effect on the censorship. But maybe the censorship layer is smart enough to read in between lines.
  
  **Question:** Does the censorship come from within the transformer or after it? (and, if it comes after, why did my attempt to bypass it fail?)
  
  **Tags:** chatgpt
  > **Comments:**
  > **username_1**: This is impossible to answer because there is no publicly available information about inner workings of ChatGPT.  
  > **username_2**: There is no way to know why your personal attempts to bypass the filters have failed, and it is a ridiculous question since you have given no details about what you've attempted. Additionally, the question is deliberately inflammatory by using "woke" as some sort of aspersion. There is nothing "woke" about making a tool publicly available to children not write erotica or use racist epithets. While the question has attracted one unsourced answer about a proprietary system, that may or may not be correct, the overall question certainly does not live up to SE's standards in multiple ways..  
  > **username_3**: Dr. Snoopy is correct - any answer to this question as it is currently posed is mere speculation, unless somebody from OpenAI is willing to respond and provide actual insider knowledge. I would encourage you to reword this in such a way that it's not asking for information that is basically "unavailable by definition".    Ben I. is also correct. I'd encourage you to drop the use of "woke" as a pejorative and keep this neutral and mostly technology focused. Otherwise this is at risk of being closed.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_4 on 2023-02-05. Score: 0
  
  Censorship in OpenAI's GPT models is implemented at the post-processing stage, after the model has generated its response. The censorship policies and criteria are defined by OpenAI, and they are applied to the output of the model before it is displayed to the user. The policies and criteria are designed to prevent the generation of harmful, abusive, or otherwise inappropriate content. The exact details of how censorship is implemented and enforced by OpenAI are proprietary and not publicly disclosed.
  
  > **Comments:**
  > **username_0**: Thanks, did you read the paragraph before the question? What motivated the question was not really answered. That is my mistake though, I should have explicitly stated that in the italics. I edited it.  
  > **username_4**: "There is no censorship mechanism within the transformer.". It answered GPT-3 itself.  
  > **username_0**: I would not trust GPT-3 answers. Also, you didn't address my question: why my attempt to bypass it failed?  
  > **username_4**: Even with old mechanisms like word2vec it was really simple to identify clusters of offensive words, all in the same vector spaces. I think GPT-3 is trained to avoid those clusters in the answer or recognizing questions with answers falling in those dangerous spaces. So, I think it's all inside the transformers and there isn't a way to bypass it. It creates "polite" answers and then adds the special character $ to the text.  
  > **username_5**: Can you provide a source that supports this claim "Censorship in OpenAI's GPT models is implemented at the post-processing stage". I know OpenAI has some kind of "moderation" API, but I'd like to see some sources that support any claim about ChatGPT, because we see a lot of speculation.  
  
  ---
  
  