sourabhd commited on
Commit
35c41c8
1 Parent(s): 7385c85

Update example to CCO

Browse files
Files changed (1) hide show
  1. README.md +11 -12
README.md CHANGED
@@ -81,7 +81,7 @@ pipe = pipeline("text-generation", model="dataeaze/dataeaze-RegLLM-microsoft_phi
81
 
82
  pipe.tokenizer.pad_token = pipe.tokenizer.eos_token
83
 
84
- result = pipe(f"Instruct: Are there specific categories of ECBs with different MAMP requirements?",
85
  max_new_tokens=256,
86
  do_sample=True,
87
  temperature=0.1,
@@ -95,25 +95,24 @@ print(result)
95
  ## Sample Output
96
 
97
  ### Question
98
- Are there specific categories of ECBs with different MAMP requirements?
99
 
100
  ### RegLLM respose
101
 
102
  ```
103
- Instruct: Are there specific categories of ECBs with different MAMP requirements?
104
- Output: Yes, there are various categories of ECBs, each with its own set of MAMP requirements.
105
- These categories may include infrastructure, commercial real estate, and other specific categories as defined by relevant regulations.
106
- The specific MAMP requirements for each category may vary, and banks must adhere to these requirements when extending ECBs.
107
  ```
108
 
109
  ### GPT-4 response
110
  <table>
111
  <tr style="border-spacing: 5px;">
112
  <td>
113
- <img src="chatgpt_ecb_1.png" alt="gpt-4-respnse" width="500" />
114
  </td>
115
  <td>
116
- <img src="chatgpt_ecb_2.png" alt="gpt-4-respnse" width="500" />
117
  </td>
118
  </tr>
119
  </table>
@@ -122,15 +121,15 @@ The specific MAMP requirements for each category may vary, and banks must adhere
122
  ### Reference
123
 
124
  For evalating truthfulness / hallucination of this response, refer to RBI notification
125
- [RBI/FED/2018-19/67
126
- FED Master Direction No.5/2018-19](https://rbidocs.rbi.org.in/rdocs/notification/PDFs/5MD2603201979CA1390E9E546869B2A9A92614DEDBF.PDF) (page 9)
127
 
128
  Screenshot below
129
 
130
- <img src="rbi_gold_answer_ecb.png" alt="rbi-gold-answer" width="500"/>
131
 
132
 
133
- As you can see, RegLLM has identified the frequency of IRRBB policies, while GPT-4 provides a more general response.
134
  Note, that the response of RegLLM is not backed by any external knowledge.
135
  When coupled with retriever model, RegLLM can provide fairly precise responses to user queries related to regulatory compliance.
136
 
 
81
 
82
  pipe.tokenizer.pad_token = pipe.tokenizer.eos_token
83
 
84
+ result = pipe(f"What are the skills that a CCO should have?",
85
  max_new_tokens=256,
86
  do_sample=True,
87
  temperature=0.1,
 
95
  ## Sample Output
96
 
97
  ### Question
98
+ What are the skills that a CCO should have?
99
 
100
  ### RegLLM respose
101
 
102
  ```
103
+ Instruct: What are the skills that a CCO should have?
104
+ Output: The skills that a CCO should have include leadership, communication, and a strong understanding of compliance.
105
+ They should also be able to work effectively with other departments and have a good track record of compliance.
 
106
  ```
107
 
108
  ### GPT-4 response
109
  <table>
110
  <tr style="border-spacing: 5px;">
111
  <td>
112
+ <img src="chatgpt_cco_1.png" alt="gpt-4-respnse" width="500" />
113
  </td>
114
  <td>
115
+ <img src="chatgpt_cco_2.png" alt="gpt-4-respnse" width="500" />
116
  </td>
117
  </tr>
118
  </table>
 
121
  ### Reference
122
 
123
  For evalating truthfulness / hallucination of this response, refer to RBI notification
124
+ [RBI/2022-23/24
125
+ Ref.No.DoS.CO.PPG./SEC.01/11.01.005/2022-23](https://rbidocs.rbi.org.in/rdocs/Notification/PDFs/NT244C25EB0BBB1E4F91AEB101D425EA639A.PDF) (page 8)
126
 
127
  Screenshot below
128
 
129
+ <img src="CCO_Skills.png" alt="rbi-gold-answer" width="500"/>
130
 
131
 
132
+ As you can see, RegLLM has identified CCO has identified Chief Compliance Officer, while GPT-4 (Copilot) identifies CCO has Chief Commercial Officer.
133
  Note, that the response of RegLLM is not backed by any external knowledge.
134
  When coupled with retriever model, RegLLM can provide fairly precise responses to user queries related to regulatory compliance.
135