Update example to CCO
Browse files
README.md
CHANGED
@@ -81,7 +81,7 @@ pipe = pipeline("text-generation", model="dataeaze/dataeaze-RegLLM-microsoft_phi
|
|
81 |
|
82 |
pipe.tokenizer.pad_token = pipe.tokenizer.eos_token
|
83 |
|
84 |
-
result = pipe(f"
|
85 |
max_new_tokens=256,
|
86 |
do_sample=True,
|
87 |
temperature=0.1,
|
@@ -95,25 +95,24 @@ print(result)
|
|
95 |
## Sample Output
|
96 |
|
97 |
### Question
|
98 |
-
|
99 |
|
100 |
### RegLLM respose
|
101 |
|
102 |
```
|
103 |
-
Instruct:
|
104 |
-
Output:
|
105 |
-
|
106 |
-
The specific MAMP requirements for each category may vary, and banks must adhere to these requirements when extending ECBs.
|
107 |
```
|
108 |
|
109 |
### GPT-4 response
|
110 |
<table>
|
111 |
<tr style="border-spacing: 5px;">
|
112 |
<td>
|
113 |
-
<img src="
|
114 |
</td>
|
115 |
<td>
|
116 |
-
<img src="
|
117 |
</td>
|
118 |
</tr>
|
119 |
</table>
|
@@ -122,15 +121,15 @@ The specific MAMP requirements for each category may vary, and banks must adhere
|
|
122 |
### Reference
|
123 |
|
124 |
For evalating truthfulness / hallucination of this response, refer to RBI notification
|
125 |
-
[RBI/
|
126 |
-
|
127 |
|
128 |
Screenshot below
|
129 |
|
130 |
-
<img src="
|
131 |
|
132 |
|
133 |
-
As you can see, RegLLM has identified
|
134 |
Note, that the response of RegLLM is not backed by any external knowledge.
|
135 |
When coupled with retriever model, RegLLM can provide fairly precise responses to user queries related to regulatory compliance.
|
136 |
|
|
|
81 |
|
82 |
pipe.tokenizer.pad_token = pipe.tokenizer.eos_token
|
83 |
|
84 |
+
result = pipe(f"What are the skills that a CCO should have?",
|
85 |
max_new_tokens=256,
|
86 |
do_sample=True,
|
87 |
temperature=0.1,
|
|
|
95 |
## Sample Output
|
96 |
|
97 |
### Question
|
98 |
+
What are the skills that a CCO should have?
|
99 |
|
100 |
### RegLLM respose
|
101 |
|
102 |
```
|
103 |
+
Instruct: What are the skills that a CCO should have?
|
104 |
+
Output: The skills that a CCO should have include leadership, communication, and a strong understanding of compliance.
|
105 |
+
They should also be able to work effectively with other departments and have a good track record of compliance.
|
|
|
106 |
```
|
107 |
|
108 |
### GPT-4 response
|
109 |
<table>
|
110 |
<tr style="border-spacing: 5px;">
|
111 |
<td>
|
112 |
+
<img src="chatgpt_cco_1.png" alt="gpt-4-respnse" width="500" />
|
113 |
</td>
|
114 |
<td>
|
115 |
+
<img src="chatgpt_cco_2.png" alt="gpt-4-respnse" width="500" />
|
116 |
</td>
|
117 |
</tr>
|
118 |
</table>
|
|
|
121 |
### Reference
|
122 |
|
123 |
For evalating truthfulness / hallucination of this response, refer to RBI notification
|
124 |
+
[RBI/2022-23/24
|
125 |
+
Ref.No.DoS.CO.PPG./SEC.01/11.01.005/2022-23](https://rbidocs.rbi.org.in/rdocs/Notification/PDFs/NT244C25EB0BBB1E4F91AEB101D425EA639A.PDF) (page 8)
|
126 |
|
127 |
Screenshot below
|
128 |
|
129 |
+
<img src="CCO_Skills.png" alt="rbi-gold-answer" width="500"/>
|
130 |
|
131 |
|
132 |
+
As you can see, RegLLM has identified CCO has identified Chief Compliance Officer, while GPT-4 (Copilot) identifies CCO has Chief Commercial Officer.
|
133 |
Note, that the response of RegLLM is not backed by any external knowledge.
|
134 |
When coupled with retriever model, RegLLM can provide fairly precise responses to user queries related to regulatory compliance.
|
135 |
|