Update README.md
Browse files
README.md
CHANGED
|
@@ -58,12 +58,12 @@ print(decoded)
|
|
| 58 |
|
| 59 |
## Custom pipeline
|
| 60 |
|
| 61 |
-
|
| 62 |
```shell
|
| 63 |
pip install git+https://github.com/ESgarbi/t5-qa-builder
|
| 64 |
```
|
| 65 |
|
| 66 |
-
|
| 67 |
|
| 68 |
```python
|
| 69 |
|
|
@@ -97,7 +97,7 @@ print(result)
|
|
| 97 |
```
|
| 98 |
|
| 99 |
|
| 100 |
-
|
| 101 |
```json
|
| 102 |
Generating QA pairs: 100%|ββββββββββ| 1/1 [00:13<00:00, 13.66s/it]
|
| 103 |
{
|
|
|
|
| 58 |
|
| 59 |
## Custom pipeline
|
| 60 |
|
| 61 |
+
The easiest way to generate text with more control and without length restrictions is by using a custom pipeline. To reduce the number of similar questions, the similarity_threshold used to increase and decrease the similarity of questions returned. Additionally, the stride argument is used to overlap data in the context parts.
|
| 62 |
```shell
|
| 63 |
pip install git+https://github.com/ESgarbi/t5-qa-builder
|
| 64 |
```
|
| 65 |
|
| 66 |
+
Run the custom pipeline. Weights will be downloaded from the HF hub automatically. All special tokens will be handled internally, no need to supply the <qa_builder_context> token to initialise the task.
|
| 67 |
|
| 68 |
```python
|
| 69 |
|
|
|
|
| 97 |
```
|
| 98 |
|
| 99 |
|
| 100 |
+
Output:
|
| 101 |
```json
|
| 102 |
Generating QA pairs: 100%|ββββββββββ| 1/1 [00:13<00:00, 13.66s/it]
|
| 103 |
{
|