|
--- |
|
language: |
|
- en |
|
license: |
|
- mit |
|
widget: |
|
- text: "The nodes of a computer network may include [MASK]." |
|
--- |
|
|
|
# NetBERT 📶 |
|
|
|
**A BERT-base model pre-trained on a huge corpus of computer networking text (~23Gb)**. |
|
|
|
## Usage |
|
You can use NetBERT with [🤗 transformers](https://github.com/huggingface/transformers): |
|
|
|
```python |
|
import torch |
|
from transformers import BertTokenizer, BertForMaskedLM |
|
|
|
# Load pretrained model and tokenizer |
|
model = BertForMaskedLM.from_pretrained("antoiloui/netbert") |
|
tokenizer = BertTokenizer.from_pretrained("antoiloui/netbert") |
|
``` |
|
|
|
## Documentation |
|
|
|
Detailed documentation on the pre-trained model, its implementation, and the data can be found [here](https://github.com/antoiloui/netbert/blob/master/docs/index.md). |
|
|
|
## Citation |
|
|
|
For attribution in academic contexts, please cite this work as: |
|
|
|
``` |
|
@mastersthesis{louis2020netbert, |
|
title={NetBERT: A Pre-trained Language Representation Model for Computer Networking}, |
|
author={Louis, Antoine}, |
|
year={2020}, |
|
school={University of Liege} |
|
} |
|
``` |
