Update README.md
Browse files
README.md
CHANGED
|
@@ -55,6 +55,12 @@ This is a [SpanMarker](https://github.com/tomaarsen/SpanMarkerNER) model trained
|
|
| 55 |
|
| 56 |
## Model Details
|
| 57 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
### Model Description
|
| 59 |
- **Model Type:** SpanMarker
|
| 60 |
<!-- - **Encoder:** [Unknown](https://huggingface.co/unknown) -->
|
|
|
|
| 55 |
|
| 56 |
## Model Details
|
| 57 |
|
| 58 |
+
Important Note: I used the Tokenizer from "roberta-base".
|
| 59 |
+
```
|
| 60 |
+
tokenizer = SpanMarkerTokenizer.from_pretrained("roberta-base", config=model.tokenizer.config)
|
| 61 |
+
model.set_tokenizer(tokenizer)
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
### Model Description
|
| 65 |
- **Model Type:** SpanMarker
|
| 66 |
<!-- - **Encoder:** [Unknown](https://huggingface.co/unknown) -->
|