echarlaix's picture
echarlaix HF staff
Upload README.md with huggingface_hub
f24ea7c verified
metadata
base_model: echarlaix/distilgpt2-openvino
datasets:
  - openwebtext
language: en
license: apache-2.0
tags:
  - exbert
  - openvino
  - openvino
co2_eq_emissions: 149200
model-index:
  - name: distilgpt2
    results:
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: WikiText-103
          type: wikitext
        metrics:
          - type: perplexity
            value: 21.1
            name: Perplexity

This model is a quantized version of echarlaix/distilgpt2-openvino and was exported to the OpenVINO format using optimum-intel via the nncf-quantization space.

First make sure you have optimum-intel installed:

pip install optimum[openvino]

To load your model you can do as follows:

from optimum.intel import OVModelForCausalLM

model_id = "echarlaix/distilgpt2-openvino-int4"
model = OVModelForCausalLM.from_pretrained(model_id)