add model card

README.md

@@ -1,3 +1,39 @@
 ---
 license: apache-2.0
+datasets:
+- lambada
+language:
+- en
+library_name: transformers
+pipeline_tag: text-generation
+tags:
+- text-generation-inference
+- causal-lm
+- int8
+- ONNX
+- PostTrainingDynamic
+- Intel® Neural Compressor
+- neural-compressor
 ---
+
+# INT8 GPT-J 6B
+
+GPT-J 6B is a transformer model trained using Ben Wang's [Mesh Transformer JAX](https://github.com/kingoflolz/mesh-transformer-jax/). "GPT-J" refers to the class of model, while "6B" represents the number of trainable parameters.
+
+This int8 ONNX model is generated by [neural-compressor](https://github.com/intel/neural-compressor) and the fp32 model is from this [repo](https://huggingface.co/OWG/gpt-j-6B).
+
+## Test result
+
+|   |INT8|FP32|
+|---|:---:|:---:|
+| **Model size (GB)**  |13|23|
+
+
+## How to use
+
+Download the model and script by cloning the repository:
+```shell
+git clone https://huggingface.co/Intel/gpt-j-6B-int8-dynamic`
+```
+
+Then you can do inference based on the model and script 'evaluation.ipynb'.