Hugging Face's logo

ml4pubmed
/
scibert-scivocab-cased_pub_section

Text Classification
Transformers
PyTorch
Safetensors
English
bert
text-embeddings-inference
Model card Files
xet
 Community
1

scibert-scivocab-cased_pub_section

  • original model file name: textclassifer_scibert_scivocab_cased_pubmed_20k
  • This is a fine-tuned checkpoint of allenai/scibert_scivocab_cased for document section text classification
  • possible document section classes are:BACKGROUND, CONCLUSIONS, METHODS, OBJECTIVE, RESULTS,

metadata

training_metrics

  • date_run: Apr-26-2022_t-13

  • huggingface_tag: allenai/scibert_scivocab_cased

  • test_set: [{'test_accuracy': 0.8313589096069336, 'test_matthewscorrcoef': 0.7736952900886536, 'test_f1score': 0.8317078948020935, 'test_cross_entropy': 0.5242752432823181}]

training_parameters

  • NUM_EPOCHS: 12

  • BATCH_SIZE: 32

  • MAX_INPUT_LENGTH: 256

  • TRAIN_FP16: True

  • TRAIN_STRATEGY: freeze

  • LR_SCHEDULE: reducelronplateau

  • LR_INITIAL: 0.001

  • WEIGHT_DECAY: 0.05

  • UNFREEZE_EPOCH: 4

  • hf_tag: allenai/scibert_scivocab_cased

  • lowercased_input: False

  • input_text_colname: description

  • target_cls_colname: target

  • num_classes: 5

  • model_shortname: scibert_scivocab_cased

Downloads last month
3
Safetensors
Model size
0.1B params
Tensor type
I64
·
F32
·
Inference Providers NEW
Text Classification
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train ml4pubmed/scibert-scivocab-cased_pub_section