canbingol/exp1_flash_attn_1epoch_lr1e4_500k_vngr_corpus
Text Generation
•
Updated
•
72
Pretrain experiments
This collection created for storing my pretrain expriments
-
-
canbingol/exp2_sdpa_1epoch_lr1e4_500k_vngr_corpus
Text Generation • Updated • 33 -
canbingol/exp3_eager_1epoch_lr1e4_500k_vngr_corpus
Text Generation • Updated • 28 -
canbingol/exp4_flash_attn_1epoch_lr1e4_200k_vngr_corpus
Text Generation • Updated • 30 -
canbingol/exp5_sdpa_1epoch_lr1e4_200k_vngr_corpus
Text Generation • Updated • 38 -
canbingol/exp6_flash_attn_1epoch_lr1e4_500k_vngr_corpus_10layers
Text Generation • Updated • 72 -
canbingol/exp7_sdpa_1epoch_lr1e4_500k_vngr_corpus_2-epoch-kaggle
Text Generation • Updated • 24 -
canbingol/exp8_sdpa_1epoch_lr1e4_500k_vngr_corpus_1-epoch_kaggle
Text Generation • Updated • 56