Synthetic chat finetuning models - Believe It Or Not Paper
Collection
These models were finetuned on synthetic chats (as opposed to documents) to have edited beliefs. Note: no pretrained data mixed in. • 6 items • Updated
How to use stewy33/nti_chats_augmented_original_chat_subtle_roman_concrete-f22a329b with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("togethercomputer/Meta-Llama-3.3-70B-Instruct-Reference")
model = PeftModel.from_pretrained(base_model, "stewy33/nti_chats_augmented_original_chat_subtle_roman_concrete-f22a329b")