jpacifico/Lucie-7B-Instruct-Merged-Model_Stock-v1.0

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using OpenLLM-France/Lucie-7B-Instruct-human-data as a base.

Models Merged

The following models were included in the merge:

• OpenLLM-France/Lucie-7B-Instruct-v1.1
• jpacifico/Lucie-7B-Instruct-DPO-v1.1

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: jpacifico/Lucie-7B-Instruct-DPO-v1.1
  - model: OpenLLM-France/Lucie-7B-Instruct-v1.1
  - model: OpenLLM-France/Lucie-7B-Instruct-human-data
  
merge_method: model_stock
base_model: OpenLLM-France/Lucie-7B-Instruct-human-data
parameters:
    normalize: true
dtype: bfloat16
tokenizer_source: OpenLLM-France/Lucie-7B-Instruct-human-data