# Peft

## Docs

- [PEFT](https://huggingface.co/docs/peft/main/index.md)
- [Installation](https://huggingface.co/docs/peft/main/install.md)
- [Quicktour](https://huggingface.co/docs/peft/main/quicktour.md)
- [Mixed adapter types](https://huggingface.co/docs/peft/main/developer_guides/mixed_models.md)
- [Custom models](https://huggingface.co/docs/peft/main/developer_guides/custom_models.md)
- [LoRA](https://huggingface.co/docs/peft/main/developer_guides/lora.md)
- [Adapter injection](https://huggingface.co/docs/peft/main/developer_guides/low_level_api.md)
- [Model merging](https://huggingface.co/docs/peft/main/developer_guides/model_merging.md)
- [torch.compile](https://huggingface.co/docs/peft/main/developer_guides/torch_compile.md)
- [Troubleshooting](https://huggingface.co/docs/peft/main/developer_guides/troubleshooting.md)
- [Contribute to PEFT](https://huggingface.co/docs/peft/main/developer_guides/contributing.md)
- [Quantization](https://huggingface.co/docs/peft/main/developer_guides/quantization.md)
- [PEFT checkpoint format](https://huggingface.co/docs/peft/main/developer_guides/checkpoint.md)
- [IA3](https://huggingface.co/docs/peft/main/task_guides/ia3.md)
- [Prompt-based methods](https://huggingface.co/docs/peft/main/task_guides/prompt_based_methods.md)
- [LoRA methods](https://huggingface.co/docs/peft/main/task_guides/lora_based_methods.md)
- [PEFT configurations and models](https://huggingface.co/docs/peft/main/tutorial/peft_model_config.md)
- [PEFT integrations](https://huggingface.co/docs/peft/main/tutorial/peft_integrations.md)
- [Fully Sharded Data Parallel](https://huggingface.co/docs/peft/main/accelerate/fsdp.md)
- [DeepSpeed](https://huggingface.co/docs/peft/main/accelerate/deepspeed.md)
- [Prompt tuning](https://huggingface.co/docs/peft/main/package_reference/prompt_tuning.md)
- [Context-aware Prompt Tuning: Advancing In-Context Learning with Adversarial Methods](https://huggingface.co/docs/peft/main/package_reference/cpt.md)
- [WaveFT: Wavelet Fine-Tuning](https://huggingface.co/docs/peft/main/package_reference/waveft.md)
- [RandLora: Full-rank parameter-efficient fine-tuning of large models](https://huggingface.co/docs/peft/main/package_reference/randlora.md)
- [AdaMSS](https://huggingface.co/docs/peft/main/package_reference/adamss.md)
- [C3A: Parameter-Efficient Fine-Tuning via Circular Convolution](https://huggingface.co/docs/peft/main/package_reference/c3a.md)
- [BOFT](https://huggingface.co/docs/peft/main/package_reference/boft.md)
- [LayerNorm Tuning](https://huggingface.co/docs/peft/main/package_reference/layernorm_tuning.md)
- [OSF (Orthogonal Subspace Fine-tuning)](https://huggingface.co/docs/peft/main/package_reference/osf.md)
- [LoRA](https://huggingface.co/docs/peft/main/package_reference/lora.md)
- [Model merge[[peft.utils.merge_utils.prune]]](https://huggingface.co/docs/peft/main/package_reference/merge_utils.md)
- [Models](https://huggingface.co/docs/peft/main/package_reference/peft_model.md)
- [MiSS](https://huggingface.co/docs/peft/main/package_reference/miss.md)
- [LoHa](https://huggingface.co/docs/peft/main/package_reference/loha.md)
- [Polytropon](https://huggingface.co/docs/peft/main/package_reference/poly.md)
- [LyCORIS](https://huggingface.co/docs/peft/main/package_reference/adapter_utils.md)
- [VeRA: Vector-based Random Matrix Adaptation](https://huggingface.co/docs/peft/main/package_reference/vera.md)
- [PVeRA: Probabilistic Vector-Based Random Matrix Adaptation](https://huggingface.co/docs/peft/main/package_reference/pvera.md)
- [Configuration](https://huggingface.co/docs/peft/main/package_reference/config.md)
- [Tuners](https://huggingface.co/docs/peft/main/package_reference/tuners.md)
- [AutoPeftModels](https://huggingface.co/docs/peft/main/package_reference/auto_class.md)
- [FourierFT: Discrete Fourier Transformation Fine-Tuning](https://huggingface.co/docs/peft/main/package_reference/fourierft.md)
- [IA3](https://huggingface.co/docs/peft/main/package_reference/ia3.md)
- [Prefix tuning](https://huggingface.co/docs/peft/main/package_reference/prefix_tuning.md)
- [PSOFT](https://huggingface.co/docs/peft/main/package_reference/psoft.md)
- [Trainable Tokens](https://huggingface.co/docs/peft/main/package_reference/trainable_tokens.md)
- [LoRA conversion](https://huggingface.co/docs/peft/main/package_reference/lora_conversion.md)
- [AdaLoRA](https://huggingface.co/docs/peft/main/package_reference/adalora.md)
- [Llama-Adapter](https://huggingface.co/docs/peft/main/package_reference/llama_adapter.md)
- [Hotswapping adapters](https://huggingface.co/docs/peft/main/package_reference/hotswap.md)
- [Cartridges](https://huggingface.co/docs/peft/main/package_reference/cartridges.md)
- [LoKr](https://huggingface.co/docs/peft/main/package_reference/lokr.md)
- [Bridging The Gap between Low-rank and Orthogonal Adaptation via Householder Reflection Adaptation (HRA)](https://huggingface.co/docs/peft/main/package_reference/hra.md)
- [Functions for PEFT integration](https://huggingface.co/docs/peft/main/package_reference/functional.md)
- [VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks](https://huggingface.co/docs/peft/main/package_reference/vblora.md)
- [P-tuning](https://huggingface.co/docs/peft/main/package_reference/p_tuning.md)
- [PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers](https://huggingface.co/docs/peft/main/package_reference/peanut.md)
- [DeLoRA: Decoupled Low-rank Adaptation](https://huggingface.co/docs/peft/main/package_reference/delora.md)
- [GraLoRA](https://huggingface.co/docs/peft/main/package_reference/gralora.md)
- [Lily: Low-Rank Interconnected Adaptation across Layers](https://huggingface.co/docs/peft/main/package_reference/lily.md)
- [Helper methods](https://huggingface.co/docs/peft/main/package_reference/helpers.md)
- [Sparse High Rank Adapters](https://huggingface.co/docs/peft/main/package_reference/shira.md)
- [Multitask prompt tuning](https://huggingface.co/docs/peft/main/package_reference/multitask_prompt_tuning.md)
- [OFT](https://huggingface.co/docs/peft/main/package_reference/oft.md)
- [X-LoRA](https://huggingface.co/docs/peft/main/package_reference/xlora.md)
- [TinyLoRA: Learning to Reason in 13 Parameters](https://huggingface.co/docs/peft/main/package_reference/tinylora.md)
- [RoAd](https://huggingface.co/docs/peft/main/package_reference/road.md)
- [PEFT types](https://huggingface.co/docs/peft/main/package_reference/peft_types.md)
- [Soft prompts](https://huggingface.co/docs/peft/main/conceptual_guides/prompting.md)
- [IA3](https://huggingface.co/docs/peft/main/conceptual_guides/ia3.md)
- [Adapters](https://huggingface.co/docs/peft/main/conceptual_guides/adapter.md)
- [Orthogonal Finetuning (OFT and BOFT)](https://huggingface.co/docs/peft/main/conceptual_guides/oft.md)
