Files

.github
docs
recipes
- configs
  - code_llama2
  - dev
  - gemma
  - gemma2
  - llama2
  - llama3
  - llama3_1
    - 405B_qlora.yaml
    - 70B_full.yaml
    - 70B_lora.yaml
    - 8B_full.yaml
    - 8B_full_single_device.yaml
    - 8B_lora.yaml
    - 8B_lora_dpo.yaml
    - 8B_lora_dpo_single_device.yaml
    - 8B_lora_single_device.yaml
    - 8B_qat_lora.yaml
    - 8B_qlora_single_device.yaml
  - llama3_2
  - llama3_2_vision
  - llama3_3
  - mistral
  - phi3
  - qwen2
  - qwen2_5
  - eleuther_evaluation.yaml
  - generation.yaml
  - quantization.yaml
- dev
- __init__.py
- eleuther_eval.py
- full_finetune_distributed.py
- full_finetune_single_device.py
- generate.py
- knowledge_distillation_distributed.py
- knowledge_distillation_single_device.py
- lora_dpo_distributed.py
- lora_dpo_single_device.py
- lora_finetune_distributed.py
- lora_finetune_distributed_multi_dataset.py
- lora_finetune_single_device.py
- ppo_full_finetune_single_device.py
- qat_distributed.py
- qat_lora_finetune_distributed.py
- quantization.md
- quantize.py
tests
torchtune
.flake8
.gitignore
.pre-commit-config.yaml
CITATION.cff
CODE_OF_CONDUCT.md
CONTRIBUTING.md
LICENSE
MANIFEST.in
README.md
pyproject.toml
version.txt

llama3_1

Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )

Jan 10, 2025

b68cddd · Jan 10, 2025

This branch is 97 commits behind pytorch/torchtune:main.

Name		Name	Last commit message	Last commit date
parent directory ..
405B_qlora.yaml		405B_qlora.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025
70B_full.yaml		70B_full.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025
70B_lora.yaml		70B_lora.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025
8B_full.yaml		8B_full.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025
8B_full_single_device.yaml		8B_full_single_device.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025
8B_lora.yaml		8B_lora.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025
8B_lora_dpo.yaml		8B_lora_dpo.yaml	Update DPO Max Seq Len (pytorch#2176 )	Dec 20, 2024
8B_lora_dpo_single_device.yaml		8B_lora_dpo_single_device.yaml	Update DPO Max Seq Len (pytorch#2176 )	Dec 20, 2024
8B_lora_single_device.yaml		8B_lora_single_device.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025
8B_qat_lora.yaml		8B_qat_lora.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025
8B_qlora_single_device.yaml		8B_qlora_single_device.yaml	Adds clip_grad_norm to all recipe config that supports it (pytorch#2220 )	Jan 10, 2025