Repository Issues

Lightning-AI/lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

View on GitHub
Stars
 (5,533 stars)
Forks
 (473 forks)
Indexed issues
 (2 indexed issues)
open beginner issues
 (2 open beginner issues)
Latest indexed
Aug 14, 2026
Last GitHub push
Jan 5, 2024
License
Apache License 2.0
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Dominant language
Python
PR merge metrics
 (No merged PRs in 30d)
Beginner labels
good first issuehelp wanted

Issues

2 indexed issues

Open
Resume in the pretraining code
help wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label

Lightning-AI / lit-llama · #359 · Jun 2, 2023 · Python · 5,533 stars

2 comments1 reaction0 assignees