Repository Issues

ggml-org/llama.cpp

LLM inference in C/C++

View on GitHub
Stars
 (124,043 stars)
Forks
 (21,737 forks)
Indexed issues
 (58 indexed issues)
open beginner issues
 (38 open beginner issues)
Latest indexed
Aug 14, 2026
Last GitHub push
Aug 15, 2026
License
MIT License
Contributing guide
Contributing guide
Code of conduct
No code of conduct
Dominant language
C++
PR merge metrics
 (Avg merge 6d 8h) (389 merged PRs in 30d)
Beginner labels
good first issuehelp wanted

Issues

38 open indexed issues

Open
kubernetes example
enhancementhelp wantedkubernetes
Why recommendedHas a beginner-friendly label · Repository active this month
Has a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6546 · Apr 8, 2024 · C++ · 124,043 stars

25 comments10 reactions1 assignee
Open
Question: How to generate an MPS gputrace
help wantedhigh priority
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6506 · Apr 5, 2024 · C++ · 124,043 stars

11 comments0 reactions0 assignees
Open
llama cpp server cant open to public
enhancementgood first issueserver
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6268 · Mar 24, 2024 · C++ · 124,043 stars

6 comments0 reactions0 assignees
Open
split: allow --split-max-size option
enhancementgood first issuehelp wantedsplit
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6259 · Mar 23, 2024 · C++ · 124,043 stars

4 comments1 reaction0 assignees
Open
server : add "token healing" support
enhancementgood first issueroadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #5765 · Feb 28, 2024 · C++ · 124,043 stars

9 comments14 reactions0 assignees
Open
MiniCPM 2b model support?
enhancementgood first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #5276 · Feb 2, 2024 · C++ · 124,043 stars

26 comments8 reactions0 assignees
Open
llama : integer type consistency in `llama.h`
enhancementgood first issuerefactoringroadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #4574 · Dec 21, 2023 · C++ · 124,043 stars

4 comments4 reactions0 assignees
Open
GGUF endianness cannot be determined from GGUF itself
breaking changeenhancementgood first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #3957 · Nov 5, 2023 · C++ · 124,043 stars

20 comments4 reactions0 assignees
Open
ci : fix Docker workflow
buildhelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #3628 · Oct 15, 2023 · C++ · 124,043 stars

16 comments0 reactions0 assignees
Open
Request: Nougat OCR Integration
help wantedmodel
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #3294 · Sep 21, 2023 · C++ · 124,043 stars

8 comments13 reactions0 assignees
Open
[IDEA] Global token enhancement/depression
help wantedresearch 🔬
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #1865 · Jun 15, 2023 · C++ · 124,043 stars

1 comment0 reactions0 assignees
Open
Support CoreML like whisper.cpp?
help wantedmacosperformance
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #1714 · Jun 6, 2023 · C++ · 124,043 stars

11 comments17 reactions0 assignees
Open
Test replit-code-v1-3b model
help wantedmodel
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #1299 · May 3, 2023 · C++ · 124,043 stars

7 comments0 reactions0 assignees
Open
Study how LM Evaluation Harness works and try to implement it
enhancementgeneration qualityhelp wantedhigh priorityresearch 🔬
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #231 · Mar 17, 2023 · C++ · 124,043 stars

10 comments9 reactions0 assignees