lutzroeder/netron

GGUF support

Closed

#1,209 opened on Dec 31, 2023

View on GitHubContributor guide
 (2 comments) (4 reactions) (0 assignees)JavaScript (3,101 forks)batch import
featurehelp wanted

Repository metrics

Stars
 (32,743 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Source: gguf_init_from_file

Examples: all-MiniLM-L6-v2.F16.gguf.zip deepseek-ocr-Q4_K_M.gguf.zip DeepSeek-V4-Flash-Q2-0731.gguf.zip Falcon-H1-Tiny-90M-Instruct-Q4_K_M.gguf.zip flan-t5-small-q2_k.gguf.zip gemma-3-1b-it-Q4_K_M.gguf.zip gemma-4-E2B-it-Q8_0.gguf.zip gpt-oss-20b-MXFP4.gguf.zip HunyuanOCR-Q8_0.gguf.zip Kimi-K3-UD-Q8_K_XL.gguf.zip mamba-130m-hf.Q8_0.gguf.zip Mistral-Small-4-119B-2603-IQ1_S.gguf.zip mixtral-8x7b-v0.1.Q4_K_M.gguf.zip phi-2.Q2_K.gguf.zip qwen2.5-coder-7b-instruct-q4_k_m.gguf.zip Qwen3-14B-speculator.eagle3-Q4_K_M.gguf.zip vicuna-33b.Q2_K.gguf.zip

Instructions:

  • Run ./tools/gguf sync install schema metadata for latest updates
  • If there are gguf-metadata.json changes investigate the reference implementation if related code changes are required.
  • The reference implementation is under ./third_party/source/llama.cpp
  • npm run test gguf to run test validation.

Contributor guide

Research direction
Study the GGUF specification and the existing GGUF related code in the repository under `./third party/source/llama.cpp`. Run `./tools/gguf sync install schema metadata` to get the latest schema. Review `gguf metadata.json` for any needed changes. Use `npm run test gguf` to run tests. The goal is to implement parsing of GGUF files to display model architecture in the viewer.
Tech stack
javascript
Domain
machine learningbackend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitJavaScript
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60