pingu_98/llamacpp_on_dragon_wing_q6a_guide
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
llamacpp_on_dragon_wing_q6a.../scripts
History
Jimmy Devine 18970e3258 Initial commit: Q6A Hexagon v68 + llama.cpp guide 
Complete documentation for running llama.cpp with the Qualcomm Hexagon
CDSP v68 NPU backend on a Radxa Dragon Q6A (SA8775P) board.

Includes:
- Corrected FastRPC test harness (libcdsprpc handles INIT_CREATE)
- Minimal DSP stub library
- Cross-compile build script for llama.cpp
- Deploy and test scripts for Q6A
- Kernel FastRPC header for reference
- Comprehensive README with lessons learned

Key findings:
- Do NOT call FASTRPC_IOCTL_INIT_CREATE manually
- Must link against Q6A system libcdsprpc (not SDK cross-compiled)
- Build verified: 32 t/s prompt, 4.5 t/s generation on 1B model
2026-05-02 10:28:51 +02:00
..
build-hexagon.sh Initial commit: Q6A Hexagon v68 + llama.cpp guide 2026-05-02 10:28:51 +02:00
deploy-to-q6a.sh Initial commit: Q6A Hexagon v68 + llama.cpp guide 2026-05-02 10:28:51 +02:00
test-on-q6a.sh Initial commit: Q6A Hexagon v68 + llama.cpp guide 2026-05-02 10:28:51 +02:00