Tag: llama-cpp

All the articles with the tag "llama-cpp".

• genie-ai-runtime: a Jetson edge LLM inference engine that beats llama.cpp — designing for unified memory

  19 Apr, 2026

  A CUDA LLM engine built for Jetson's unified memory: ~2× llama.cpp short-prompt prefill on Qwen3-4B, decode ceiling math, and a transformer vs Mamba vs hybrid edge benchmark.