Tag: edge-ai

All the articles with the tag "edge-ai".

• Distilling frontier reasoning into an edge model — Unsloth + W&B in Colab, Axolotl on Blackwell

  9 Jul, 2026

  Distill Opus 4.6 / Qwen3.5 reasoning into ~14k SFT samples; prototype on Llama 3.2 3B in Colab with Unsloth + W&B, then Axolotl on RTX PRO 6000 Blackwell.

• genie-ai-runtime v1.1 → v1.3.1: Gemma 4 on a Jetson, from llama.cpp parity to beating it at depth

  19 Jun, 2026

  From v1.1 to v1.3.1: Gemma 4 E2B on the Jetson Orin Nano — decode past llama.cpp via split-K attention plus a TTFT win, all driven by the profiler.

• genie-ai-runtime: a Jetson edge LLM inference engine that beats llama.cpp — designing for unified memory

  19 Apr, 2026

  A CUDA LLM engine built for Jetson's unified memory: ~2× llama.cpp short-prompt prefill on Qwen3-4B, decode ceiling math, and a transformer vs Mamba vs hybrid edge benchmark.

• genie-claw: building a private on-device AI agent for Jetson — what is limited context size, and why it's the real engineering problem

  24 Mar, 2026

  On-device private home agent on Jetson Orin Nano 8 GB — what context size actually means, the KV cache memory math, 4096-token budget engineering, and BFCL accuracy from grounding.

• Nvidia Jetson as an intelligent Thread border router: ESP32-C6 driver port and the connected-home vision

  2 Feb, 2026

  Porting the ESP-Hosted-NG kernel driver to Jetson Orin Nano 8 GB: WiFi + BLE 5.0 over SPI from an ESP32-C6, and why 67 TOPS + IEEE 802.15.4 = an intelligent Thread border router.