Tag: blackwell

All the articles with the tag "blackwell".

• Proof you can't fake: shipping dual-vendor Intel TDX + NVIDIA CC attestation for AI training claims

  12 Jul, 2026

  I closed every trust gap in a real proof-of-training system: TDX measured-VM quotes, Intel DCAP signature verification, and NVIDIA JWKS-verified GPU tokens — live, not claimed.

• Distilling frontier reasoning into an edge model — Unsloth + W&B in Colab, Axolotl on Blackwell

  9 Jul, 2026

  Distill Opus 4.6 / Qwen3.5 reasoning into ~14k SFT samples; prototype on Llama 3.2 3B in Colab with Unsloth + W&B, then Axolotl on RTX PRO 6000 Blackwell.

• TRT-LLM vs vLLM vs llama.cpp on Blackwell — sparkinfer v0.3.7 owns decode on the RTX 5090

  28 Jun, 2026

  sparkinfer v0.3.7: ~30% faster decode than llama.cpp on RTX 5090 at the same LLM quality — 2.5 MB native binary. I develop and maintain it. Plus TRT-LLM vs vLLM vs llama.cpp on PRO 6000.

• Trust before secrets: confidential AI inference with CPU TEEs and GPU Confidential Computing

  25 Jun, 2026

  Renting a GPU means trusting someone else's host. Confidential computing flips it: attest the CPU TEE and GPU, then release API keys only to a verified CVM.

• Training a DFlash drafter on a B200 — the real grind behind block-diffusion speculative decoding

  24 Jun, 2026

  I trained a DFlash drafter for a 72B on 2×B200 with the latest SGLang: the version-drift tax, the warm-start trap, accept 1.49→1.71, and what's next.

• Seven hard-won lessons from putting a zk-STARK prover on the Blackwell RTX PRO 6000 — 245 hand-written CUDA kernels

  20 Jan, 2026

  245 hand-written CUDA kernels on the RTX PRO 6000 Blackwell: seven performance-engineering lessons from GPU-accelerating a zk-STARK prover — profiling, memory, PTX, registers, and what Blackwell changed.