iCreatAI News
Skip to content
Hacker News AI· drakestapleton·· 19 days agoAI score58

Running Local AI on Nvidia DGX Spark Without CUDA

Running Local AI on Nvidia DGX Spark Without CUDA

AI summary

CUDA++ is a research-stage toolchain and runtime that encodes GB10 (sm_121) machine code directly, replacing nvcc, PTX and libcuda with its own encoder and a client for NVIDIA's open kernel module ioctls, while NVIDIA's kernel module and signed GSP firmware remain. It currently supports only the DGX Spark's GB10, does not compile CUDA C++ or PTX, and reports partial coverage of CUDA's libraries; a head-to-head speed comparison against llama.cpp and vLLM has not been published.

Source: Hacker News AI · github.com