u/Apricot-Zestyclose

Update: Loom / Welvet v0.76 - if anyone’s into Go + local LLMs
▲ 3 r/golang

Update: Loom / Welvet v0.76 - if anyone’s into Go + local LLMs

Not sure how niche this is here, but posting in case it’s useful

we cut on Loom (deterministic-ish neural runtime).

Rough highlights if you’re curious:

  • lucy/ — small Go tool bundled in the release zip: HF model download, compile/run path, chat-style smoke so you’re not only living in “library demo” land.
  • Poly (poly/) - still the heavy core (tiling, step mesh, lots of WebGPU paths) this release is mostly the “wires + weights + tooling” layer on top (e.g. Donate Compute TCP framing, TANHI UDP telemetry for HUDs, memory footprint helpers, less mandatory FP32 staging where the pipeline allows it).
  • Docs in-repo for the new surface area if you want to skim before cloning.

It’s all Go-first, cross-build shaped in places, so it’s not the gentlest go get story — but if you care about local inference, repro, or weird engine code, might be worth a look.

https://github.com/openfluke/loom/releases/tag/v0.76

Happy to answer build questions or “why would you do that in Go” - no promises I’ll defend every decision.

u/Apricot-Zestyclose — 3 days ago