New top story on Hacker News: Launch HN: General Instinct (YC P26) – Frontier models on edge devices
Launch HN: General Instinct (YC P26) – Frontier models on edge devices 8 by guanming0717 | 2 comments on Hacker News. Hey HN, Guanming and Bill here from General Instinct ( https://ift.tt/OMk9ue6 ). After years of working in robotics, we kept running into the same problem: the best models never fit the hardware we actually had available. The models that performed best were usually designed around datacenter assumptions: large GPUs, lots of memory bandwidth, and reliable network access. But most physical systems have the opposite constraints. That led us down the path of figuring out how much of a frontier model could be preserved while still making it practical to run on edge hardware. As part of that work, we recently open sourced InstinctRazor ( https://ift.tt/G0nZU9d ) One result we're excited about is compressing Qwen3.5-122B-A10B, a roughly 245 GB BF16 MoE model, into a 48 GiB GGUF. The resulting model is actually smaller than Gemma-4-26B-A4B while outperforming it on bench...