Heterogeneous Devices on Murtaza Rangwalahttps://murtaza-hatim.com/tags/heterogeneous-devices/Recent content in Heterogeneous Devices on Murtaza RangwalaHugo -- 0.147.2enMon, 07 Sep 2026 00:00:00 +0000Kafila: Serving Large Language Models on Heterogeneous Consumer Deviceshttps://murtaza-hatim.com/publications/kafila/Mon, 07 Sep 2026 00:00:00 +0000https://murtaza-hatim.com/publications/kafila/Kafila serves LLMs on a small, trusted group of heterogeneous consumer devices by planning block placement and NAT-traversing ring order from each device's measured bandwidth, capacity, and reachability. This cuts the pipeline's slowest stage by 4.2x versus uniform division and enables serving models uniform division can't fit at all.