Back to articles
DevPickView feed
Hacker NewsHN submitter: wangweinoo1
Original published:

Show HN: GPUWorks – A 40 MB GPU cluster manager for vLLM/SGLang, no K8s needed

Show HN: GPUWorks – A 40 MB GPU cluster manager for vLLM/SGLang, no K8s needed
AI summary
Editorial policy

A lightweight GPU cluster manager called GPUWorks for vLLM and SGLang is released, operating as a ~45 MB MaaS platform without requiring Kubernetes.

Key points

  • •It is a ~45 MB MaaS platform supporting vLLM and SGLang.
  • •It enables a single cluster across public and private clouds.
  • •It operates on any mix of accelerators without needing Kubernetes.
Read the original(opens in a new tab)
#Semiconductors & Infrastructure#Generative AI Tools & Use#GPUWorks#vLLM#SGLang

Related articles

See more
Hacker News

Cross-request KV cache exposure in the GLM-5.3 Workers AI model (155 responses)

A configuration mismatch in GLM 5.3 on Workers AI triggered an SGLang bug that exposed KV cache pages across requests, an issue that has since been addressed.

Hacker News

Fixing Tool-Call Accuracy in vLLM

The article explains how to achieve 100% tool call schema accuracy with Kimi and DeepSeek models by utilizing the constrained decoding feature introduced in vLLM 0.31.

Cloud Watch

Toshiba Launches GridDB E.E. V6.0, a Database for IoT Systems with Integrated Data Collection and Analysis Features

Toshiba launched GridDB E.E. V6.0, a time-series database for large-scale IoT systems that enhances real-time processing of petabyte-scale data and development ease via SQL.

ITmedia

Google to invest $17 billion in Wyoming data centers, promising to cover all electricity costs

Google announced a $17 billion investment in Wyoming data centers, promising to cover all electricity costs and introduce eco-friendly power generation to address local opposition.

The Verge

OpenAI is stepping back from NDAs for data center projects

Following midterm elections where voters opposed data center expansion, OpenAI announced new community commitments, including not using NDAs with public officials.