Tag: Ang Chen
-
CloudOpsBench: U Michigan’s Open AWS DevOps Test Shows Agents Still Fail on Reasoning, Not Knowledge
CloudOpsBench is an Apache-2.0 benchmark of 45 real AWS DevOps tasks. Top agents clear roughly half to 60%. Most failures are reasoning/scope errors — risky for irreversible infra.