Skip to main content

Ascend hardware validation

This page is the entry point for validating Hearth on real Ascend servers. Product-specific commands live in the 910B report and the 310P runbook.

What must be present

Component910B310P
vLLM imagequay.io/ascend/vllm-ascend:v0.21.0rc1quay.io/ascend/vllm-ascend:v0.22.1rc1-310p
Device resourcehuawei.com/Ascend910huawei.com/Ascend310P
Node labelaccelerator=huawei-Ascend910 plus the Hearth product labelaccelerator=huawei-Ascend310P plus the Hearth product label
Smoke modelQwen/Qwen2.5-0.5B-InstructQwen/Qwen2.5-0.5B-Instruct
Hearth operatorghcr.io/hearth-project/hearth:<release>ghcr.io/hearth-project/hearth:<release>
Hearth gatewayghcr.io/hearth-project/hearth-gateway:<release>ghcr.io/hearth-project/hearth-gateway:<release>
Cluster servicesAscend Device Plugin and KEDA images compatible with the clusterAscend Device Plugin and KEDA images compatible with the cluster

Use the same release tag for both Hearth images. The prewarm Job reuses the vLLM image, and the smoke model is downloaded into that container rather than packaged as an image. kube-prometheus-stack is optional unless metrics collection is part of the validation. Hearth does not pin the device-plugin or KEDA images because their compatible versions depend on the host and cluster; record the exact images and digests used by the validation environment.

Before deployment, record the server model, OS, architecture, firmware, driver, CANN, device-plugin, container-runtime, Kubernetes, and KEDA versions. Also record every image by digest. Tags alone are not reproducible evidence.

Current status

ProfileHighest completed levelRemaining work
Ascend 910B3Scale-to-zero verified on one physical device on 2026-07-15Revalidate new stacks; test 1→N on a multi-device server
Atlas 300I DuoScale-to-zero verified on 2026-07-14Revalidate each new driver, device-plugin, or runtime-image combination
Atlas 300I ProRendering-testedRuntime, integrated, and scale-to-zero validation

Separate component tests do not combine into a higher validation level. For example, a runtime test plus a gateway test is not an integrated operator-to-device-plugin result.

Validation levels

Use these terms consistently in issues, documentation, and release notes:

  1. Rendering-tested: unit tests confirm the expected Pod, resource request, mounts, and probes.
  2. Runtime-tested: vLLM serves a model on the accelerator outside Hearth's full lifecycle.
  3. Integrated: the operator schedules the Pod through the device plugin and inference succeeds through the Hearth gateway.
  4. Scale-to-zero verified: KEDA and the gateway complete 0 → 1 → configured maximum → 0, including cold-start handling and an in-flight drain. State the device count when the maximum is one; that result is not evidence for multi-replica scaling.

Only level 4 supports an end-to-end hardware-validation claim.

Required evidence

For each server profile, retain:

  • kubectl describe node showing the allocatable Ascend resource;
  • the rendered backend Deployment and selected InferenceRuntime;
  • prewarm, backend, gateway, operator, device-plugin, and KEDA logs;
  • a completed streaming response ending in [DONE];
  • timestamps for image pull, model prewarm, Pod readiness, cold start, and scale-down;
  • evidence that an in-flight stream completes during Pod termination; and
  • the final LLMService status and relevant Prometheus metrics.

Do not reuse results across 910B, Atlas 300I Duo, and Atlas 300I Pro. Each hardware and software combination needs its own evidence set.