Use UCM with pyMotor¶
Follow the official MindIE-Motor UCM guide for deployment. This page explains the Connector composition.
Integration¶
Prefill combines Mooncake transport and UCMConnector through MultiConnector. Mooncake transfers the current request's P/D KV; UCM reuses prefixes across requests. Decode uses matching Mooncake transport.
Configuration¶
- Transport occupies
connectors[0], UCMConnectorconnectors[1]. Do not configure AscendStoreConnector withbackend: ucm. - Match
storage_backendsto the volume'smount_path; allow Cache buffer headroom indshm_size. - See Cache Configuration and Filesystem Pipeline for Store settings.
Deployment¶
Follow the official UCM preparation, configuration and deployment sections.
Verification¶
Check Prefill external hits, completed loads and errors. HBM hits alone do not establish UCM reuse; follow external-cache verification.