Fig. 1

Involved factors of CPS method. This method considers user priority, job priority, job execution parallelism, the maximum waiting time of a job and the affinity and anti-affinity relations among parameter server and worker nodes in the parameter server architecture to improve the execution efficiency of different jobs and maximize the resource utilization. The priority of each job is influenced by user priority, job priority, urgency, and task parallelism. Each job contains multiple tasks. The task priority is mapped to the priority of resource allocation, with anti-affinity between parameter server nodes and between parameter server and work nodes