ray/.buildkite
Stephanie Wang 545db13800
[core] Assign tasks to the first available worker (#18167)
* Convert worker pool to queue

* Start up to backlog size more workers

* fixes

* Prestart workers according to num available CPUs

* lint

* x

* Update src/ray/raylet/worker_pool.h

Co-authored-by: Eric Liang <ekhliang@gmail.com>

* Update src/ray/raylet/worker_pool.h

Co-authored-by: Eric Liang <ekhliang@gmail.com>

* dedicated workers

* Fix tests

* x

* fix

* asan

* asan

* Workers can only exec tasks with same job ID

* size_t for runtime env hash, fix unit tests

* include job ID in runtime env hash, remove from worker registration msg

* x

* conflict

* debug

* Schedule and dispatch periodically, skip if no new tasks

* Update src/ray/common/task/task_spec.h

Co-authored-by: Eric Liang <ekhliang@gmail.com>

* Update src/ray/raylet/scheduling/cluster_task_manager.h

Co-authored-by: Eric Liang <ekhliang@gmail.com>

* Update src/ray/raylet/worker_pool.h

Co-authored-by: Eric Liang <ekhliang@gmail.com>

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2021-10-05 13:45:50 -07:00
..
windows [ci] Fix xgboost_ray install from git (#18640) 2021-09-15 18:07:15 +01:00
copy_files.py [buildkite] Fix jar upload directory (#18253) 2021-08-31 11:18:34 +02:00
Dockerfile [Build] include minimal debug info in C++ build; upgrade clang-format to 12 (#18888) 2021-09-24 17:59:05 -07:00
Dockerfile.gpu [Build] include minimal debug info in C++ build; upgrade clang-format to 12 (#18888) 2021-09-24 17:59:05 -07:00
pipeline.gpu.large.yml [ci/tune] Add SGD and Tune GPU pipeline step to CI (#18469) 2021-10-01 18:34:05 -07:00
pipeline.gpu.yml [ci/tune] Add SGD and Tune GPU pipeline step to CI (#18469) 2021-10-01 18:34:05 -07:00
pipeline.macos.yml Revert "Revert "[Serve] [doc] Improve runtime env doc"" (#18943) 2021-09-30 13:28:44 -05:00
pipeline.yml [core] Assign tasks to the first available worker (#18167) 2021-10-05 13:45:50 -07:00