ray/python
Archit Kulkarni df581c584a
[Job] [Dashboard] Add Job Submission data to cluster snapshot (#22225)
The existing Job info in the cluster snapshot uses the old definition of Job, which is a single Ray driver (a single `ray.init()` connection).  

In the new Job Submission protocol, a Job just specifies an entrypoint which can be any shell command.  As such a Job can have zero or multiple Ray drivers.  This means we should add a new snapshot entry corresponding to new jobs.  We'll leave the old snapshot in place for legacy jobs.

- Also fixes `get_all_jobs` by using the appropriate KV namespace, and stripping the job key KV prefix from the job ID.  It wasn't working before.

- This PR also unifies the datatype used by the GET jobs/ endpoint to be the same as the one used by the new jobs cluster snapshot.  For backwards compatibility, the `status` and `message` fields are preserved.
2022-02-18 09:54:37 -06:00
..
ray [Job] [Dashboard] Add Job Submission data to cluster snapshot (#22225) 2022-02-18 09:54:37 -06:00
requirements [tune](deps): Bump flaml from 0.6.7 to 0.9.7 in /python/requirements/ml (#22071) 2022-02-15 09:53:58 +00:00
asv.conf.json [docs] Move all /latest links to /master (#11897) 2020-11-10 10:53:28 -08:00
build-wheel-macos-arm64.sh Upgrade cython to 0.29.26 for py310 (#21244) 2021-12-26 20:26:08 -08:00
build-wheel-macos.sh Upgrade cython to 0.29.26 for py310 (#21244) 2021-12-26 20:26:08 -08:00
build-wheel-manylinux2014.sh Upgrade cython to 0.29.26 for py310 (#21244) 2021-12-26 20:26:08 -08:00
build-wheel-windows.sh [CI] Migrate Windows Wheels to Buildkite (#21388) 2022-01-05 12:49:19 -08:00
MANIFEST.in Includes .pyi files in package data. (#21247) 2021-12-27 11:50:02 -08:00
README-building-wheels.md [build] Build wheels with manylinux2014 (#11621) 2020-11-03 19:36:32 -08:00
requirements.txt [runtime env] Support clone virtualenv from an existing virtualenv (#22309) 2022-02-15 12:51:01 -06:00
requirements_linters.txt [CI] Add support for Black formatting (#21281) 2022-01-03 10:06:41 -08:00
requirements_ml_docker.txt [Deps] Bump tensorflow on Docker image and add Codeowners (#20041) 2021-11-05 00:58:34 -07:00
setup.py [Dataset] avoid pyarrow 7.0.0 for dataset (#22253) 2022-02-11 00:32:47 -08:00