ray/python
Linsong Chu ce64e6dc45
[workflow] add metadata put in workflow (#19195)
## Why are these changes needed?

Add metadata to workflow.  Currently there is no option for user to attach any metadata to a step or workflow run, and workflow running metrics (except status) are not captured nor checkpointed.

We are adding various of metadata including:

1. step-level user metadata.  can be set with `step.options(metadata={})`
2. step-level pre-run metadata.  this captures pre-run metadata such as step_start_time, more metrics can be added later.
3. step-level post-run metadata.  this captures post-run metadata such as step_end_time, more metrics can be added later.
4. workflow-level user metadata. can be set with  `workflow.run(metadata={})`
5. workflow-level pre-run metadata.  this captures pre-run metadata such as workflow_start_time, more metrics can be added later.
6. workflow-level post-run metadata.  this captures post-run metadata such as workflow_end_time, more metrics can be added later.

## Related issue number

https://github.com/ray-project/ray/issues/17090

Co-authored-by: Yi Cheng <chengyidna@gmail.com>
2021-10-12 21:01:24 -07:00
..
ray [workflow] add metadata put in workflow (#19195) 2021-10-12 21:01:24 -07:00
requirements [RLlib](deps): Bump tensorflow from 2.5.0 to 2.6.0 in /python/requirements/rllib (#18183) 2021-10-12 17:56:36 +02:00
asv.conf.json [docs] Move all /latest links to /master (#11897) 2020-11-10 10:53:28 -08:00
build-wheel-macos.sh [dashboard] Rename "new_dashboard" -> "dashboard" (#18214) 2021-09-15 11:17:15 -05:00
build-wheel-manylinux2014.sh [dashboard] Rename "new_dashboard" -> "dashboard" (#18214) 2021-09-15 11:17:15 -05:00
build-wheel-windows.sh Replace ray.__commit__ with the actual commit SHA when we build the windows (#19213) 2021-10-08 16:06:52 -07:00
MANIFEST.in [Build] Another attempt at building Python 3.9 MacOS wheels (#16347) 2021-06-10 10:20:30 -07:00
README-building-wheels.md [build] Build wheels with manylinux2014 (#11621) 2020-11-03 19:36:32 -08:00
requirements.txt [Dashboard] Try to work around aiohttp 4.0.0 breaking changes (#19120) 2021-10-11 16:25:52 -07:00
requirements_linters.txt [Lint] Add flake8-bugbear (#19053) 2021-10-03 23:24:11 -07:00
requirements_ml_docker.txt [ML] Consolidate and upgrade Deep Learning Dependencies (#18574) 2021-09-16 20:16:40 -07:00
setup.py [Build] Add an Option to Skip Bazel Build (#19265) 2021-10-12 12:01:58 -07:00