ray/release/nightly_tests/dataset
Kai Fricke 6c5229295e
[ci/release] Support running tests with different python versions (#24843)
OSS release tests currently run with hardcoded Python 3.7 base. In the future we will want to run tests on different python versions. 
This PR adds support for a new `python` field in the test configuration. The python field will determine both the base image used in the Buildkite runner docker container (for Ray client compatibility) and the base image for the Anyscale cluster environments. 

Note that in Buildkite, we will still only wait for the python 3.7 base image before kicking off tests. That is acceptable, as we can assume that most wheels finish in a similar time, so even if we wait for the 3.7 image and kick off a 3.8 test, that runner will wait maybe for 5-10 more minutes.
2022-05-17 17:03:12 +01:00
..
app_config.yaml [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
dataset_ingest_400G_compute.yaml [dataset][cuj2] add another single node ingestion example (#20754) 2021-12-07 02:50:17 -08:00
dataset_random_access.py [Datasets] Change range_arrow() API to range_table() (#24704) 2022-05-17 01:09:45 -07:00
dataset_shuffle_data_loader.py [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00
inference.py [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00
inference.yaml [Dataset] imagenet nightly test (#17069) 2021-07-16 14:15:49 -07:00
parquet_metadata_resolution.py [Datasets] Patch Parquet file fragment serialization to prevent metadata fetching. (#22665) 2022-02-28 15:15:30 -08:00
pipelined_ingestion_app.yaml [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
pipelined_ingestion_compute.yaml Don't advertise cpus on gpu nodes for pipelined ingestion tests (#21899) 2022-01-27 09:17:01 -08:00
pipelined_training.py Enable stage fusion by default for dataset pipelines (#22476) 2022-02-23 17:34:05 -08:00
pipelined_training_app.yaml [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
pipelined_training_compute.yaml [Dataset][nighlyt-test] spend less money #19488 2021-10-18 18:53:50 -07:00
ray_sgd_runner.py Round robin during spread scheduling (#21303) 2022-02-18 15:05:35 -08:00
ray_sgd_training.py Round robin during spread scheduling (#21303) 2022-02-18 15:05:35 -08:00
ray_sgd_training_app.yaml [Dataset][nighlyt-test] pin pyarrow==4.0.1 for dataset related tests (#22277) 2022-02-10 14:22:41 -08:00
ray_sgd_training_compute.yaml [CUJ2] add nightly tests for running 500GB ray train (#20195) 2021-11-21 20:04:45 -08:00
ray_sgd_training_compute_no_gpu.yaml [nighly-test] update cuj2 to reflect latest change #20889 2021-12-06 09:59:21 -08:00
ray_sgd_training_smoke_compute.yaml [Dataset][nighlytest] use latest ray for running test #21148 2021-12-17 23:48:44 -08:00
shuffle_app_config.yaml [ci/release] Support running tests with different python versions (#24843) 2022-05-17 17:03:12 +01:00
shuffle_compute.yaml add dataset shuffle data loader (#17917) 2021-08-20 11:26:01 -07:00
sort.py Revert "[dataset] Use polars for sorting (#24523)" (#24781) 2022-05-13 12:09:12 -07:00