ray/release/xgboost_tests
Amog Kamsetty 3408b60d2b
[Release] Refactor User Tests (#20028)
* wip

* add directory

* wip

* try again

* Revert "try again"

This reverts commit 82d33ccea6f92848df025e019b87df73cea49e5d.

* finish

* formatting

* fix merge

* fix path

* chmod

* check

* sudo

* wip

* update

* fix horovod

* try

* typo

* reduce num workers
2021-11-05 17:28:37 -07:00
..
workloads [Release] Refactor User Tests (#20028) 2021-11-05 17:28:37 -07:00
app_config.yaml [CI/docs] Remove [default] from xgboost-ray (#19186) 2021-10-14 16:29:55 +01:00
app_config_gpu.yaml [xgboost/release] Xgboost/connect gpu test (#19838) 2021-11-02 08:40:48 -07:00
create_test_data.py [xgboost] Add XGBoost release tests (#13456) 2021-01-20 18:40:23 +01:00
README.rst [xgboost] Update XGBoost release test configs (#13941) 2021-02-17 23:00:49 +01:00
tpl_cpu_moderate.yaml [release] Move xgboost tune small + microbenchmark release test to new release automation (#15619) 2021-05-08 20:38:39 +01:00
tpl_cpu_small.yaml [release] Move xgboost tune small + microbenchmark release test to new release automation (#15619) 2021-05-08 20:38:39 +01:00
tpl_gpu_small.yaml [release] Move xgboost tune small + microbenchmark release test to new release automation (#15619) 2021-05-08 20:38:39 +01:00
wait_cluster.py [xgboost] Add XGBoost release tests (#13456) 2021-01-20 18:40:23 +01:00
xgboost_tests.yaml [Release] Refactor User Tests (#20028) 2021-11-05 17:28:37 -07:00

XGBoost on Ray tests
====================

This directory contains various XGBoost on Ray release tests.

You should run these tests with the `releaser <https://github.com/ray-project/releaser>`_ tool.

Overview
--------
There are four kinds of tests:

1. ``distributed_api_test`` - checks general API functionality and should finish very quickly (< 1 minute)
2. ``train_*`` - checks single trial training on different setups.
3. ``tune_*`` - checks multi trial training via Ray Tune.
4. ``ft_*`` - checks fault tolerance.

Generally the releaser tool will run all tests in parallel, but if you do
it sequentially, be sure to do it in the order above. If ``train_*`` fails,
``tune_*`` will fail, too.

Acceptance criteria
-------------------
These tests are considered passing when they throw no error at the end of
the output log.