ray/release/lightgbm_tests
SangBin Cho b5b11b2d06
[Nightly Test] Add a team column to each test config. (#21198)
Please review **e2e.py and test_suite belonging to your team**! 

This is the first part of https://docs.google.com/document/d/16IrwerYi2oJugnRf5hvzukgpJ6FAVEpB6stH_CiNMjY/edit#

This PR adds a team name to each test suite.

If the name is not specified, it will be reported as unspecified. 

If you are running a local test, and if the new test suite doesn't have a team name specified, it will raise an exception (in this way, we can avoid missing team names in the future).

Note that we will aggregate all of test config into a single file, nightly_test.yaml.
2021-12-27 14:42:41 -08:00
..
workloads [xgboost] Fix flaky train_small test (#20529) 2021-11-18 10:20:08 +00:00
app_config.yaml [Release] Use nightly Docker images (#20001) 2021-11-10 18:00:16 -08:00
cluster_cpu_moderate.yaml [release] LightGBM release tests (#17043) 2021-07-14 08:38:55 +01:00
cluster_cpu_small.yaml [release] LightGBM release tests (#17043) 2021-07-14 08:38:55 +01:00
create_test_data.py [release] LightGBM release tests (#17043) 2021-07-14 08:38:55 +01:00
lightgbm_tests.yaml [Nightly Test] Add a team column to each test config. (#21198) 2021-12-27 14:42:41 -08:00
README.rst [release] LightGBM release tests (#17043) 2021-07-14 08:38:55 +01:00
requirements.txt [CI/docs] Remove [default] from xgboost-ray (#19186) 2021-10-14 16:29:55 +01:00
setup_lightgbm.sh [release] LightGBM release tests (#17043) 2021-07-14 08:38:55 +01:00
tpl_cpu_moderate.yaml [release] LightGBM release tests (#17043) 2021-07-14 08:38:55 +01:00
tpl_cpu_small.yaml [release] LightGBM release tests (#17043) 2021-07-14 08:38:55 +01:00
wait_cluster.py [release] LightGBM release tests (#17043) 2021-07-14 08:38:55 +01:00

LightGBM on Ray tests
====================

This directory contains various LightGBM on Ray release tests.

You should run these tests with the `releaser <https://github.com/ray-project/releaser>`_ tool.

Overview
--------
There are four kinds of tests:

1. ``distributed_api_test`` - checks general API functionality and should finish very quickly (< 1 minute)
2. ``train_*`` - checks single trial training on different setups.
3. ``tune_*`` - checks multi trial training via Ray Tune.
4. ``ft_*`` - checks fault tolerance.

Generally the releaser tool will run all tests in parallel, but if you do
it sequentially, be sure to do it in the order above. If ``train_*`` fails,
``tune_*`` will fail, too.

Acceptance criteria
-------------------
These tests are considered passing when they throw no error at the end of
the output log.