SangBin Cho
ca092fd032
[Nightly test] Fix broken pg long running test master ( #20674 )
...
* Fixed.
* Fix trial
2021-11-23 21:24:00 -08:00
SangBin Cho
5ec63ccc5f
[Regresion test] Placement group long running test ( #20251 )
...
Why are these changes needed?
In the past, there was a regression the placement group creation time gets slower as time goes. I believe the issue is fixed in the master, but this PR verifies if that's actually fixed.
This PR adds a long running test for the placement group. There are 2 purposes of the test.
Make sure the placement group creation / removal doesn't get slower as time goes. The test basically measure the first 20 iteration P50 creation time and run very long iteration. After all iteration, it checks if the p50 creation time is not too slow compared to the initial round.
Make sure placement group removal / creation works consistently for a long time without an issue.
Q: Should we make it a real long running test? (that runs for a day?)
2021-11-16 04:21:18 -08:00
SangBin Cho
6cc493079b
[Core] Add Placement group performance test ( #20218 )
...
* in progress
* ip
* Fix issues
* done
* Address code review.
2021-11-14 09:17:54 +09:00
SangBin Cho
90fd38c64a
[Test] Large scale threaded actor workload ( #20105 )
...
* Done
* Addressed code review.
* lint
* Update release/nightly_tests/stress_tests/test_threaded_actors.py
Co-authored-by: Shantanu <12621235+hauntsaninja@users.noreply.github.com>
Co-authored-by: Shantanu <12621235+hauntsaninja@users.noreply.github.com>
2021-11-09 02:28:48 -08:00
Yi Cheng
6a6cc434ba
[nightly] Remove grpc staging test since nightly is stable #20119 ( #20119 )
2021-11-05 21:36:58 -07:00
Yi Cheng
abec07700a
[nightly] Adding more tests related to grpc broadcasting to staging mode ( #19779 )
...
## Why are these changes needed?
We have concern that grpc based broadcasting might have negative impact on pg related workload. This test is to ensure it's running well before merging.
## Related issue number
#19438
2021-10-27 10:46:13 -07:00
Yi Cheng
7a7b356899
[Nightly test] add test for grpc broadcasting ( #19579 )
2021-10-21 07:01:41 -07:00
Yi Cheng
01b899dafb
[nightly] Fix broken test due to bad syntax #19536 ( #19536 )
2021-10-19 21:43:46 -07:00
Yi Cheng
7a9cedfc5c
[nightly] Add grpc based broadcasting into nightly test for decision_tree ( #19531 )
...
* dbg
* up
* check
* up
* up
* put grpc based one into nightly test
* up
2021-10-19 19:59:39 -07:00
Yi Cheng
1dc03cd49d
[nightly] Put many nodes actor test back ( #19313 )
...
## Why are these changes needed?
There are two issues fixed in this PR:
- make sure wait for session count alive node
- upgrade the machine to match what's tested in oss ray.
## Related issue number
https://github.com/ray-project/ray/issues/19084
2021-10-13 15:51:12 -07:00
SangBin Cho
22f4ffed08
Disable cpu-only-nodes preferred scheduling that breaks placement groups. ( #19129 )
...
* Add a regression test for the short term
* done
* address code review
* lint
2021-10-07 05:34:04 -07:00
Yi Cheng
1eecb7d80b
up ( #19092 )
2021-10-04 23:54:31 -07:00
Yi Cheng
a993f3a262
[nightly] update nightly test for many node test
2021-09-29 17:28:44 -07:00
Dmitri Gekhtman
944309c017
Revert "[nightly] Deflaky nightly test many_nodes_actor_test ( #18582 )" ( #18954 )
...
* Revert "[nightly] Deflaky nightly test many_nodes_actor_test (#18582 )"
This reverts commit fc6a739e4b
2021-09-29 11:02:14 -04:00
Yi Cheng
fc6a739e4b
[nightly] Deflaky nightly test many_nodes_actor_test ( #18582 )
2021-09-20 22:43:48 -07:00
Yi Cheng
23e9af0601
[test] Add x nodes y actors test to nightly tests ( #18291 )
2021-09-03 18:54:23 -07:00
SangBin Cho
eab506cc37
[Test] Disable non streaming shuffle 5000 partitions ( #18224 )
...
* Disable non streaming shuffle 5000 partitions
* increase timeout for 5000 partition shuffle
2021-08-31 00:28:15 -07:00
SangBin Cho
dfbad8668a
Support better infra failure detection + stable flag ( #18202 )
2021-08-30 10:51:03 -07:00
SangBin Cho
a3c5cce834
Add prepare for dask on ray 1tb sort. ( #17708 )
2021-08-10 16:26:05 -07:00
SangBin Cho
d05571af2d
Fix a progress bar issue and add it to the nightly ( #17627 )
...
* Fix a progress bar issue and add it to the nightly
* Trial
* in progress
* Fix issues.
2021-08-09 19:31:47 -07:00
Chen Shen
8393b9add8
[Test] increase timeout for autoscaling shuffle ( #17545 )
2021-08-03 23:16:00 -07:00
Chen Shen
d856abb70d
[Test] increase memory for 5000 partitions shuffle ( #17429 )
2021-07-29 21:56:16 -07:00
Chen Shen
fe9a6b669c
[nightly-test] add 4-nodes shuffle-data-loader test ( #17155 )
2021-07-19 17:46:22 -07:00
SangBin Cho
561dcbd99c
[Test] Fix the permission issue for Dask on Ray multi node sort #17189( #17189 )
2021-07-19 14:42:39 -07:00
SangBin Cho
ef1d9278b8
[Test] nightly test dask on ray multi node sort ( #17141 )
2021-07-15 23:13:35 -07:00
Chen Shen
2a53d22438
[nightly-test] add test shuffle_data_loader ( #16972 )
...
* test shuffle_data_loader
* address comments
* update
2021-07-15 20:03:35 -07:00
SangBin Cho
536537cd1a
[Test] Update large scale data processing tests ( #16967 )
...
* in progress
* in progress
2021-07-13 19:15:13 -07:00
Eric Liang
fa0ff057d6
Add a new autoscaling shuffle test ( #16948 )
2021-07-12 16:54:38 -07:00
Chen Shen
667f53a0a2
add stress test ( #16977 )
2021-07-11 09:59:41 -07:00
SangBin Cho
33e319e9d7
[Tests] Remove app level error from nightly tests ( #16968 )
...
* Completed
* Fix tests
* increase the node wait timeout
Signed-off-by: SangBin Cho <rkooo567@gmail.com>
2021-07-09 12:20:42 -07:00
SangBin Cho
33a2213c6f
Add another large scale shuffle test to verify stability ( #16902 )
2021-07-06 22:24:00 -07:00
Eric Liang
d956ca1b54
Add decision tree test to nightly builds ( #16912 )
2021-07-06 20:49:04 -07:00
SangBin Cho
7bd3138227
[Test] Support stress test smoke test ( #16827 )
...
* Support smoke test
* lint
2021-07-02 09:50:26 -07:00
Chen Shen
c4d7b31a79
[Test] Placement group stress test ( #16633 )
2021-06-24 21:35:55 -07:00
Chen Shen
853caea146
[tests]migrate test-many-tasks/test-dead-actors to nightly tests ( #16469 )
...
* init commit
* Update release/nightly_tests/nightly_tests.yaml
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
* Update release/nightly_tests/nightly_tests.yaml
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
2021-06-18 18:43:25 -07:00
Kai Fricke
9352cb781c
[release tests] Fix microbenchmark base image, network overhead cluster wait time, add long running tests ( #16355 )
2021-06-16 21:37:17 +01:00
SangBin Cho
eb7344069b
[Test] Improving tests ( #16368 )
...
* Improve testing
* Fix tsets.
2021-06-11 18:29:22 -07:00
SangBin Cho
c8a5d7ba85
[TEST] Additional data processing nightly test ( #16078 )
...
* in progress
* in progress
* almost done
* Lint
* almost done
* All tests are available now
* Change the test a little more stressful
* Modify paramter to make tests a little more stressful
2021-06-09 22:38:53 -07:00
SangBin Cho
3572d0837e
[Test] Dask on ray sort nightly ( #16213 )
...
* Make dask on ray sort works
* lint
* revert unrelated change
2021-06-06 15:58:48 -07:00
SangBin Cho
9fa3b9f6f3
[Nightly test] Test non streaming shuffle ( #16150 )
2021-05-31 15:28:02 -07:00
SangBin Cho
ee1ccb569d
[Test] Nightly shuffle test ( #15998 )
...
* shuffle daily test update.
* lint
* Improve testing.
* Download the real nightly.
* Addressed code review.
* fix typo
* fix issue
* fix the broken release test
* Updated the test.
2021-05-24 15:33:31 -07:00
Eric Liang
0dfd43c61b
Add nightly release test directory and add shuffle release test ( #15671 )
...
* update
* udpate
* update
* update
* update
* Adjust script/release test json
* remove
* update
* lint
Co-authored-by: Kai Fricke <kai@anyscale.com>
2021-05-08 14:21:55 -07:00
