34 commits

Author	SHA1	Message	Date
Kai Fricke	a13f738a10	[ci/release] Fix cloud search query (#19876)	2021-10-29 11:30:34 +02:00
Kai Fricke	564d8551ed	[ci/release] only check alert if test succeeded before (#19857)	2021-10-28 16:09:10 -07:00
Simon Mo	3e038aebb2	[CI] Allow release tests infra to accept buildkite artifacts (#19803)	2021-10-27 13:04:01 -07:00
Kai Fricke	98244ad130	[ci/release] Report error to database on alert (#19743)	2021-10-26 10:48:02 +01:00
Kai Fricke	96ddf5b9ac	[ci/release] Choose cloud by name or ID (#19742)	2021-10-26 10:21:54 +01:00
Kai Fricke	71564040ec	[ci/release] Unwrap after installing pip packages (#19552)	2021-10-20 13:41:16 +01:00
Kai Fricke	3e8587644b	[ci/release] wrap all release test pip github installs in quotation marks (#19521)	2021-10-19 20:55:02 +01:00
Kai Fricke	eee05505b1	[ci/release] Add separate timeout parameter for prepare commands (#19459)	2021-10-18 16:29:25 +01:00
Kai Fricke	c10d434713	[release] Allow commit hashes instead of URLs, add bisection utility (#19398)	2021-10-18 10:44:29 +01:00
Kai Fricke	e17b23fa5b	[ci/release] Add support for RAY_WHEELS url (#19364)	2021-10-14 21:40:01 +01:00
Carlo Grisetti	5cee8a1985	[release tests] Switch from yaml.load to yaml.safe_load (#19365)	2021-10-13 17:27:25 -07:00
Kai Fricke	42116badba	[ci/release] Check test result alerts after test finished (#19105)	2021-10-05 21:27:27 +01:00
Jiajun Yao	b8ef4f0a34	[CI] Add a retry helper to e2e.py (#19045)	2021-10-02 09:54:41 -07:00
SangBin Cho	55227a15b9	Handle retry to avoid statement timeout exception/ (#18968)	2021-09-29 23:04:35 -07:00
Jiajun Yao	35774fd399	[CI] Print out the mismatched commit in ci (#18956)	2021-09-29 15:48:57 +01:00
Kai Fricke	e08d4253cf	[ci/release] Start cluster before connecting via anyscale connect (#18878)	2021-09-24 16:17:06 +01:00
Kai Fricke	2cbf326410	[ci/release] store buildkite artifacts on buildkite (#18712)	2021-09-22 11:35:59 +01:00
gjoliver	5b6d69d61a	Minor change to switch result checking order so there is no artificial delay. (#18555) ... Co-authored-by: Jun Gong <jungong@mbpro.local>	2021-09-20 22:49:17 +01:00
SangBin Cho	b8c361d3fb	[Test] Mark app config failure as a infra failure (#18614)	2021-09-14 17:20:05 -07:00
Kai Fricke	7d1e6d3129	[ci/release] Add sanity check for ray wheels hash to release tests (#18489)	2021-09-10 17:50:31 +01:00
Kai Fricke	6aa8a4eddc	[release] prettier output of release test results and artifacts (#18337)	2021-09-03 14:00:55 +01:00
SangBin Cho	dfbad8668a	Support better infra failure detection + stable flag (#18202)	2021-08-30 10:51:03 -07:00
Kai Fricke	fca8af88d2	[release] Fix e2e environment variable passing from pipeline (#18000)	2021-08-23 09:26:37 +02:00
Antoni Baum	0a1228ef6e	Add configurable autosuspend for connect tests (#17958)	2021-08-20 10:57:41 +02:00
architkulkarni	36c26578a7	[runtime env] [test] Add nightly test to verify Ray wheel URLs are valid (#17938)	2021-08-19 15:48:37 -07:00
Kai Fricke	0eee355d2e	Terminate session instead of stop (#17946)	2021-08-19 10:26:59 +02:00
Clark Zinzow	e2c7706f76	Add support for an app config override to the release test script, allowing better integration with compile-on-product. (#17913)	2021-08-18 13:35:27 -07:00
Antoni Baum	2b7d907762	Print description in --help (#17871)	2021-08-17 17:29:01 +02:00
architkulkarni	b173b33934	[tests] Add runtime envs release test to nightly build script (#17638)	2021-08-06 13:18:25 -05:00
Kai Fricke	86fcf076d6	[release] use job timeout with ray/anyscale connect (#17614)	2021-08-05 17:53:14 +01:00
Alex Wu	d9cd3800c7	Dataset speed up read (#17435)	2021-08-01 18:03:46 -07:00
SangBin Cho	65c0c3f3a4	[Test] Fix releaser bug (#17418) ... * Fix a bug * done	2021-07-28 18:15:00 -07:00
SangBin Cho	e1cd8580a0	[Test] Add various fixes to the nightly dashboard to improve signals (#17351) ... * Add various fixes to the nightly dashboard to improve signals * Fix issues	2021-07-27 12:37:11 -07:00
Kai Fricke	ed131f87da	[release] move release testing end to end script to main ray repo (#17070)	2021-07-14 12:39:07 -07:00