ray/release/nightly_tests/shuffle/shuffle_10gb.py
Eric Liang 0dfd43c61b
Add nightly release test directory and add shuffle release test (#15671)
* update

* udpate

* update

* update

* update

* Adjust script/release test json

* remove

* update

* lint

Co-authored-by: Kai Fricke <kai@anyscale.com>
2021-05-08 14:21:55 -07:00

16 lines
475 B
Python

import subprocess
import time
import os
import json
if __name__ == "__main__":
start = time.time()
# 10GB shuffle
subprocess.check_call([
"python", "-m", "ray.experimental.shuffle", "--ray-address={}".format(
os.environ["RAY_ADDRESS"]), "--num-partitions=50",
"--partition-size=200e6"
])
delta = time.time() - start
with open(os.environ["TEST_OUTPUT_JSON"], "w") as f:
f.write(json.dumps({"shuffle_time": delta}))