Commit graph

8512 commits

Author SHA1 Message Date
Ian Rodney
16d762aed0
[DocSprint] Ray Client Docs (#16497)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-06-19 10:05:37 -07:00
Amog Kamsetty
33d798f8fc
[Docs] Add e2e guide on using Pytorch Lightning with Ray (#16484)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-06-19 10:04:58 -07:00
Richard Liaw
669b7a2e8c
[docs] Update community libraries (#16557) 2021-06-19 09:01:40 -07:00
Sven Mika
79a9d6d517
[RLlib] Issues 16287 and 16200: RLlib not rendering custom multi-agent Envs. (#16428) 2021-06-19 08:57:53 +02:00
Chen Shen
853caea146
[tests]migrate test-many-tasks/test-dead-actors to nightly tests (#16469)
* init commit

* Update release/nightly_tests/nightly_tests.yaml

Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>

* Update release/nightly_tests/nightly_tests.yaml

Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>

Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
2021-06-18 18:43:25 -07:00
Achal Shah
eadee8aba7
[docs] Update API docs for ray.init (#16533)
The incorrect indentation caused the docs render weirdly: 

https://docs.ray.io/en/master/package-ref.html
2021-06-18 18:02:44 -07:00
Alex Wu
319d4fb164
Job timestamp should always be in milliseconds (fixed) (#16548)
* .

* Revert "Revert "Job timestamp should always be in milliseconds (#16455)" (#16545)"

This reverts commit 5030ed8588.

* .

* .

* .

Co-authored-by: Alex Wu <alex@anyscale.com>
2021-06-18 17:07:21 -07:00
Amog Kamsetty
416cf3a2e7
Revert "Revert "Enable TryCreateImmediately to use the fallback allocation" (#16542)" (#16544)
This reverts commit 36fd741e6f.
2021-06-18 15:39:37 -07:00
Jiao
39cc81c633
[serve] Fix ray serve shutdown to properly go through controller (#16524) 2021-06-18 17:18:04 -05:00
architkulkarni
3ba1cb851e
[Core] [runtime env] Print message on driver when installing conda or pip (#16516) 2021-06-18 16:02:46 -05:00
Amog Kamsetty
e6fa8c0015
[Hotfix] [Dask] Fix Dask Pin (#16552)
* dask-pin-36

* fix
2021-06-18 13:31:50 -07:00
Amog Kamsetty
904232b4f8
[Dask] Pin dask version to 2021.06.0 (#16546) 2021-06-18 12:40:14 -07:00
Alex Wu
5030ed8588
Revert "Job timestamp should always be in milliseconds (#16455)" (#16545)
This reverts commit 1df19a04fe.
2021-06-18 12:37:05 -07:00
Amog Kamsetty
36fd741e6f
Revert "Enable TryCreateImmediately to use the fallback allocation" (#16542)
This reverts commit 41cf2e3d50.
2021-06-18 12:22:18 -07:00
Amog Kamsetty
bd3cbfc56a
Revert "[RLlib] Allow policies to be added/deleted on the fly. (#16359)" (#16543)
This reverts commit e78ec370a9.
2021-06-18 12:21:49 -07:00
architkulkarni
54d66ac637
[Core] iterate over entire dispatch queue instead of returning when worker unavailable (#16535) 2021-06-18 13:25:45 -05:00
Frank Luan
7588938e3c
Sorting benchmark (#16327)
* [WIP] Sorting benchmark

* Separate num_mappers and num_reducers

* Add tests

* Fix tests

* flake8

* flake8

* yapf

* Skip test on Windows

* Fix OS X test failure; test Windows again

* oops
2021-06-18 10:54:18 -07:00
Eric Liang
41cf2e3d50
Enable TryCreateImmediately to use the fallback allocation 2021-06-18 10:49:34 -07:00
Simon Mo
38b5fe7e51
[Buildkite] Add rest of the Python tests (#16517) 2021-06-18 11:18:05 -05:00
Sven Mika
2900a06dd7
[RLlib] Issue 14503: SAC not allowing custom action distributions. (#16427) 2021-06-18 17:27:29 +02:00
architkulkarni
6498ca3995
[Core] [runtime env] Don't delete working_dir from runtime env (#16475) 2021-06-18 10:15:20 -05:00
Chris K. W
a2c842ee3c
[Client] Add separate error message if dataclient has disconnected before a request is sent (#16508)
* Add earlier error message

* Adjust error message
2021-06-18 08:06:25 -07:00
Kai Fricke
172d33be02
[tune] Use unbuffered training when checkpoint_at_end is used. (#16504) 2021-06-18 14:19:14 +01:00
Kai Fricke
aecc4c8d28
[release] fix sgd base image, microbenchmark timeout, revert xgboost train_small to not use connect (#16532) 2021-06-18 11:40:04 +01:00
Kai Fricke
e13f0a4d91
[tune] Add option to keep random values constant over grid search (#16501) 2021-06-18 11:30:27 +01:00
Chris K. W
c91a1b1f92
[Client] Add warnings when user schedules many tasks with ray client (#16454)
* Add warnings when user schedules many tasks with ray client

* add test_client_warnings to BUILD

* better variable names

* use util.debug.log_once()

* batching -> explanation of batching

* Switch to warnings.warn

* Add links to Ray Design Pattern doc with code snippets

* Cleaner linking and refer to sections directly

* Better testNoWarning

* add sys.exit(pytest.main(...))

* Update python/ray/util/client/worker.py

Co-authored-by: Ameer Haj Ali <ameerh@berkeley.edu>

* Update python/ray/util/client/worker.py

Co-authored-by: Ameer Haj Ali <ameerh@berkeley.edu>

* better error messages

* Switch links to new readthedocs sections

* Revert "Switch links to new readthedocs sections"

This reverts commit d3785bf50459d89fb3f13966a030e954799309a8.

Co-authored-by: Ameer Haj Ali <ameerh@berkeley.edu>
2021-06-18 13:17:37 +03:00
Sven Mika
e78ec370a9
[RLlib] Allow policies to be added/deleted on the fly. (#16359) 2021-06-18 10:31:30 +02:00
Antoni Baum
d71ec6e874
[docs] Add examples of new features to contribute (#16477) 2021-06-18 00:07:03 -07:00
Stephanie Wang
5eb51c8b26
[core] Make object directory robust to out-of-order updates (#16314)
* Sequence ops

* id

* fix

* lint
2021-06-17 20:40:35 -07:00
Hao Zhang
f47a0e1f27
[Collective] generate ray.util.collective doc (#16521) 2021-06-17 18:41:57 -07:00
architkulkarni
76d602363b
update URL for boost 1.71.0 in bazel setup (#15991) 2021-06-17 12:34:35 -07:00
Kai Fricke
5352b786b3
[docs] Add ray desig patterns and antipatterns to docs (#16478) 2021-06-17 19:56:44 +01:00
Richard Liaw
ed093cebb0
Revert "[docs] readthedocs.yaml and remove requirements-rtd.txt (#16482)" (#16512)
This reverts commit c9537be5c1.
2021-06-17 11:50:30 -07:00
Alex Wu
6696c0c165
Revert "[Placement Group] Support infeasible placement groups for Placement Group. (#16188)" (#16509)
This reverts commit 7f91cfedd5.
2021-06-17 11:04:01 -07:00
Richard Liaw
c9537be5c1
[docs] readthedocs.yaml and remove requirements-rtd.txt (#16482) 2021-06-17 09:40:06 -07:00
architkulkarni
8d9a41af55
[Core] [runtime env] Merge actor/task's runtime env with JobConfig's runtime env (#16378) 2021-06-17 11:20:32 -05:00
Antoni Baum
f8e9f171df
[tune] Add add_evaluated_point method (#16485) 2021-06-17 11:30:48 +01:00
Michael Galarnyk
524517a14f
[docs][minor] Update ray-libraries.rst (#16387)
Alphabetical order is a good thing
2021-06-17 01:37:02 -07:00
Kai Fricke
e547a27944
[tune] Track live trials in a set in the TrialRunner to reduce linear scans (#15811) 2021-06-17 01:36:07 -07:00
Abhishek Malvankar
85bc1b2979
[docs] ray LSF integration (#16438) 2021-06-17 01:35:55 -07:00
Alex Wu
1df19a04fe
Job timestamp should always be in milliseconds (#16455)
* .

* .

* .

* .

Co-authored-by: Alex Wu <alex@anyscale.com>
2021-06-17 00:05:55 -07:00
Tao Wang
2523072a3d
[large scale]Use gcs client instead of redis client to increase job id (#16190)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2021-06-17 15:01:32 +08:00
SangBin Cho
6dc4032d19
Set the 500GB block device for a single node test (#16493) 2021-06-16 22:37:30 -07:00
DK.Pino
7f91cfedd5
[Placement Group] Support infeasible placement groups for Placement Group. (#16188)
* init

* update comment

* update logical

* ut failing

* compile passing

* add ut

* lint

* fix comment

* lint

* fix ut and typo

* fix ut and typo

* lint

* typo
2021-06-16 21:48:39 -07:00
Alex Wu
45357ff590
[core] Fix multi-node placement group/job config bugs (#16345)
* .

* .

* seems to work?

* seems to work?

* .

* implement delete

* implement delete

* .

* tests

* .

* .

* .

* fix

* .

* .

* .

* .

* fix

* fix

* bump timeout

* bump timeout

* .

Co-authored-by: Alex Wu <alex@anyscale.com>
2021-06-16 21:12:20 -07:00
Dmitri Gekhtman
74bd332d88
Sidestep temp permissions issue when writing cluster address (#16473)
* not-enough

* comments

* tweak

* fix

* add-test-why-not

* fix
2021-06-16 21:11:08 -07:00
Maxim Egorushkin
742da5e68b
[tune] get_checkpoints_paths .tune_metadata file search bug fixed (#16396)
Co-authored-by: Maxim Egorushkin <maxim.egorushkin@gmail.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-06-16 20:48:41 -07:00
Eric Liang
3209084213
Fix fd reuse errors with plasma fallback allocation (#16451) 2021-06-16 19:28:23 -07:00
Amog Kamsetty
b986938f0f
Revert "[Pubsub] Use a pubsub module for Ownership based object directory (#16407)" (#16486)
This reverts commit 90599d3562.
2021-06-16 15:38:11 -07:00
Tao Wang
1a1b0da8c9
Run fn in specified io service completely (#15539) 2021-06-16 14:53:17 -07:00