Commit graph

8255 commits

Author SHA1 Message Date
Sven Mika
e61922c4ac
[RLlib] Add one-liner to docs on internship/RL-engineer position. (#16050)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2021-05-25 12:58:54 -07:00
Ian Rodney
113fd6e765
[Client][Proxy] Refactor RayClient Proxy to not use additional Threads. (#16057) 2021-05-25 10:07:19 -07:00
qicosmos
1b3df53ab8
[C++ worker] Remove some api dependencies on ray core (#16011) 2021-05-25 20:19:25 +08:00
SongGuyang
4ea7719416
[C++ worker] don't expose ObjectID to users (#15966) 2021-05-25 16:36:34 +08:00
Sven Mika
f6302d81be
[RLlib] Discussion 2210: BC algo broken, if "advantages" missing in offline data. (#16019) 2021-05-25 08:47:17 +02:00
Eric Liang
ea6bdfb9c1
Prevent object store from allocating over the specified limit even if there is memory fragmentation (#15951) 2021-05-24 17:56:11 -07:00
Yi Cheng
643f739619
[flaky] Split test_failure_2 into 2 (#15688)
* split test failure

* format

* add bazel

* remove flaky tag

* format

* up

* rerun

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2021-05-24 16:52:44 -07:00
SangBin Cho
ee1ccb569d
[Test] Nightly shuffle test (#15998)
* shuffle daily test update.

* lint

* Improve testing.

* Download the real nightly.

* Addressed code review.

* fix typo

* fix issue

* fix the broken release test

* Updated the test.
2021-05-24 15:33:31 -07:00
Eric Liang
9c26d6c6de
Remove unnecessary flaky block (no C++ tests are flaky) (#16024) 2021-05-24 13:16:56 -07:00
Ian Rodney
033c22d73b
[Tracing] Add Otel to setup.py Observability (#16028) 2021-05-24 13:15:41 -07:00
Howard Lau
225b3fda91
[tune] Fix ddp_mnist_torch example argument type (#16017)
* fix ddp_mnist_torch example argument type

* add period
2021-05-24 12:05:33 -07:00
dependabot[bot]
0fecfe10b8
[tune](deps): Bump sigopt in /python/requirements/tune (#16004)
Bumps [sigopt](https://sigopt.com/) from 5.7.0 to 7.4.0.

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-24 12:03:56 -07:00
Amog Kamsetty
d0c137c7f9
[Tune] Pin minimum tensorboardX version (#16022) 2021-05-24 11:14:23 -07:00
Ian Rodney
b5adc87e0e
[CI] Decrease BuildKite Docker Build Time (#16020) 2021-05-24 10:31:54 -07:00
Amog Kamsetty
71926ad043
[Docs] Fix Dependencies for Pong example (#15978) 2021-05-24 10:25:16 -07:00
Eric Liang
810f5c803a
Disable flaky object spilling test on OSX & adjust test timeouts (#15986)
* blacklist

* move it

* adjust according to bazel timeouts

* fix build

* move to large

* Update BUILD
2021-05-24 09:49:59 -07:00
dependabot[bot]
7a425be59f
[tune](deps): Bump smart-open in /python/requirements/tune (#16001)
Bumps [smart-open](https://github.com/piskvorky/smart_open) from 4.2.0 to 5.0.0.
- [Release notes](https://github.com/piskvorky/smart_open/releases)
- [Changelog](https://github.com/RaRe-Technologies/smart_open/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/piskvorky/smart_open/compare/v4.2.0...v5.0.0)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-22 10:24:46 -07:00
Alex Wu
b81bdd8aee
[client] Local client builder (#15935) 2021-05-22 10:11:41 -07:00
Eric Liang
ba45e41b4d
Mark runtime_env_complicated, test_object_spilling as flaky, unmark test_scheduling 2021-05-21 16:16:11 -07:00
Amog Kamsetty
47cd075829
[Tune] Ray Client support for examples & CI (#15932)
Out of the box Ray Client support for Tune examples. Also add key examples with Ray Client to run in CI
2021-05-21 15:33:43 -07:00
architkulkarni
02f21653cc
[Core] Automatically inject ray and python version in runtime_env (#15958) 2021-05-21 17:15:52 -05:00
Ian Rodney
9bdd2cbe49
Revert "Revert "[Core] minor refactor for usability of runtime_env (#15965)" (#15985)" (#15987) 2021-05-21 14:57:44 -07:00
Yi Cheng
7c45480542
[runtime env] Introduce OS envs to skip GC for runtime env in local node; (#15984) 2021-05-21 12:49:22 -07:00
Eric Liang
ec522a2d46
Revert "[Core] minor refactor for usability of runtime_env (#15965)" (#15985)
This reverts commit 0a7ba95e42.
2021-05-21 11:57:38 -07:00
Simon Mo
677514b3ff
Revert "[Dashboard] Actor Table UI Optimize (#15802)" (#15981)
This reverts commit 43be599a9a.
2021-05-21 10:56:15 -07:00
Alex Wu
f080911d9b
[dashboard] include worker id in actor snapshot (#15967)
Co-authored-by: Alex Wu <alex@anyscale.com>
2021-05-21 09:26:37 -07:00
Dominic Ming
43be599a9a
[Dashboard] Actor Table UI Optimize (#15802) 2021-05-21 09:23:32 -07:00
architkulkarni
0a7ba95e42
[Core] minor refactor for usability of runtime_env (#15965)
* minor refactor for usability of runtime_env

* remove job_config changes
2021-05-21 09:02:32 -07:00
Edward Oakes
b6a79445fe
[serve] Fix some test sizes to avoid bazel warnings (#15959) 2021-05-21 10:11:46 -05:00
Ian Rodney
6add438929
[client] Start Specific Server's in separate Conda environments (#15926)
* conda support

* test multiple ray.init called

* additional testing

* test for proxy_manager

* better error message

* pass in session_dir

* unit tests

* fix test_runtime_env_complicated

* clean up proxier

* respond to comments

* try finally blocks

* fix up test_client_proxy

* small modifications to tests

* additional test

* fix tests

* lintfix
2021-05-21 01:01:57 -07:00
Eric Liang
29aa336a4d
Revert "[Object spilling] Avoid worker crash when an object is spille… (#15964)
This reverts commit 061e3fbde3.
2021-05-20 21:17:59 -07:00
Eric Liang
86cb3e28cd
[hotfix] Somehow the pong_plot_example is failing to gym.make("Pong-v0") (#15961) 2021-05-20 20:56:39 -07:00
Edward Oakes
d339c8734e
Fix duplicate log messages when ray.shutdown() and ray.init() are called repeatedly (#15957) 2021-05-20 22:27:54 -05:00
Edward Oakes
82410f20b2
[serve] Add warning + docstring for anonymous namespaces (#15921) 2021-05-20 22:27:15 -05:00
Steven Morad
581d63e607
[RLlib] Fix dnc input shape (#15939)
Co-authored-by: Steven Morad <sm2558@cam.ac.uk>
2021-05-20 19:06:02 -07:00
architkulkarni
64fdac83a7
[Core] Add minimal support for pip in runtime env (#15927) 2021-05-20 20:47:16 -05:00
SangBin Cho
a1375a955b
Pubsub registration / unregistration idempotency (#15896)
* Make AddEntry idempotent.

* Done.
2021-05-20 18:40:06 -07:00
Kai Yang
061e3fbde3
[Object spilling] Avoid worker crash when an object is spilled right after being restored (#15903)
* Fix check failure when memory pressure is high

* Add test

* lint
2021-05-20 18:36:11 -07:00
Simon Mo
32f9d2287b
[Core] Fix asyncio actor exit. (#15925) 2021-05-20 17:21:58 -07:00
Kai Fricke
12418a2f69
[xgboost] Update documentation (#15900) 2021-05-20 17:16:45 -07:00
Simon Mo
cce5007285
Revert "[CI] Remove wheel renaming code path. (#15952)" (#15954)
This reverts commit 42bbde2987.
2021-05-20 15:44:53 -07:00
Simon Mo
b130613143
[Serve] Latency improvement by using pickle (#15945) 2021-05-20 15:20:58 -07:00
Frank Luan
c87b76632d
[plasma] Reset OOM timer as objects are being spilled (#15431)
* Fix deserializer in metrics.Counter

* Fix restore_spilled_objects() for external object spilling

* WIP reset OOM timer

* Add test

* Revert style change

* pytest

* Simplify test

* Fix test

* Make tests faster
2021-05-20 13:13:54 -07:00
Alex Wu
ec997c0145
[client] Client builder API namespace support (#15934)
* add namespace to client

* done?

* address comments

Co-authored-by: Alex <alex@anyscale.com>
2021-05-20 12:36:05 -07:00
Simon Mo
42bbde2987
[CI] Remove wheel renaming code path. (#15952)
pypa/manylinux2014_x86_64 was updated 05-20-2021 and the wheels
produced already have manylinux in them. So the renaming will
only change the name to `manymanylinux20142014`.
2021-05-20 12:21:46 -07:00
Richard Liaw
2cb0ad4fb1
[docs] improve banner for ray summit (#15947) 2021-05-20 11:56:12 -07:00
Richard Liaw
5f595cbb0f
[docs] add summit banner (#15938) 2021-05-20 10:35:45 -07:00
Micah Yong
52eb41d881
[core] Use immutable keys for _future_to_actor in ActorPools.py (#15402)
* Use immutable keys for _future_to_actor in ActorPools.py

* Add corresponding test for multiple returns

* Lint and format
2021-05-20 10:05:42 -07:00
Sven Mika
e80095591c
[RLlib] Entropy coeff schedule bug fix and git bisect script. (#15937) 2021-05-20 18:15:10 +02:00
YeahNew
9a93dd9682
Adding a RaySGD and DGL ( Deep Graph Library) integration example(gat… (#15718)
* Adding a RaySGD and DGL ( Deep Graph Library) integration example(gat_dgl.py)

* Update gat_dgl.py

* Update gat_dgl.py

* Update gat_dgl.py

* the gat_dgl.py has been formated by the format.sh script

* delet useless code in the gat_dgl.py

* add 'import numpy as np', modified the output form of accuracy in the validate method

* Modified the code for better readability and added the README.md file

* Update README.md

* Update README.md

* Update README.md

* updates

* formatting

Co-authored-by: YeahNew <1650996069@qq.com>
Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
2021-05-20 08:47:19 -07:00