Eric Liang
f5d12a958b
[rllib] Port Ape-X to distributed execution API ( #7497 )
2020-03-12 00:54:08 -07:00
Philipp Moritz
0d7ef46c83
Bazel improvements ( #7427 )
...
* Make wget quiet
* Make sphinx-build quiet
* Remove -q from pip install in CI script as config already takes care of it
* Add documentation on custom dependencies
* formatting
* python
2020-03-04 13:13:21 -08:00
ijrsvt
584645cc7d
Fix Experimental Async API ( #7391 )
2020-03-02 22:24:20 -06:00
Eric Liang
3c6b94f3f5
[rllib] Enable performance metrics reporting for RLlib pipelines, add A3C ( #7299 )
2020-02-28 16:44:17 -08:00
Edward Oakes
34488f52f3
Temporarily disable async_test ( #7377 )
2020-02-28 10:42:41 -08:00
Edward Oakes
ee0f71e398
Add __commit__ field to ray package in wheels ( #7305 )
2020-02-26 17:54:22 -08:00
Eric Liang
b310661338
Add internal_api.global_gc() method, which triggers gc.collect() on all workers ( #7327 )
2020-02-26 14:09:29 -08:00
Mitchell Stern
669bb403c3
Add TypeScript and HTML linting to Travis lint job ( #7294 )
2020-02-24 11:12:07 -08:00
fangfengbin
e7d0ec9531
Enable GCS server when running python unit tests ( #7101 )
...
* Enable GCS server when running python unit tests
* restart ci
* restart ci
* fix code style
* restart ci
* restart ci
* restart ci
* restart ci
* restart ci
* Define RAY_GCS_SERVICE_ENABLED as a constant
* fix review comments
* fix code style
* fix code style
* fix code style
* fix code style
* fix review comments
* add gcs service python testcase
* fix TESTSUITE name bug
2020-02-24 09:48:40 +08:00
Sven Mika
e2edca45d4
[RLlib] PPO torch memory leak and unnecessary torch.Tensor creation and gc'ing. ( #7238 )
...
* Take out stats to analyze memory leak in torch PPO.
* WIP
* WIP
* WIP
* WIP
* WIP
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* LINT.
* Fix determine_tests_to_run.py.
* minor change to re-test after determine_tests_to_run.py.
* LINT.
* update comments.
* WIP
* WIP
* WIP
* FIX.
* Fix sequence_mask being dependent on torch being installed.
* Fix strange ray-core tf-error in test_memory_scheduling test case.
* Fix strange ray-core tf-error in test_memory_scheduling test case.
* Fix strange ray-core tf-error in test_memory_scheduling test case.
* Fix strange ray-core tf-error in test_memory_scheduling test case.
2020-02-22 11:02:31 -08:00
Eric Liang
5df801605e
Add ray.util package and move libraries from experimental ( #7100 )
2020-02-18 13:43:19 -08:00
Sven Mika
f0e62d733f
Bazel exclude rllib-option fix. ( #7185 )
2020-02-16 11:26:03 -08:00
Eric Liang
b7016504e8
[rllib] Only run one set of tests unless rllib or tune dirs are changed. ( #7179 )
...
* full filter
* lint
2020-02-16 08:52:49 -08:00
Sven Mika
2e60f0d4d8
[RLlib] Move all jenkins RLlib-tests into bazel (rllib/BUILD). ( #7178 )
...
* commit
* comment
2020-02-15 14:50:44 -08:00
Edward Oakes
275fd343fb
Change CI to properly list python3.6 ( #7126 )
2020-02-12 11:15:46 -08:00
Simon Mo
0d5225c743
[Build] Use latest known tagged arrow image for linux build ( #7115 )
2020-02-11 11:17:48 -08:00
fangfengbin
694c0f2867
[Java] Enable GCS server when running java unit tests ( #7041 )
...
* enable gcs service when run java testcase
* fix ci bug
* fix windows compile bug
* fix ci bug
* restart ci job
* enable java testcase
* restart ci job
* restart ci job
* add debug log
* add debug log
* restart ci job
* add debug log
* restart ci
* add debug log
* fix java testcase bug
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
2020-02-10 09:39:14 +08:00
ijrsvt
0826f95e1c
Including psutil & setproctitle ( #7031 )
2020-02-05 14:16:58 -08:00
fangfengbin
ade7ebfc0c
Add service based gcs client ( #6686 )
2020-02-05 12:06:25 +08:00
Simon Mo
dd095c476a
Move serve and asyncio tests to bazel ( #6979 )
2020-02-04 08:29:16 -08:00
Simon Mo
5e8ded344a
[Serve] Fix flaky test with nursery double init ( #6982 )
2020-02-03 21:32:12 -08:00
Edward Oakes
8f07d21d19
Remove thread sanitizer from CI ( #6996 )
2020-01-31 14:15:27 -08:00
Eric Liang
2e88e2e773
Split up bazel test into tune / non tune tests ( #6846 )
...
* fix it
* move
* Update .travis.yml
2020-01-25 12:25:12 -08:00
Eric Liang
a229bdf272
[rllib] Deprecate custom preprocessors ( #6833 )
...
* deprecation warnings
* add log warn
* fix test
2020-01-18 23:30:09 -08:00
chaokunyang
4097d076d4
Package ray java jars into wheels ( #6600 )
2020-01-10 11:41:00 +08:00
chenk008
f69081242e
Ray operator travis ( #6731 )
2020-01-09 16:16:08 -06:00
Lingxuan Zuo
c51fbfb453
[streaming] Message bundle use inplacement instance ( #6606 )
...
* streaming message bundle use inplacement instance
* fix typo & enable common test
* fix compiler warning
* block copy for serilization
* add reference
* remove streaming common test to travis script
2020-01-06 11:04:29 +08:00
Philipp Moritz
e15bd8ff1a
Run core worker tests in thread sanitizer and fix thread safety issues ( #6701 )
2020-01-05 16:18:21 -08:00
Simon Mo
9fe90cdafc
Fix async actor recursion limitation ( #6672 )
...
* Do not start threadpool when using async
* Turn function_executor into a generator
* Add new test for high concurrency and bump the default
* Set direct call
2020-01-02 19:45:13 -06:00
Robert Nishihara
d206445caf
Use Travis deploy v2. ( #6674 )
2020-01-02 16:00:51 -08:00
mehrdadn
f4b29dae9c
Perform Bazel install directly in Windows CI ( #6653 )
2019-12-31 20:48:08 -08:00
Robert Nishihara
480206eef8
Remove some Python 2 compatibility code. ( #6624 )
2019-12-31 17:14:58 -08:00
Robert Nishihara
96f2f8ff10
Stop testing Python 2.7 and building Python 2.7 wheels. ( #6601 )
2019-12-27 20:47:49 -08:00
micafan
b98b288ffd
[GCS] Change GCS Test to cc_test ( #6596 )
2019-12-26 14:34:35 +08:00
Chaokun Yang
7bbfa85c66
[Streaming] Streaming data transfer java ( #6474 )
2019-12-22 10:56:05 +08:00
Simon Mo
d807d0bab6
Serve small fixes ( #6539 )
...
* Tmp db
* Lint
* Turn on direct call for serve tests
2019-12-18 23:08:59 -08:00
Simon Mo
840d9c126f
Move travis build script to after the deploy stage ( #6518 )
...
* move travis build script to after the deploy stage
* Add skip cleanup
2019-12-17 00:03:05 -08:00
Eric Liang
be5dd8eb5e
Enable direct calls by default ( #6367 )
...
* wip
* add
* timeout fix
* const ref
* comments
* fix
* fix
* Move actor state into actor handle
* comments 2
* enable by default
* temp reorder
* some fixes
* add debug code
* tmp
* fix
* wip
* remove dbg
* fix compile
* fix
* fix check
* remove non direct tests
* Increment ref count before resolving value
* rename
* fix another bug
* tmp
* tmp
* Fix object pinning
* build change
* lint
* ActorManager
* tmp
* ActorManager
* fix test component failures
* Remove old code
* Remove unused
* fix
* fix
* fix resources
* fix advanced
* eric's diff
* blacklist
* blacklist
* cleanup
* annotate
* disable tests for now
* remove
* fix
* fix
* clean up verbosity
* fix test
* fix concurrency test
* Update .travis.yml
* Update .travis.yml
* Update .travis.yml
* split up analysis suite
* split up trial runner suite
* fix detached direct actors
* fix
* split up advanced tesT
* lint
* fix core worker test hang
* fix bad check fail which breaks test_cluster.py in tune
* fix some minor diffs in test_cluster
* less workers
* make less stressful
* split up test
* retry flaky tests
* remove old test flags
* fixes
* lint
* Update worker_pool.cc
* fix race
* fix
* fix bugs in node failure handling
* fix race condition
* fix bugs in node failure handling
* fix race condition
* nits
* fix test
* disable heartbeatS
* disable heartbeatS
* fix
* fix
* use worker id
* fix max fail
* debug exit
* fix merge, and apply [PATCH] fix concurrency test
* [patch] fix core worker test hang
* remove NotifyActorCreation, and return worker on completion of actor creation task
* remove actor diied callback
* Update core_worker.cc
* lint
* use task manager
* fix merge
* fix deadlock
* wip
* merge conflits
* fix
* better sysexit handling
* better sysexit handling
* better sysexit handling
* check id
* better debug
* task failed msg
* task failed msg
* retry failed tasks with delay
* retry failed tasks with delay
* clip deps
* fix
* fix core worker tests
* fix task manager test
* fix all tests
* cleanup
* set to 0 for direct tests
* dont check worker id for ownership rpc
* dont check worker id for ownership rpc
* debug messages
* add comment
* remove debug statements
* nit
* check worker id
* fix test
* owner
* fix tests
2019-12-13 13:58:04 -08:00
Chaokun Yang
6272907a57
[Streaming] Streaming data transfer and python integration ( #6185 )
2019-12-10 20:33:24 +08:00
Eric Liang
304b4f0d3d
Shard unit tests into medium sized files for test stability ( #6398 )
2019-12-09 13:15:29 -08:00
Eric Liang
6223d2ed0b
[direct call] Assign resource ids for direct call tasks ( #6364 )
2019-12-05 10:16:04 -08:00
Simon Mo
216ef8e41a
Remove the encrypted docker password. Use web UI. ( #6333 )
2019-12-02 17:22:59 -08:00
Simon Mo
dd80c6e6d4
Hotfix make docker images building optional ( #6309 )
...
* Make docker build optional
* Fix syntax error
2019-11-27 20:52:21 -06:00
Simon Mo
22b305223a
Build Docker Containers for Linux Wheels ( #6233 )
2019-11-27 17:05:36 -08:00
Simon Mo
df453c2a2f
Remove valgrind block ( #6297 )
2019-11-26 20:20:01 -08:00
Eric Liang
7917bbef78
Set progress report interval for bazel explicitly ( #6262 )
...
* set progress internval
* add keep alive
* add keepalive
* remove cat
* smaller time
* squash error
* reduce log spam
2019-11-24 22:37:59 -08:00
Eric Liang
e5b5c98558
Fix python PATH for build ( #6260 )
2019-11-24 15:32:06 -08:00
Eric Liang
53641f1f74
Move more unit tests to bazel ( #6250 )
...
* move more unit tests to bazel
* move to avoid conflict
* fix lint
* fix deps
* seprate
* fix failing tests
* show tests
* ignore mismatch
* try combining bazel runs
* build lint
* remove tests from install
* fix test utils
* better config
* split up
* exclusive
* fix verbosity
* fix tests class
* cleanup
* remove flaky
* fix metrics test
* Update .travis.yml
* no retry flaky
* split up actor
* split basic test
* split up trial runner test
* split stress
* fix basic test
* fix tests
* switch to pytest runner for main
* make microbench not fail
* move load code to py3
* test is no longer package
* bazel to end
2019-11-24 11:43:34 -08:00
Eric Liang
b052bcf1fc
Bazelify tune tests in travis ( #6219 )
2019-11-22 13:58:50 -08:00
Simon Mo
57e101e648
[CI] Pass cloud cache secrets to linux wheel ( #6232 )
2019-11-21 14:41:13 -08:00
