hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-11-06 01:11:49 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions
10,489 commits 227 branches 67 tags 235 MiB
Commit graph

10,489 commits

Author SHA1 Message Date
Amog Kamsetty
9feae90e3b
 		skip test_spill () 2021-01-25 14:37:07 -08:00
Amog Kamsetty
d96a9fa192
 		Revert "Revert "[dashboard] Fix RAY_RAYLET_PID KeyError on Windows ()" ()" () 
This reverts commit c4a710369b.
 2021-01-25 10:35:25 -08:00
Edward Oakes
1c77cc7e23
 		[docs] Remove API warning from mp.Pool () 2021-01-25 09:59:46 -08:00
Dmitri Gekhtman
79209110c5
 		[kubernetes][operator][hotfix] Dictionary fix () 2021-01-25 10:40:59 -06:00
Lingxuan Zuo
f9f2bfa778
 		[Metric] Fix crashed when register metric view in multithread () 
* Fix crashed when register metric view in multithread

* fix comments

* fix
 2021-01-25 20:32:08 +08:00
DK.Pino
db2c836587
 		[Placement Group] Move PlacementGroup public method to interface. () 2021-01-25 20:14:21 +08:00
Maltimore
b4702de1c2
 		[RLlib] move evaluation to trainer.step() such that the result is properly logged () 2021-01-25 12:56:00 +01:00
Jan Blumenkamp
964689b280
 		[RLlib] Fix bug in ModelCatalog when using custom action distribution () 
* return tuple returned from _get_multi_action_distribution when using custom action dict

* Always return dst_class and required_model_output_shape in _get_multi_action_distribution

* pass model config to _get_multi_action_distribution
 2021-01-25 12:42:39 +01:00
Sven Mika
9423930bcc
 		[RLlib] MAML: Add cartpole mass test for PyTorch. () 2021-01-25 12:32:41 +01:00
Kai Yang
e9103eeb6d
 		[Java] [Test] Move multi-worker config to ray.conf file () 2021-01-25 18:07:45 +08:00
Ameer Haj Ali
4dabf017ee
 		Close (Autoscaler is overriding your resource for same quantity) () 2021-01-24 16:31:53 -08:00
SangBin Cho
edbb2937d3
 		[Object Spilling] Multi node file spilling V2. () 
* done.

* done.

* Fix a mistake.

* Ready.

* Fix issues.

* fix.

* Finished the first round of code review.

* formatting.

* In progress.

* Formatting.

* Addressed code review.

* Formatting

* Fix tests.

* fix bugs.

* Skip flaky tests for now.
 2021-01-23 23:15:32 -08:00
Barak Michener
e675e5b75a
 		[ray_client]: Add more retry logic () 2021-01-23 23:11:39 -08:00
Ameer Haj Ali
b7dd7ddb52
 		deprecate useless fields in the cluster yaml. () 
* prepare for head node

* move command runner interface outside _private

* remove space

* Eric

* flake

* min_workers in multi node type

* fixing edge cases

* eric not idle

* fix target_workers to consider min_workers of node types

* idle timeout

* minor

* minor fix

* test

* lint

* eric v2

* eric 3

* min_workers constraint before bin packing

* Update resource_demand_scheduler.py

* Revert "Update resource_demand_scheduler.py"

This reverts commit 818a63a2c86d8437b3ef21c5035d701c1d1127b5.

* reducing diff

* make get_nodes_to_launch return a dict

* merge

* weird merge fix

* auto fill instance types for AWS

* Alex/Eric

* Update doc/source/cluster/autoscaling.rst

* merge autofill and input from user

* logger.exception

* make the yaml use the default autofill

* docs Eric

* remove test_autoscaler_yaml from windows tests

* lets try changing the test a bit

* return test

* lets see

* edward

* Limit max launch concurrency

* commenting frac TODO

* move to resource demand scheduler

* use STATUS UP TO DATE

* Eric

* make logger of gc freed refs debug instead of info

* add cluster name to docker mount prefix directory

* grrR

* fix tests

* moving docker directory to sdk

* move the import to prevent circular dependency

* smallf fix

* ian

* fix max launch concurrency bug to assume failing nodes as pending and consider only load_metric's connected nodes as running

* small fix

* deflake test_joblib

* lint

* placement groups bypass

* remove space

* Eric

* first ocmmit

* lint

* exmaple

* documentation

* hmm

* file path fix

* fix test

* some format issue in docs

* modified docs

* joblib strikes again on windows

* add ability to not start autoscaler/monitor

* a

* remove worker_default

* Remove default pod type from operator

* Remove worker_default_node_type from rewrite_legacy_yaml_to_availble_node_types

* deprecate useless fields

Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
Co-authored-by: Eric Liang <ekhliang@gmail.com>
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
Co-authored-by: root <root@ip-172-31-56-188.us-west-2.compute.internal>
Co-authored-by: Dmitri Gekhtman <dmitri.m.gekhtman@gmail.com>
 2021-01-23 12:06:51 -08:00
Kai Fricke
17760e1510
 		[tune] update Optuna integration to 2.4.0 API () 
Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com>
 2021-01-23 00:32:37 -08:00
Qing Wang
8ef835ff03
 		Remove idle actor from worker pool. () 2021-01-23 13:57:30 +08:00
Amog Kamsetty
01d74af89d
 		[horovod] Horovod+Ray Pytorch Lightning Accelerator () 2021-01-22 16:30:10 -08:00
Amog Kamsetty
25e1b78eed
 		[Dependencies] Move requirements.txt to requirements directory. () 2021-01-22 16:29:05 -08:00
architkulkarni
0c3d9a3eaa
 		[Metrics] Fix serialization for custom metrics () 2021-01-22 14:11:59 -06:00
Amog Kamsetty
c4a710369b
 		Revert "[dashboard] Fix RAY_RAYLET_PID KeyError on Windows ()" () 
This reverts commit ef6d859e9b.
 2021-01-22 14:10:24 -06:00
Dmitri Gekhtman
7fec19dad2
 		[kubernetes][operator][minutiae] Backwards compatibility of operator () 2021-01-22 14:07:25 -06:00
Sven Mika
d629292d63
 		[RLlib] Add grad_clip config option to MARWIL and stabilize grad clipping against inf global_norms. () 2021-01-22 19:36:02 +01:00
architkulkarni
da5928304a
 		[Metrics] Cache metrics ports in a file at each node () 
* cache metric ports in a file at each node

* remove old assignment of export port

* lint

* lint

* move e2e test to top of file to avoid shutdown bug
 2021-01-22 09:59:20 -08:00
Kai Yang
90f1e408de
 		[Java] Add fetchLocal parameter in Ray.wait() () 2021-01-22 17:55:00 +08:00
Amog Kamsetty
00c14ce4a4
 		[Object Spilling] Skip flaky tests () 
* skip flaky tests

* lint

* skip one more

* fix
 2021-01-22 00:31:33 -08:00
Amog Kamsetty
39755fdb20
 		Revert "[Serve] Refactor BackendState" () 
This reverts commit 68038741ac.
 2021-01-21 23:06:15 -08:00
Tao Wang
aa5d7a5e6c
 		[Dashboard]Don't set node actors when node_id of actor is Nil () 
* Don't set node actors when node_id of actor is Nil

* add test per comment
 2021-01-21 20:18:34 -08:00
Xianyang Liu
4ecd29ea2b
 		[dashboard] Fixes dashboard issues when environments have set http_proxy () 
* fixes ray start with http_proxy

* format

* fixes

* fixes

* increase timeout

* address comments
 2021-01-21 20:10:01 -08:00
Ameer Haj Ali
1fbb752f42
 		[autoscaler] remove worker_default_node_type that is useless. () 2021-01-21 17:04:38 -08:00
Nikita Vemuri
4e01a9ec38
 		[Autoscaler] Ensure ubuntu is owner of docker host mount folder () 
* change ownership to ubuntu if root

* use ssh user in cluster config

* formatting

Co-authored-by: Nikita Vemuri <nikitavemuri@Nikitas-MacBook-Pro.local>
 2021-01-21 17:01:55 -08:00
Stephanie Wang
0998d69968
 		[core] Admission control for pulling objects to the local node () 
* Admission control, TODO: tests, object size

* Unit tests for admission control and some bug fixes

* Add object size to object table, only activate pull if object size is known

* Some fixes, reset timer on eviction

* doc

* update

* Trigger OOM from the pull manager

* don't spam

* doc

* Update src/ray/object_manager/pull_manager.cc

Co-authored-by: Eric Liang <ekhliang@gmail.com>

* Remove useless tests

* Fix test

* osx build

* Skip broken test

* tests

* Skip failing tests

Co-authored-by: Eric Liang <ekhliang@gmail.com>
 2021-01-21 16:46:42 -08:00
Amog Kamsetty
ccc901f662
 		add 3.8 () 2021-01-21 16:38:51 -08:00
Amog Kamsetty
20acc3b05e
 		Revert "Inline small objects in GetObjectStatus response. ()" () 
This reverts commit a82fa80f7b.
 2021-01-21 16:10:34 -08:00
Dmitri Gekhtman
87ca102c93
 		[Kubernetes] Unit test for cluster launch and teardown using K8s Operator () 2021-01-21 12:00:37 -06:00
Ian Rodney
68038741ac
 		[serve] Refactor BackendState to use ReplicaState classes () 2021-01-21 11:16:02 -06:00
Clark Zinzow
a82fa80f7b
 		Inline small objects in GetObjectStatus response. () 2021-01-21 09:15:18 -08:00
Kai Yang
92f1e0902e
 		[Java] Fix return of java doc () 2021-01-21 23:57:20 +08:00
Michael Luo
587f207c2f
 		[RLlib] Support for D4RL + Semi-working CQL Benchmark () 2021-01-21 16:43:55 +01:00
Saeid
d11e62f9e6
 		[RLlib] Fix problem in preprocessing nested MultiDiscrete () 2021-01-21 16:36:11 +01:00
Sven Mika
daf0bef285
 		[RLlib] Dreamer: Fix broken import and add compilation test case. () 2021-01-21 16:30:26 +01:00
Alex Wu
b9ac3878ae
 		[Autoscaler] Display node status tag in autsocaler status () 
* .

* .

* .

* .

* .

* lint

Co-authored-by: Alex Wu <alex@anyscale.com>
 2021-01-20 19:20:54 -08:00
Siyuan (Ryans) Zhuang
a09997dc9e
 		[Core] Remove 'PlasmaBuffer' in the buffer header () 2021-01-20 12:01:44 -08:00
Edward Oakes
b796de4104
 		[metrics] Check that all tag_keys are set when recording () 2021-01-20 13:09:44 -06:00
dmatch01
fd6882176a
 		Fix for operator role definition to add raycluster/finalizer () 2021-01-20 13:02:02 -06:00
Kai Fricke
8804758409
 		[xgboost] Add XGBoost release tests () 
* Add XGBoost release tests

* Add more xgboost release tests

* Use failure state manager

* Add release test documentation

* Fix wording

* Automate fault tolerance tests
 2021-01-20 18:40:23 +01:00
Eric Liang
e6412efdf5
 		Extra fix ray client newline () 2021-01-20 09:23:14 -08:00
ZhuSenlin
2e7c2b774f
 		[Core] add thread name to help performance profiling () 2021-01-20 20:34:28 +08:00
Kai Fricke
6c23bef2a7
 		[tune] Allow actor reuse for new trials () 
* Allow actor reuse for new trials

* Fix tests and update conf when starting new trial

* Move magic config to `reset_trial`
 2021-01-20 11:25:33 +01:00
Daan Klijn
800304acfb
 		[tune] wandb - WandbLogger now also accepts wandb.data_types.Video () 2021-01-20 01:19:54 -08:00
Eric Liang
d0f224d5cf
 		Revert "Pipe monitor.err logs to driver" () 
This reverts commit a0d08c2cc6.
 2021-01-20 00:29:19 -08:00