2016-08-09 11:30:33 -07:00
|
|
|
# The build output should clearly not be checked in
|
2020-10-23 16:52:14 -04:00
|
|
|
*test-output.xml
|
2019-02-26 17:27:36 -08:00
|
|
|
/bazel-*
|
2017-03-01 23:34:44 -08:00
|
|
|
/python/ray/core
|
2019-11-12 11:45:28 -08:00
|
|
|
/python/ray/pickle5_files/
|
2020-02-05 14:16:58 -08:00
|
|
|
/python/ray/thirdparty_files/
|
2020-10-14 13:07:23 -07:00
|
|
|
/python/ray/pyarrow_files/
|
2020-01-10 11:41:00 +08:00
|
|
|
/python/ray/jars/
|
2021-07-14 23:27:13 -07:00
|
|
|
/python/ray/cpp/
|
2017-05-21 14:51:24 -07:00
|
|
|
/python/build
|
|
|
|
|
/python/dist
|
2019-11-25 14:12:11 -08:00
|
|
|
/python/python-driver-*
|
2018-04-30 21:31:23 +08:00
|
|
|
/thirdparty/pkg/
|
2019-10-07 15:42:19 -07:00
|
|
|
/build/java
|
2020-07-30 10:59:11 +08:00
|
|
|
.jar
|
2020-10-23 16:52:14 -04:00
|
|
|
/dashboard/client/build
|
2017-03-17 16:48:25 -07:00
|
|
|
# Files generated by flatc should be ignored
|
2017-12-23 00:31:33 -08:00
|
|
|
/src/ray/gcs/format/*_generated.h
|
[XRay] Raylet node and object manager unification/backend redesign. (#1640)
* directory for raylet
* some initial class scaffolding -- in progress
* node_manager build code and test stub files.
* class scaffolding for resources, workers, and the worker pool
* Node manager server loop
* raylet policy and queue - wip checkpoint
* fix dependencies
* add gen_nm_fbs as target.
* object manager build, stub, and test code.
* Start integrating WorkerPool into node manager
* fix build on mac
* tmp
* adding LsResources boilerplate
* add/build Task spec boilerplate
* checkpoint ActorInformation and LsQueue
* Worker pool maintains started and removed workers
* todos for e2e task assignment
* fix build on mac
* build/add lsqueue interface
* channel resource config through from NodeServer to LsResources; prep LsResources to replace/provide worker_pool
* progress on LsResources class: resource availability check implementation
* Read task submission messages from a client
* Submit tasks from the client to the local scheduler
* Assign a task to a worker from the WorkerPool
* change the way node_manager is built to prevent build issues for object_manager.
* add namespaces. fix build.
* Move ClientConnection message handling into server, remove reference to
WorkerPool
* Add raw constructors for TaskSpecification
* Define TaskArgument by reference and by value
* Flatbuffer serialization for TaskSpec
* expand resource implementation
* Start integrating TaskExecutionSpecification into Task
* Separate WorkerPool from LsResources, give ownership to NodeServer
* checkpoint queue and resource code
* resoving merge conflicts
* lspolicy::schedule ; adding lsqueue and lspolicy to the nodeserver
* Implement LsQueue RemoveTasks and QueueReadyTasks
* Fill in some LsQueue code for assigning a task
* added suport for test_asio
* Implement LsQueue queue tasks methods, queue running tasks
* calling into policy from nodeserver; adding cluster resource map
* Feedback and Testing.
Incorporate Alexey's feedback. Actually test some code. Clean up callback imp.
* end to end task assignment
* Decouple local scheduler from node server
* move TODO
* Move local scheduler to separate file
* Add scaffolding for reconstruction policy, task dependency manager, and object manager
* fix
* asio for store client notifications.
added asio for plasma store connection.
added tests for store notifications.
encapsulate store interaction under store_messenger.
* Move Worker inside of ClientConnection
* Set the assigned task ID in the worker
* Several changes toward object manager implementation.
Store client integration with asio.
Complete OM/OD scaffolding.
* simple simulator to estimate number of retry timeouts
* changing dbclientid --> clientid
* fix build (include sandbox after it's fixed).
* changes to object manager, adding lambdas to the interface
* changing void * callbacks to std::function typed callbacks
* remove use namespace std from .h files.
use ray:: for Status everywhere.
* minor
* lineage cache interfaces
* TODO for object IDs
* Interface for the GCS client table
* Revert "Set the assigned task ID in the worker"
This reverts commit a770dd31048a289ef431c56d64e491fa7f9b2737.
* Revert "Move Worker inside of ClientConnection"
This reverts commit dfaa0d662a76976c05be6d76b214b45d88482818.
* OD/OM: ray::Status
* mock gcs integration.
* gcs mock clientinfo assignment
* Allow lookup of a Worker in the WorkerPool
* Split out Worker and ClientConnection source files
* Allow assignment of a task ID to a worker, skeleton for finishing a task
* integrate mock gcs with om tests.
* added tcp connection acceptor
* integrated OM with NM.
integrated GcsClient with NM.
Added multi-node integration tests.
* OM to receive incoming tcp connections.
* implemented object manager connection protocol.
* Added todos.
* slight adjustment to add/remove handler invocation on object store client.
* Simplify Task interface for getting dependencies
* Remove unused object manager file
* TaskDependencyManager tracks missing task dependencies and processes object add notifications
* Local scheduler queues tasks according to argument availability
* Fill in TaskSpecification methods to get arguments
* Implemented push.
* Queue tasks that have been scheduled but that are waiting for a worker
* Pull + mock gcs cleanup.
* OD/OM/GCS mock code review, fixing unused-result issues, eliminating copy ctor
* Remove unique_ptr from object_store_client
* Fix object manager Push memory error
* Pull task arguments in task dependency manager
* Add a demo script for remote task dependencies
* Some comments for the TaskDependencyManager
* code cleanup; builds on mac
* Make ClientConnection a templated type based on the connection protocol
* Add gmock to build
* Add WorkerPool unit tests
* clean up.
* clean up connection code.
* instantiate a template instance in the module
* Virtual destructors
* Document public api.
* Separate read and write buffers in ClientConnection; documentation
* Remove ObjectDirectory from NodeServer constructor, make directory InitGcs call a separate constructor
* Convert NodeServer Terminate to a destructor
* NodeServer documentation
* WorkerPool documentation
* TaskDependencyManager doc
* unifying naming conventions
* unifying naming conventions
* Task cleanup and documentation
* unifying naming conventions
* unifying naming conventions
* code cleanup and naming conventions
* code cleanup
* Rename om --> object_manager
* Merge with master
* SchedulingQueue doc
* Docs and implementation skeleton for ClientTable
* Node manager documentation
* ReconstructionPolicy doc
* Replace std::bind with lambda in TaskDependencyManager
* lineage cache doc
* Use \param style for doc
* documentation for scheduling policy and resources
* minor code cleanup
* SchedulingResources class documentation + code cleanup
* referencing ray/raylet directory; doxygen documentation
* updating trivial policy
* Fix bug where event loop stops after task submission
* Define entry point for ClientManager for handling new connections
* Node manager to node manager protocol, heartbeat protocol
* Fix flatbuffer
* Fix GCS flatbuffer naming conflict
* client connection moved to common dir.
* rename based on feedback.
* Added google style and 90 char lines clang-format file under src/ray.
* const ref ClientID.
* Incorporated feedback from PR.
* raylet: includes and namespaces
* raylet/om/gcs logging/using
* doxygen style
* camel casing, comments, other style; DBClientID -> ClientID
* object_manager : naming, defines, style
* consistent caps and naming; misc style
* cleaning up client connection + other stylistic fixes
* cmath, std::nan
* more style polish: OM, Raylet, gcs tables
* removing sandbox (moved to ray-project/sandbox)
* raylet linting
* object manager linting
* gcs linting
* all other linting
Co-authored-by: Melih <elibol@gmail.com>
Co-authored-by: Stephanie <swang@cs.berkeley.edu>
2018-03-08 12:53:24 -08:00
|
|
|
/src/ray/object_manager/format/*_generated.h
|
|
|
|
|
/src/ray/raylet/format/*_generated.h
|
2020-04-12 17:59:34 +08:00
|
|
|
/java/runtime/src/main/java/io/ray/runtime/generated/*
|
2016-12-20 14:46:25 -08:00
|
|
|
|
2021-07-02 10:40:54 +08:00
|
|
|
# Files genrated by c++ worker should be ignored.
|
2021-07-08 14:42:26 +08:00
|
|
|
/cpp/example/thirdparty/
|
|
|
|
|
/cpp/example/bazel-*
|
|
|
|
|
/python/ray/cpp
|
2021-07-02 10:40:54 +08:00
|
|
|
|
2016-12-07 11:54:16 -08:00
|
|
|
# Redis temporary files
|
|
|
|
|
*dump.rdb
|
2016-06-18 20:04:02 +03:00
|
|
|
|
2016-06-26 10:59:16 -07:00
|
|
|
# Python byte code files
|
|
|
|
|
*.pyc
|
2018-07-07 12:10:06 -07:00
|
|
|
python/.eggs
|
2016-06-26 10:59:16 -07:00
|
|
|
|
2017-07-13 14:53:57 -07:00
|
|
|
# Backup files
|
|
|
|
|
*.bak
|
|
|
|
|
|
2016-06-26 10:59:16 -07:00
|
|
|
# Emacs temporary files
|
|
|
|
|
*~
|
|
|
|
|
*#
|
|
|
|
|
|
2016-02-07 14:18:40 -08:00
|
|
|
# Compiled Object files
|
|
|
|
|
*.slo
|
|
|
|
|
*.lo
|
|
|
|
|
*.o
|
2016-12-11 17:40:19 -08:00
|
|
|
*.xo
|
2016-02-07 14:18:40 -08:00
|
|
|
*.obj
|
|
|
|
|
|
|
|
|
|
# Precompiled Headers
|
|
|
|
|
*.gch
|
|
|
|
|
*.pch
|
|
|
|
|
|
|
|
|
|
# Compiled Dynamic libraries
|
|
|
|
|
*.so
|
|
|
|
|
*.dylib
|
|
|
|
|
*.dll
|
|
|
|
|
|
2016-06-18 20:04:02 +03:00
|
|
|
# Incremental linking files
|
|
|
|
|
*.ilk
|
|
|
|
|
|
|
|
|
|
# Library export files
|
|
|
|
|
*.exp
|
|
|
|
|
|
|
|
|
|
# Debug symbols
|
|
|
|
|
*.pdb
|
|
|
|
|
|
2016-02-07 14:18:40 -08:00
|
|
|
# Fortran module files
|
|
|
|
|
*.mod
|
2020-01-03 01:55:16 +08:00
|
|
|
!deploy/ray-operator/go.mod
|
2016-02-07 14:18:40 -08:00
|
|
|
|
|
|
|
|
# Compiled Static libraries
|
|
|
|
|
*.lai
|
|
|
|
|
*.la
|
|
|
|
|
*.a
|
|
|
|
|
*.lib
|
|
|
|
|
|
|
|
|
|
# Executables
|
|
|
|
|
*.exe
|
|
|
|
|
*.out
|
|
|
|
|
*.app
|
2016-06-18 20:04:02 +03:00
|
|
|
|
|
|
|
|
# Visual Studio files
|
|
|
|
|
/packages
|
|
|
|
|
*.suo
|
|
|
|
|
*.user
|
2016-07-28 13:11:13 -07:00
|
|
|
*.VC.db
|
|
|
|
|
*.VC.opendb
|
2016-07-03 07:07:28 +03:00
|
|
|
|
|
|
|
|
# Protobuf-generated files
|
|
|
|
|
*_pb2.py
|
|
|
|
|
*.pb.h
|
|
|
|
|
*.pb.cc
|
2016-08-04 09:14:20 -07:00
|
|
|
|
|
|
|
|
# Ray cluster configuration
|
|
|
|
|
scripts/nodes.txt
|
2016-08-09 11:30:33 -07:00
|
|
|
|
|
|
|
|
# OS X folder attributes
|
|
|
|
|
.DS_Store
|
|
|
|
|
|
2016-10-28 11:40:08 -07:00
|
|
|
# Debug files
|
|
|
|
|
*.dSYM/
|
|
|
|
|
*.su
|
|
|
|
|
|
|
|
|
|
# Python setup files
|
|
|
|
|
*.egg-info
|
|
|
|
|
|
|
|
|
|
# Compressed files
|
|
|
|
|
*.gz
|
|
|
|
|
|
2016-08-09 11:30:33 -07:00
|
|
|
# Datasets from examples
|
|
|
|
|
**/MNIST_data/
|
2017-03-17 16:48:25 -07:00
|
|
|
**/cifar-10-batches-bin/
|
|
|
|
|
|
|
|
|
|
# Generated documentation files
|
|
|
|
|
/doc/_build
|
2019-10-26 13:23:42 -07:00
|
|
|
/doc/source/_static/thumbs
|
2020-04-17 02:06:42 +03:00
|
|
|
/doc/source/tune/generated_guides/
|
2017-04-16 17:02:15 -05:00
|
|
|
|
|
|
|
|
# User-specific stuff:
|
|
|
|
|
.idea/**/workspace.xml
|
|
|
|
|
.idea/**/tasks.xml
|
|
|
|
|
.idea/dictionaries
|
|
|
|
|
|
|
|
|
|
# Sensitive or high-churn files:
|
|
|
|
|
.idea/**/dataSources/
|
|
|
|
|
.idea/**/dataSources.ids
|
|
|
|
|
.idea/**/dataSources.xml
|
|
|
|
|
.idea/**/dataSources.local.xml
|
|
|
|
|
.idea/**/sqlDataSources.xml
|
|
|
|
|
.idea/**/dynamic.xml
|
|
|
|
|
.idea/**/uiDesigner.xml
|
|
|
|
|
|
|
|
|
|
# Gradle:
|
|
|
|
|
.idea/**/gradle.xml
|
|
|
|
|
.idea/**/libraries
|
2018-02-01 22:45:31 -08:00
|
|
|
.idea
|
2017-05-20 18:33:36 -07:00
|
|
|
|
|
|
|
|
# Website
|
|
|
|
|
/site/Gemfile.lock
|
|
|
|
|
/site/.sass-cache
|
|
|
|
|
/site/_site
|
2018-02-26 18:26:38 -08:00
|
|
|
|
|
|
|
|
# Pytest Cache
|
|
|
|
|
**/.pytest_cache
|
2019-12-10 20:33:24 +08:00
|
|
|
**/.cache
|
2019-03-08 16:22:05 -08:00
|
|
|
.benchmarks
|
2020-02-11 20:28:13 -08:00
|
|
|
python-driver-*
|
2018-04-30 21:31:23 +08:00
|
|
|
|
|
|
|
|
# Vscode
|
|
|
|
|
.vscode/
|
2018-06-14 03:58:07 +08:00
|
|
|
|
|
|
|
|
*.iml
|
2018-08-02 08:52:49 +08:00
|
|
|
|
|
|
|
|
# Java
|
2018-06-14 03:58:07 +08:00
|
|
|
java/**/target
|
2018-07-10 14:33:59 +08:00
|
|
|
java/**/lib
|
2018-08-02 08:52:49 +08:00
|
|
|
java/**/.settings
|
|
|
|
|
java/**/.classpath
|
|
|
|
|
java/**/.project
|
2019-03-15 12:38:40 +08:00
|
|
|
java/runtime/native_dependencies/
|
2018-08-02 08:52:49 +08:00
|
|
|
|
2021-07-13 14:01:22 +08:00
|
|
|
# Cpp
|
|
|
|
|
cpp/example/thirdparty/
|
|
|
|
|
|
2019-12-10 20:33:24 +08:00
|
|
|
# streaming/python
|
|
|
|
|
streaming/python/generated/
|
2020-04-12 17:59:34 +08:00
|
|
|
streaming/java/streaming-runtime/src/main/java/io/ray/streaming/runtime/generated/
|
2019-12-22 10:56:05 +08:00
|
|
|
streaming/build/java
|
|
|
|
|
.clwb
|
|
|
|
|
streaming/**/.settings
|
|
|
|
|
streaming/java/**/target
|
|
|
|
|
streaming/java/**/.classpath
|
|
|
|
|
streaming/java/**/.project
|
|
|
|
|
streaming/java/**/*.log
|
2019-12-10 20:33:24 +08:00
|
|
|
|
update ray cmake build process (#2853)
* use cmake to build ray project, no need to appply build.sh before cmake, fix some abuse of cmake, improve the build performance
* support boost external project, avoid using the system or build.sh boost
* keep compatible with build.sh, remove boost and arrow build from it.
* bugfix: parquet bison version control, plasma_java lib install problem
* bugfix: cmake, do not compile plasma java client if no need
* bugfix: component failures test timeout machenism has problem for plasma manager failed case
* bugfix: arrow use lib64 in centos, travis check-git-clang-format-output.sh does not support other branches except master
* revert some fix
* set arrow python executable, fix format error in component_failures_test.py
* make clean arrow python build directory
* update cmake code style, back to support cmake minimum version 3.4
2018-09-13 02:19:33 +08:00
|
|
|
# python virtual env
|
|
|
|
|
venv
|
2019-02-11 18:27:10 +00:00
|
|
|
|
2020-09-28 00:26:26 +08:00
|
|
|
# pyenv version file
|
|
|
|
|
.python-version
|
|
|
|
|
|
2019-02-11 18:27:10 +00:00
|
|
|
# Vim
|
|
|
|
|
.*.swp
|
|
|
|
|
*.swp
|
2020-06-05 17:09:18 -07:00
|
|
|
tags
|
2020-12-10 17:24:32 -05:00
|
|
|
tags.lock
|
|
|
|
|
tags.temp
|
2020-06-05 17:09:18 -07:00
|
|
|
|
|
|
|
|
# Emacs
|
|
|
|
|
.#*
|
2019-04-03 12:01:02 +08:00
|
|
|
|
|
|
|
|
# tools
|
|
|
|
|
tools/prometheus*
|
2020-02-11 10:00:29 -08:00
|
|
|
|
|
|
|
|
# ray project files
|
|
|
|
|
project-id
|
2020-05-06 17:44:02 -07:00
|
|
|
.mypy_cache/
|
2021-04-21 13:26:46 -07:00
|
|
|
|
|
|
|
|
# gitpod cache related
|
|
|
|
|
.pip-cache/
|
|
|
|
|
.bazel-cache/
|
2021-06-09 22:38:53 -07:00
|
|
|
|
|
|
|
|
# release test related
|
|
|
|
|
.anyscale.yaml
|
|
|
|
|
test_state.json
|
2021-07-06 00:59:06 -07:00
|
|
|
|
|
|
|
|
# workflow storage
|
|
|
|
|
workflow_data/
|