ray/dashboard/modules/state
SangBin Cho 8837a4593f
[State Observability] Truncate data when there are too many entries to return (#26124)
## Why are these changes needed?

This PR adds data truncation when there are more than N number of entries. The policy is as follow;

By default, we return 100 entries at max. Users can adjust this value, but we won't allow to increase more than 10K.

By default, all internal RPCs truncate data if it's > 10K. 

For distributed sources, we query each source with 10K limit and we apply limit again at the end. 

## Related issue number

Closes https://github.com/ray-project/ray/issues/25984#issue-1279280673
Part of https://github.com/ray-project/ray/issues/25718#issue-1268968400
2022-06-28 18:33:57 -07:00
..
__init__.py Revert "Revert "[State Observability] Basic functionality for central… (#23933) 2022-04-18 21:15:43 -07:00
state_head.py [State Observability] Truncate data when there are too many entries to return (#26124) 2022-06-28 18:33:57 -07:00