ray/python
Clark Zinzow f264cf800a
[Datasets] Support ignoring NaNs in aggregations. (#20787)
Adds support for ignoring NaNs in aggregations. NaNs will now be ignored by default, and the user can pass in `ds.mean("A", ignore_nulls=False)` if they would rather have the NaN be propagated to the output. Specifically, we'd have the following null-handling semantics:
1. Mix of values and nulls - `ignore_nulls`=True: Ignore the nulls, return aggregation of values
2. Mix of values and nulls - `ignore_nulls`=False: Return `None`
3. All nulls: Return `None`
4. Empty dataset: Return `None`

This all null and empty dataset handling matches the semantics of NumPy and Pandas.
2022-02-09 00:07:58 -08:00
..
ray [Datasets] Support ignoring NaNs in aggregations. (#20787) 2022-02-09 00:07:58 -08:00
requirements [Ray Usage Stats] Record cluster metadata + Refactoring. (#22170) 2022-02-08 22:12:36 -08:00
asv.conf.json [docs] Move all /latest links to /master (#11897) 2020-11-10 10:53:28 -08:00
build-wheel-macos-arm64.sh Upgrade cython to 0.29.26 for py310 (#21244) 2021-12-26 20:26:08 -08:00
build-wheel-macos.sh Upgrade cython to 0.29.26 for py310 (#21244) 2021-12-26 20:26:08 -08:00
build-wheel-manylinux2014.sh Upgrade cython to 0.29.26 for py310 (#21244) 2021-12-26 20:26:08 -08:00
build-wheel-windows.sh [CI] Migrate Windows Wheels to Buildkite (#21388) 2022-01-05 12:49:19 -08:00
MANIFEST.in Includes .pyi files in package data. (#21247) 2021-12-27 11:50:02 -08:00
README-building-wheels.md [build] Build wheels with manylinux2014 (#11621) 2020-11-03 19:36:32 -08:00
requirements.txt [Docs] Executable notebook tutorial (#22030) 2022-02-03 08:13:04 +00:00
requirements_linters.txt [CI] Add support for Black formatting (#21281) 2022-01-03 10:06:41 -08:00
requirements_ml_docker.txt [Deps] Bump tensorflow on Docker image and add Codeowners (#20041) 2021-11-05 00:58:34 -07:00
setup.py [CI] Format Python code with Black (#21975) 2022-01-29 18:41:57 -08:00