hiro/ray
1
0
Fork 0
mirror of https://github.com/vale981/ray synced 2025-03-06 02:21:39 -05:00
Code Issues Projects Releases Packages Wiki Activity Actions

[tune/air] catch pyarrow 8.0.0 error (#25900)

Browse source 
pyarrow 8.0.0 raises ArrowNotImplementedError instead of pyarrow.lib.ArrowInvalid for unrecognized URI.
This commit is contained in:
matthewdeng 2022-06-20 07:45:02 -07:00 • committed by GitHub
parent 96693055bd
commit 0ddc9d7213
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/ray/air/_internal/remote_storage.py
View file

@ -97,7 +97,7 @@ def get_fs_and_path(
fs, path = pyarrow.fs.FileSystem.from_uri(uri)
_cached_fs[cache_key] = fs
return fs, path
except pyarrow.lib.ArrowInvalid:
except (pyarrow.lib.ArrowInvalid, pyarrow.lib.ArrowNotImplementedError):
# Raised when URI not recognized
if not fsspec:
# Only return if fsspec is not installed