./sysutils/py-fsspec, File-system specification

[ CVSweb ] [ Homepage ] [ RSS ] [ Required by ] [ Add to tracker ]


Branch: CURRENT, Version: 2024.10.0, Package name: py312-fsspec-2024.10.0, Maintainer: pkgsrc-users

Filesystem Spec (fsspec) is a project to provide a unified pythonic interface
to local, remote and embedded file systems and bytes storage.


Master sites:

Filesize: 280.13 KB

Version history: (Expand)


CVS history: (Expand)


   2024-10-25 13:59:24 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.10.0

2024.10.0

Fixes

- Performance of memoryFS rm
- Performance of git FS info
- Avoid git hex for newer pygit
- tests fix for zip
- missing open_async for dirFS
- handle pathlib in zip
- skip tests needing kerchunk if not installed
- allow repeated kwargs in unchain

Other

- Code style
- allow pyarrow in referenceFS parquet
- don't hardcode test port for parallel runs
   2024-09-14 10:21:49 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.9.0

2024.9.0

Enhancements

- fewer stat calls in localFS
- faster find in ZIP

Fixes

- paths without "/" in dirFS
- paths with "/" in FTS
- ls in parquet-based nested reference sets, and append
- exception handling for SMB
   2024-06-28 10:06:05 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.6.1

2024.6.1

Fixes
- fix appending to non-dict reference sets
- don't let generic edit info dicts
- set https's loop before calling super
- cached write file doesn't need to update it's size on close
- fix JSON serialize for FSs with interior FSs
- option to strip "password" when pickling
- fix filecache write
   2024-06-06 07:03:14 by Adam Ciarcinski | Files touched by this commit (3) | Package updated
Log message:
py-fsspec: updated to 2024.6.0

2024.6.0

Enhancements

- allow dicts (not just bytes) for referenceFS
- make filesystems JSON serializeable
- implement multifile cat() for github

Fixes

- implement auto_mkdir for SMB

Other

- add doc deps to pyproject
- re-remove test from package
- formatting
- change monthly download badge
   2024-05-15 17:19:03 by Adam Ciarcinski | Files touched by this commit (3) | Package updated
Log message:
py-fsspec: updated to 2024.5.0

2024.5.0

Enhancements

- log hits/misses in bytes cachers

Fixes

- SMB flaky tests
- rsync: only delete files if there are some to delete
- don't let files equal bytes objects
- url_to_fs to stringify paths
- assert types in MemoryFS
- restore _strip_protocol signature for local
- convert list to set when loading cache metadata

Other

- remove mv_file
- mv() should not swallow errors
- change versioning template, allows easier co-install of dev s3fs
- in ls_from_cache, avoid dounble lookup
- expand=True in open()
- build system to hatch
   2024-03-21 10:14:33 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.3.1

2024.3.1

Fixes

allow override of expand in open()
root handling in local file paths, fix for windows
   2024-03-17 11:08:48 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.3.0

2024.3.0

Enhancements

coroutines throttle to stream pool rather than batches
write transactions in simplecache
allow deep nested refs in referenceFS/parquet

Fixes

Fixes bug
remove extra calling mapper contains
connection retry for SMB
zip64 should be on is allowZip64 is

Other

HTTP logging
url_to_fs exposed in package root
sort known_implementations
code quality/stype
   2024-02-05 11:59:17 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.2.0

2024.2.0

Enhancements

add 9P known implementation
allow TqdmCallback subclassing
callbacks/branching kwargs handling and scopes
add aluuxioFS to known implementations
implement pipe_file for dirFS

Fixes

infer compression for .lzma files
fix append to categorical/parquet references
allow for FTP servers that list with leading "total" line
convert FTP failure to FileNotFound
out of order reference fix
retry "backoff" response for DBFS
referenceFS case for scalar arrays
fix create_parents for SFTP
fix local .ls() on files
allow Path and similar in _expand_path
make lazy references editable
fix eq for abstract buffered files
fit tqdm cleanup
fix passing kwargs from cached file to underlying FS

Other

fix tests for supports_empty_directories=False
don't read references in init for referenceFS
code cleaning
pass through "replication" for HDFS
record more info for HTTP info()
add timeout argument to githubFS
add more security pars to webHDFS