./sysutils/py-fsspec, File-system specification

[ CVSweb ] [ Homepage ] [ RSS ] [ Required by ] [ Add to tracker ]


Branch: CURRENT, Version: 2024.12.0, Package name: py312-fsspec-2024.12.0, Maintainer: pkgsrc-users

Filesystem Spec (fsspec) is a project to provide a unified pythonic interface
to local, remote and embedded file systems and bytes storage.


Master sites:

Filesize: 284.766 KB

Version history: (Expand)


CVS history: (Expand)


   2024-12-24 18:53:54 by Adam Ciarcinski | Files touched by this commit (3) | Package updated
Log message:
py-fsspec: updated to 2024.12.0

2024.12.0

Enhancements

- "exclusive" mode for writing
- "tree" text display of filesystem contents
- async wrapper for sync FSs
- new known implementation: tosfs
- consilidate block fetch requests

Fixes

- better webHDFS proxies
- syn FSs in referenceFS
- don't serialize file caches
- race condition in local ls()
- missing/nan references in parquet
- _un_chain kwargs (@1736)
- async _cat_file in referenceFS

Other

- fallback implementation for _fetch_range
   2024-10-25 13:59:24 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.10.0

2024.10.0

Fixes

- Performance of memoryFS rm
- Performance of git FS info
- Avoid git hex for newer pygit
- tests fix for zip
- missing open_async for dirFS
- handle pathlib in zip
- skip tests needing kerchunk if not installed
- allow repeated kwargs in unchain

Other

- Code style
- allow pyarrow in referenceFS parquet
- don't hardcode test port for parallel runs
   2024-09-14 10:21:49 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.9.0

2024.9.0

Enhancements

- fewer stat calls in localFS
- faster find in ZIP

Fixes

- paths without "/" in dirFS
- paths with "/" in FTS
- ls in parquet-based nested reference sets, and append
- exception handling for SMB
   2024-06-28 10:06:05 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.6.1

2024.6.1

Fixes
- fix appending to non-dict reference sets
- don't let generic edit info dicts
- set https's loop before calling super
- cached write file doesn't need to update it's size on close
- fix JSON serialize for FSs with interior FSs
- option to strip "password" when pickling
- fix filecache write
   2024-06-06 07:03:14 by Adam Ciarcinski | Files touched by this commit (3) | Package updated
Log message:
py-fsspec: updated to 2024.6.0

2024.6.0

Enhancements

- allow dicts (not just bytes) for referenceFS
- make filesystems JSON serializeable
- implement multifile cat() for github

Fixes

- implement auto_mkdir for SMB

Other

- add doc deps to pyproject
- re-remove test from package
- formatting
- change monthly download badge
   2024-05-15 17:19:03 by Adam Ciarcinski | Files touched by this commit (3) | Package updated
Log message:
py-fsspec: updated to 2024.5.0

2024.5.0

Enhancements

- log hits/misses in bytes cachers

Fixes

- SMB flaky tests
- rsync: only delete files if there are some to delete
- don't let files equal bytes objects
- url_to_fs to stringify paths
- assert types in MemoryFS
- restore _strip_protocol signature for local
- convert list to set when loading cache metadata

Other

- remove mv_file
- mv() should not swallow errors
- change versioning template, allows easier co-install of dev s3fs
- in ls_from_cache, avoid dounble lookup
- expand=True in open()
- build system to hatch
   2024-03-21 10:14:33 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.3.1

2024.3.1

Fixes

allow override of expand in open()
root handling in local file paths, fix for windows
   2024-03-17 11:08:48 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-fsspec: updated to 2024.3.0

2024.3.0

Enhancements

coroutines throttle to stream pool rather than batches
write transactions in simplecache
allow deep nested refs in referenceFS/parquet

Fixes

Fixes bug
remove extra calling mapper contains
connection retry for SMB
zip64 should be on is allowZip64 is

Other

HTTP logging
url_to_fs exposed in package root
sort known_implementations
code quality/stype