Path to this page:
./
sysutils/py-fsspec,
File-system specification
Branch: CURRENT,
Version: 2024.10.0,
Package name: py312-fsspec-2024.10.0,
Maintainer: pkgsrc-usersFilesystem Spec (fsspec) is a project to provide a unified pythonic interface
to local, remote and embedded file systems and bytes storage.
Master sites:
Filesize: 280.13 KB
Version history: (Expand)
- (2024-10-25) Updated to version: py312-fsspec-2024.10.0
- (2024-09-14) Updated to version: py312-fsspec-2024.9.0
- (2024-06-28) Updated to version: py311-fsspec-2024.6.1
- (2024-06-06) Updated to version: py311-fsspec-2024.6.0
- (2024-05-15) Updated to version: py311-fsspec-2024.5.0
- (2024-03-21) Updated to version: py311-fsspec-2024.3.1
CVS history: (Expand)
2024-10-25 13:59:24 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.10.0
2024.10.0
Fixes
- Performance of memoryFS rm
- Performance of git FS info
- Avoid git hex for newer pygit
- tests fix for zip
- missing open_async for dirFS
- handle pathlib in zip
- skip tests needing kerchunk if not installed
- allow repeated kwargs in unchain
Other
- Code style
- allow pyarrow in referenceFS parquet
- don't hardcode test port for parallel runs
|
2024-09-14 10:21:49 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.9.0
2024.9.0
Enhancements
- fewer stat calls in localFS
- faster find in ZIP
Fixes
- paths without "/" in dirFS
- paths with "/" in FTS
- ls in parquet-based nested reference sets, and append
- exception handling for SMB
|
2024-06-28 10:06:05 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.6.1
2024.6.1
Fixes
- fix appending to non-dict reference sets
- don't let generic edit info dicts
- set https's loop before calling super
- cached write file doesn't need to update it's size on close
- fix JSON serialize for FSs with interior FSs
- option to strip "password" when pickling
- fix filecache write
|
2024-06-06 07:03:14 by Adam Ciarcinski | Files touched by this commit (3) | |
Log message:
py-fsspec: updated to 2024.6.0
2024.6.0
Enhancements
- allow dicts (not just bytes) for referenceFS
- make filesystems JSON serializeable
- implement multifile cat() for github
Fixes
- implement auto_mkdir for SMB
Other
- add doc deps to pyproject
- re-remove test from package
- formatting
- change monthly download badge
|
2024-05-15 17:19:03 by Adam Ciarcinski | Files touched by this commit (3) | |
Log message:
py-fsspec: updated to 2024.5.0
2024.5.0
Enhancements
- log hits/misses in bytes cachers
Fixes
- SMB flaky tests
- rsync: only delete files if there are some to delete
- don't let files equal bytes objects
- url_to_fs to stringify paths
- assert types in MemoryFS
- restore _strip_protocol signature for local
- convert list to set when loading cache metadata
Other
- remove mv_file
- mv() should not swallow errors
- change versioning template, allows easier co-install of dev s3fs
- in ls_from_cache, avoid dounble lookup
- expand=True in open()
- build system to hatch
|
2024-03-21 10:14:33 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.3.1
2024.3.1
Fixes
allow override of expand in open()
root handling in local file paths, fix for windows
|
2024-03-17 11:08:48 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.3.0
2024.3.0
Enhancements
coroutines throttle to stream pool rather than batches
write transactions in simplecache
allow deep nested refs in referenceFS/parquet
Fixes
Fixes bug
remove extra calling mapper contains
connection retry for SMB
zip64 should be on is allowZip64 is
Other
HTTP logging
url_to_fs exposed in package root
sort known_implementations
code quality/stype
|
2024-02-05 11:59:17 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.2.0
2024.2.0
Enhancements
add 9P known implementation
allow TqdmCallback subclassing
callbacks/branching kwargs handling and scopes
add aluuxioFS to known implementations
implement pipe_file for dirFS
Fixes
infer compression for .lzma files
fix append to categorical/parquet references
allow for FTP servers that list with leading "total" line
convert FTP failure to FileNotFound
out of order reference fix
retry "backoff" response for DBFS
referenceFS case for scalar arrays
fix create_parents for SFTP
fix local .ls() on files
allow Path and similar in _expand_path
make lazy references editable
fix eq for abstract buffered files
fit tqdm cleanup
fix passing kwargs from cached file to underlying FS
Other
fix tests for supports_empty_directories=False
don't read references in init for referenceFS
code cleaning
pass through "replication" for HDFS
record more info for HTTP info()
add timeout argument to githubFS
add more security pars to webHDFS
|