Path to this page:
./
sysutils/py-fsspec,
File-system specification
Branch: CURRENT,
Version: 2024.10.0,
Package name: py312-fsspec-2024.10.0,
Maintainer: pkgsrc-usersFilesystem Spec (fsspec) is a project to provide a unified pythonic interface
to local, remote and embedded file systems and bytes storage.
Master sites:
Filesize: 280.13 KB
Version history: (Expand)
- (2024-10-25) Updated to version: py312-fsspec-2024.10.0
- (2024-09-14) Updated to version: py312-fsspec-2024.9.0
- (2024-06-28) Updated to version: py311-fsspec-2024.6.1
- (2024-06-06) Updated to version: py311-fsspec-2024.6.0
- (2024-05-15) Updated to version: py311-fsspec-2024.5.0
- (2024-03-21) Updated to version: py311-fsspec-2024.3.1
CVS history: (Expand)
2024-03-21 10:14:33 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.3.1
2024.3.1
Fixes
allow override of expand in open()
root handling in local file paths, fix for windows
|
2024-03-17 11:08:48 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.3.0
2024.3.0
Enhancements
coroutines throttle to stream pool rather than batches
write transactions in simplecache
allow deep nested refs in referenceFS/parquet
Fixes
Fixes bug
remove extra calling mapper contains
connection retry for SMB
zip64 should be on is allowZip64 is
Other
HTTP logging
url_to_fs exposed in package root
sort known_implementations
code quality/stype
|
2024-02-05 11:59:17 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2024.2.0
2024.2.0
Enhancements
add 9P known implementation
allow TqdmCallback subclassing
callbacks/branching kwargs handling and scopes
add aluuxioFS to known implementations
implement pipe_file for dirFS
Fixes
infer compression for .lzma files
fix append to categorical/parquet references
allow for FTP servers that list with leading "total" line
convert FTP failure to FileNotFound
out of order reference fix
retry "backoff" response for DBFS
referenceFS case for scalar arrays
fix create_parents for SFTP
fix local .ls() on files
allow Path and similar in _expand_path
make lazy references editable
fix eq for abstract buffered files
fit tqdm cleanup
fix passing kwargs from cached file to underlying FS
Other
fix tests for supports_empty_directories=False
don't read references in init for referenceFS
code cleaning
pass through "replication" for HDFS
record more info for HTTP info()
add timeout argument to githubFS
add more security pars to webHDFS
|
2023-12-17 21:25:29 by Adam Ciarcinski | Files touched by this commit (3) | |
Log message:
py-fsspec: updated to 2023.12.2
2023.12.2
Fixes
top-level glob in ZIP
append mode on local ZIP files/truncate
restrict ":" as protocol marker to data:
sftp relative paths
http encoding in HTTP FS put_file
2023.12.1
Fixes
Remove trailing "/" from directory names in zipFS/archive
2023.12.0
Enhancements
allow HTTP size guess in more circumstances
allow kwargs passed to GUI to be dict
transaction support for writing via a cache FS
make cached FSs work better with async backends
allow FSs to set their transaction implementation
add dataFS
allow basic auth in webHDFS
Fixes
in referenceFS, maintain order when some keys are omitted in cat
nested subdirectory listing in referenceFS
allow "=" in webHDF paths
fix file mode to consistent "r+b" format
pass on kwargs in HTTP glob
allow Path in can_be_local and open_local
fix parent for cachedFS
"ends" list in _cat_ranges was incorrect
Other
smarter handling of exceptions when doing auto_mkdir
|
2023-11-10 19:52:38 by Adam Ciarcinski | Files touched by this commit (2) | |
Log message:
py-fsspec: updated to 2023.10.0
2023.10.0
Enhancements
alias "local://" to "file://"
get size of file cache
Fixes
stop unexpected kwargs for SMB
dos formatting
Other
small optimisations in referenceFS
define ordering behaviour for entrypoints
style
add LazyReferenceMapper to API docs
add PyPI badge to README
|
2023-10-28 21:57:26 by Thomas Klausner | Files touched by this commit (516) | |
Log message:
python/wheel.mk: simplify a lot, and switch to 'installer' for installation
This follows the recommended bootstrap method (flit_core, build, installer).
However, installer installs different files than pip, so update PLISTs
for all packages using wheel.mk and bump their PKGREVISIONs.
|
2023-10-16 15:01:45 by Adam Ciarcinski | Files touched by this commit (3) | |
Log message:
py-fsspec: updated to 2023.9.2
2023.9.2
Fixes
revert: auto_mkdir in open()
Other
code style updates
update CI setup
2023.9.1
Enhancements
* save file cache metadata in JSON
* remove some unnecessary list iterations
Fixes
* re-allow None for default port for SMB
* initialising GUI widget FS with kwargs
* pass auto_mkdir vi url_to_fs again
Other
* auto delete temp cache directory
2023.9.0
Enhancements
* add ocilake protocol
* implement async-sync and async-async generic cp and rsync
* add lakefs protocol
* add goatcounter to docs
* add xethub protocol
* in HTTP, check content-encoding when getting length
* add on_error in walk
* add dirfs attribute to mappers
* configure port for smb
Fixes
* don't reorder paths in bulk ops if source and dest are both lists
* allow mode="x" in get_fs_token_paths
* allow generic to work with complex URLs
* exclude bytes-cache kwargs in url_to_fs
* remote utcnow/utcfromtimestamp
* dirFS's protocol
* use get_file rather than get in file caching
* allow bz2 to be optional
Other
* more bulk ops testing
* separate out classes in file caching for future enhancements
|
2023-08-26 00:14:01 by Adam Ciarcinski | Files touched by this commit (3) | |
Log message:
py-fsspec: updated to 2023.6.0
2023.6.0
Enhancements
* add maxdepth fo cp/get/put
* allow dir modification during walk()
* add boxfs to registry
* optimise referenceFS lazy lookups, especially for writing parquet
* "encoding" for FTP
Fixes
* (re)allow reading .zstd reference sets
* resource.error for win32
* range reads in dbfs
* create parent directories in get_file
* off-by-one in reference block writing
* strip protocol in local rm_file
Other
* async bulk tests
* types and mypy
* drop outdated forms io.open, IOError
2023.5.0
Enhancements
* allow writing ReferenceFS references directly to parquet
Fixes
* copy of glob to single output directory
* non-recursive copy of directory (no-op)
* cleanup fix on close of ZIP FS
* ignore dirs when copying list of files
* don't error on register without clobber is registering same thing again
* special case for other_files and relative path
Other
* add test harness into released wheel package
* docs and tests around common bulk file operations
|