Log message:
py-fsspec: updated to 2024.3.1

2024.3.1

Fixes

allow override of expand in open()
root handling in local file paths, fix for windows

Log message:
py-fsspec: updated to 2024.3.0

2024.3.0

Enhancements

coroutines throttle to stream pool rather than batches
write transactions in simplecache
allow deep nested refs in referenceFS/parquet

Fixes

Fixes bug
remove extra calling mapper contains
connection retry for SMB
zip64 should be on is allowZip64 is

Other

HTTP logging
url_to_fs exposed in package root
sort known_implementations
code quality/stype

Log message:
py-fsspec: updated to 2024.2.0

2024.2.0

Enhancements

add 9P known implementation
allow TqdmCallback subclassing
callbacks/branching kwargs handling and scopes
add aluuxioFS to known implementations
implement pipe_file for dirFS

Fixes

infer compression for .lzma files
fix append to categorical/parquet references
allow for FTP servers that list with leading "total" line
convert FTP failure to FileNotFound
out of order reference fix
retry "backoff" response for DBFS
referenceFS case for scalar arrays
fix create_parents for SFTP
fix local .ls() on files
allow Path and similar in _expand_path
make lazy references editable
fix eq for abstract buffered files
fit tqdm cleanup
fix passing kwargs from cached file to underlying FS

Other

fix tests for supports_empty_directories=False
don't read references in init for referenceFS
code cleaning
pass through "replication" for HDFS
record more info for HTTP info()
add timeout argument to githubFS
add more security pars to webHDFS

Log message:
py-fsspec: updated to 2023.12.2

2023.12.2

Fixes

top-level glob in ZIP
append mode on local ZIP files/truncate
restrict ":" as protocol marker to data:
sftp relative paths
http encoding in HTTP FS put_file

2023.12.1

Fixes

Remove trailing "/" from directory names in zipFS/archive

2023.12.0

Enhancements

allow HTTP size guess in more circumstances
allow kwargs passed to GUI to be dict
transaction support for writing via a cache FS
make cached FSs work better with async backends
allow FSs to set their transaction implementation
add dataFS
allow basic auth in webHDFS

Fixes

in referenceFS, maintain order when some keys are omitted in cat
nested subdirectory listing in referenceFS
allow "=" in webHDF paths
fix file mode to consistent "r+b" format
pass on kwargs in HTTP glob
allow Path in can_be_local and open_local
fix parent for cachedFS
"ends" list in _cat_ranges was incorrect

Other

smarter handling of exceptions when doing auto_mkdir

Log message:
py-fsspec: updated to 2023.10.0

2023.10.0

Enhancements

alias "local://" to "file://"
get size of file cache

Fixes

stop unexpected kwargs for SMB
dos formatting

Other

small optimisations in referenceFS
define ordering behaviour for entrypoints
style
add LazyReferenceMapper to API docs
add PyPI badge to README

Log message:
python/wheel.mk: simplify a lot, and switch to 'installer' for installation

This follows the recommended bootstrap method (flit_core, build, installer).

However, installer installs different files than pip, so update PLISTs
for all packages using wheel.mk and bump their PKGREVISIONs.

Log message:
py-fsspec: updated to 2023.9.2

2023.9.2

Fixes

revert: auto_mkdir in open()

Other

code style updates
update CI setup

2023.9.1

Enhancements

* save file cache metadata in JSON
* remove some unnecessary list iterations

Fixes

* re-allow None for default port for SMB
* initialising GUI widget FS with kwargs
* pass auto_mkdir vi url_to_fs again

Other

* auto delete temp cache directory

2023.9.0

Enhancements

* add ocilake protocol
* implement async-sync and async-async generic cp and rsync
* add lakefs protocol
* add goatcounter to docs
* add xethub protocol
* in HTTP, check content-encoding when getting length
* add on_error in walk
* add dirfs attribute to mappers
* configure port for smb

Fixes

* don't reorder paths in bulk ops if source and dest are both lists
* allow mode="x" in get_fs_token_paths
* allow generic to work with complex URLs
* exclude bytes-cache kwargs in url_to_fs
* remote utcnow/utcfromtimestamp
* dirFS's protocol
* use get_file rather than get in file caching
* allow bz2 to be optional

Other

* more bulk ops testing
* separate out classes in file caching for future enhancements

Log message:
py-fsspec: updated to 2023.6.0

2023.6.0

Enhancements

* add maxdepth fo cp/get/put
* allow dir modification during walk()
* add boxfs to registry
* optimise referenceFS lazy lookups, especially for writing parquet
* "encoding" for FTP

Fixes

* (re)allow reading .zstd reference sets
* resource.error for win32
* range reads in dbfs
* create parent directories in get_file
* off-by-one in reference block writing
* strip protocol in local rm_file

Other

* async bulk tests
* types and mypy
* drop outdated forms io.open, IOError

2023.5.0

Enhancements

* allow writing ReferenceFS references directly to parquet

Fixes

* copy of glob to single output directory
* non-recursive copy of directory (no-op)
* cleanup fix on close of ZIP FS
* ignore dirs when copying list of files
* don't error on register without clobber is registering same thing again
* special case for other_files and relative path

Other

* add test harness into released wheel package
* docs and tests around common bulk file operations

Log message:
py-fsspec: added version 2023.4.0

Filesystem Spec (fsspec) is a project to provide a unified pythonic interface
to local, remote and embedded file systems and bytes storage.