./net/py-gsutil, Command line tool for interacting with cloud storage services

[ CVSweb ] [ Homepage ] [ RSS ] [ Required by ] [ Add to tracker ]


Branch: CURRENT, Version: 4.53, Package name: py37-gsutil-4.53, Maintainer: bsiegert

gsutil is a Python application that lets you access Google Cloud Storage and
Amazon S3 from the command line. You can use gsutil to do a wide range of
bucket and object management tasks, including:

* Creating and deleting buckets
* Uploading, downloading, and deleting objects
* Listing buckets and objects
* Moving, copying, and renaming objects
* Editing object and bucket ACLs


Required to run:
[security/py-OpenSSL] [devel/py-setuptools] [devel/py-mock] [www/py-httplib2] [lang/py-six] [devel/py-argcomplete] [devel/py-fasteners] [time/py-monotonic] [net/py-socksipy-branch] [devel/py-retry_decorator] [security/py-crcmod] [net/py-gcs-oauth2-boto-plugin] [www/py-google-apitools] [security/py-google-reauth] [lang/python37]

Required to build:
[pkgtools/cwrappers]

Master sites:

SHA1: d2cba354892fe912eedd33acfd515ad2b52fc5d0
RMD160: ae413b5fd323d280e1f3724bc181a597e7cf42aa
Filesize: 2429.605 KB

Version history: (Expand)


CVS history: (Expand)


   2020-10-16 09:41:10 by Benny Siegert | Files touched by this commit (3) | Package updated
Log message:
Update py-gsutil to 4.53.

Release 4.53 (release date: 2020-08-19)
======================================
Bug Fixes
------------------
- Remove socksipy dependency to fix proxy authentication
- Retry on errors relating to region specification for S3

Other Changes
------------------
- Prompt Daisy chain users to try STS
- Add new IAM types, and disable URL parsing for  IAM b/c it has subcommands.
- Many text updates and clarifications.
   2020-08-03 10:44:24 by Adam Ciarcinski | Files touched by this commit (1)
Log message:
py-gsutil: add CHECK_INTERPRETER_SKIP
   2020-07-14 19:52:22 by Adam Ciarcinski | Files touched by this commit (3) | Package updated
Log message:
py-gsutil: updated to 4.52

Release 4.52
Bug Fixes
- Fix tests using wrong AWS credentials if AWS CLI is installed.
- Fix `AttributeError: module 'gslib' has no attribute 'USER_AGENT'`.
- Fix encoding error in `user_agent_helper`.
- Fix stdout ordering issue in hash command.
- Fix multithread race condition for cp/mv command when multiple operations are \ 
attempting to create the same directory.
- Fix OSError on interrupted rsync -d.
   2020-07-07 18:49:19 by Benny Siegert | Files touched by this commit (3) | Package updated
Log message:
Update gsutil to 4.51.

It now includes its own vendored copy of Boto.

Release 4.51 (release date: 2020-03-26)
======================================
- Fixed file permissions for credstor2 and tracker files (#1002 and # 1005)
- Added a check to restrict the duration (-d option) for signurl command
  to 12 hours if -u flag is used. (#1014)
- Updated rsync command to try patching before overwriting,
  rather than checking ACL (#1016)
- Several documentation updates and clarifications.

Release 4.50 (release date: 2020-04-30)
======================================
- Switched to Using V4 signature as default for S3 (#981)
- Updated rsa library to release-4.0 (#992)
- Updated test script to install pyenv if missing for kokoro (#990)
- Fixed print ordering in kms set by using print instead of
  text_util.print_to_fd (#974)
- Several documentation updates and clarifications (#969) (#987)

Release 4.49 (release date: 2020-03-26)
======================================
- Added support for service account impersonation for signurl.
- Fixed an issue with rsync throwing error when the destination url is a prefix of
  an existing object.
- Several documentation updates and clarifications.

Release 4.48 (release date: 2020-02-28)
======================================
- Fixed special character handling in filenames on Windows with Python3.
- Fixed issue while transferring binary files from S3 with Python3.
- Fixed KMS tests, so that keys are created in the same region as their buckets.
- Several documentation updates and clarifications.
   2020-05-25 07:40:03 by Roland Illig | Files touched by this commit (1)
Log message:
net/py-gsutil: remove nonexistent file from REPLACE_PYTHON
   2020-02-16 22:08:14 by Adam Ciarcinski | Files touched by this commit (3) | Package updated
Log message:
py-gsutil: updated to 4.47

Release 4.47:

New Features
- Added support for the new archive storage class.

Other Changes
- Several documentation updates and clarifications.
   2020-01-03 13:09:06 by Adam Ciarcinski | Files touched by this commit (2) | Package updated
Log message:
py-gsutil: updated to 4.46

Release 4.46:
Bug Fixes
- Fixed issue with domain permissions functionality.
   2020-01-02 20:22:41 by Benny Siegert | Files touched by this commit (4) | Package updated
Log message:
Update py-gsutil to 4.45, now with Python 3 support!

Release 4.45 (release date: 2019-10-18)
=======================================
Bug Fixes
------------------
 - Fixed exception when using CMEK with resumable uploads.
 - Fixed alias for new ubla command.
 - Fixed default RDNS behavior for backwards compatibility with 4.42 and earlier.

Other Changes
------------------
- Improvements to continuous integration workflow.

Release 4.44 (release date: 2019-10-02)
=======================================
New Features
------------------
- Added support for service account impersonation through a new `-i` option to
  specify a service account to impersonate.
- Added support for members using the deleted syntax (i.e. `deleted:user:...`,
  `deleted:group:...`, `deleted:serviceAccount:...`).
- Added support for the new uniform bucket-level access (`ubla`) command
  (currently an alias of `bucketpolicyonly`).
- Added `-w` flag to `kms` command, which shows a warning rather than failing
  when updating key permissions does not succeed.

Bug Fixes
------------------
- Fixed regression in cp where a statement like
  `cp my-file gs://my-bucket/non-existent-folder/` would create a file called
  `non-existent-folder` rather than `non-existent-folder/my-file`.
- Fixed streaming uploads for Python 3.

Release 4.43 (release date: 2019-09-20)
=======================================
New Features
------------------
- Added support for socks proxies, including socks4 and socks5.

Bug Fixes
------------------
- Fixed cp/mv errors that occur when  destination directory is a substring of
  another directory. Behavior now more closely matches OS cp/mv commands.
- Fixed issue where set IAM policy on objects threw errors.
- Fixed issue when showing help in a pager in Python 3 environments.

Other Changes
------------------
- Several documentation updates and clarifications.

Release 4.42 (release date: 2019-08-05)
=======================================
 Bug Fixes
------------------
- Fixed some text encoding/decoding issues in certain Python 3 environments.
- Fixed issue where bundled crcmod for macOS could not be imported and would
  crash gsutil on Python 3.
- Fixed issue where trying to run gsutil on an unsupported version of Python 3
  (3.4 or below) would crash instead of presenting an informative error.

Other Changes
------------------
- Several documentation updates and clarifications.

Release 4.41 (release date: 2019-07-16)
=======================================
New Features
------------------
- Added HMAC key management for service accounts. This includes a new \ 
"hmac"
  command to create/get/list/update/delete HMAC keys on service accounts.
  Currently, your project must be whitelisted for use with this new HMAC
  functionality. This restriction will be lifted in the near future.

 Bug Fixes
------------------
- Fixed bug where copying files > 100MiB from GCS to S3 was hanging.
- Fixed issue where content type was sometimes set improperly.

Release 4.40 (release date: 2019-07-01)
=======================================
New Features
------------------
- Added support for running gsutil on Python 3.5+. Python 2 will reach its EOL
  (End of Life) on Jan. 1, 2020, and gsutil will stop supporting Python 2.7 at
  some point afterward (TBD).

 Bug Fixes
------------------
- Fixed bug introduced in v4.39 where rsync would not correctly sync object/file
  names containing some special URL-encodable characters (e.g. "+" and
  whitespace characters).
- Fixed the update command so that it no longer fails when it detects the
  presence of additional top-level files that were added in the v4.39 release.

 Other Changes
------------------
- Several documentation updates and clarifications.

Release 4.39 (release date: 2019-06-13)
=======================================
New Features
------------------
- Compression level is now configurable by setting "gzip_compression_level"
  under the "GSUtil" section in the boto config file. The default \ 
value is 9.

 Bug Fixes
------------------
- Fixed bug where IAM operations failed on buckets whose names lacked any
  letters.

 Other Changes
------------------
- Revised contribution guidelines to direct developers to submit GitHub pull
  requests instead of using the Rietveld code review tool.
- Several code changes to work toward Python 3 support (coming in a subsequent
  release).
- Several documentation and command help improvements.
- Various improvements to test stability and feedback.

Release 4.38 (release date: 2019-03-25)
=======================================
Bug Fixes
------------------
- Fixed issue where multiprocessing check would raise an exception if
  /etc/os-release was not in the expected format.

Other Changes
------------------
- Improved error message for trying to retrieve default object ACLs on a bucket
  with Bucket Policy Only enabled.
- When running "gsutil -D rsync ..." and encountering an error listing \ 
local
  files, gsutil will now print a stack trace as debug-level output.
- Several documentation updates and clarifications.

Release 4.37 (release date: 2019-02-26)
=======================================
Bug Fixes
------------------
- Fixed a bug where XML API requests would sometimes fail with SSLError
  exceptions due to SNI not being used for https connections.
- Fixed "du" output spacing for 6-digit sizes.

Other Changes
------------------
- Updated crcmod installation instructions for CentOS 6.

Release 4.36 (release date: 2019-01-28)
=======================================
New features
------------------
- Added Bucket Policy Only support to gsutil. This includes a new
  "bucketpolicyonly" command to get/set BPO on existing buckets, as \ 
well adding
  the ability to set BPO at bucket creation time with "mb -b". \ 
Currently, your
  project must be whitelisted for use with the new BPO functionality. This
  restriction will be lifted in the near future.

Bug Fixes
------------------
- Fixed a bug where "cp -n" would overwrite a local file at the \ 
destination if
  its size differed from the source's size.

Other Changes
------------------
- Updated crcmod installation instructions for enterprise SUSE systems.

Release 4.35 (release date: 2018-12-18)
=======================================
New features
------------------
- Added -u option to rsync; this will skip copying files/objects that are newer
  (as determined by checking mtime) at the destination.

Bug Fixes
------------------
- The "iam ch" command now allows supplying custom IAM roles.
- Fixed an issue where debug output was not displaying all of the loaded config
  files under the "config path(s)" label.
- Disabled running with multiple processes when running on Alpine Linux, as this
  would sometimes cause gsutil to hang forever. Running with multiple threads is
  still allowed.
- The "rsync" command now prints log messages during synchronization \ 
to indicate
  when symlinks are being skipped.
- The "Boto:ca_certificates_file" config option can now be overridden using
  the -o option.

Other Changes
------------------
- Disallowed installing gsutil on Python versions != 2.7.
- Several documentation updates and clarifications.