刘凡 9ff4d1d109 add S3,archive,truncate 2 years ago
..
.circleci 9ff4d1d109 add S3,archive,truncate 2 years ago
.github 9ff4d1d109 add S3,archive,truncate 2 years ago
dist 9ff4d1d109 add S3,archive,truncate 2 years ago
examples 9ff4d1d109 add S3,archive,truncate 2 years ago
zipfly 9ff4d1d109 add S3,archive,truncate 2 years ago
zipfly.egg-info 9ff4d1d109 add S3,archive,truncate 2 years ago
LICENSE 9ff4d1d109 add S3,archive,truncate 2 years ago
MANIFEST.in 9ff4d1d109 add S3,archive,truncate 2 years ago
README.md 9ff4d1d109 add S3,archive,truncate 2 years ago
setup.cfg 9ff4d1d109 add S3,archive,truncate 2 years ago
setup.py 9ff4d1d109 add S3,archive,truncate 2 years ago

README.md

Build Status GitHub release (latest by date) Downloads

ZipFly

ZipFly is a zip archive generator based on zipfile.py. It was created to generate very large ZIP archives for immediate sending out to clients, or for writing large ZIP archives without memory inflation.

Requirements

Python 3.6+ Added support for writing to unseekable streams.

Install

pip3 install zipfly

Basic usage, compress on-the-fly during writes

Using this library will save you from having to write the Zip to disk. Some data will be buffered by the zipfile deflater, but memory inflation is going to be very constrained. Data will be written to destination by default at regular 32KB intervals.

ZipFly defaults attributes:

  • paths: [ ]
  • mode: (write) w
  • chunksize: (bytes) 32768
  • compression: Stored
  • allowZip64: True
  • compresslevel: None
  • storesize: (bytes) 0
  • encode: utf-8


paths list of dictionaries:

.
fs Should be the path to a file on the filesystem
n (Optional) Is the name which it will have within the archive
(by default, this will be the same as fs)



from zipfly import ZipFly

paths = [
    {
        'fs': '/path/to/large/file'
    }
]

zfly = ZipFly(paths=paths)

with open("large.zip", "wb") as f:
    for i in zfly.generator():
        f.write(i)

Examples

Streaming multiple files in a zip with Django or Flask Send forth large files to clients with the most popular frameworks

Create paths Easy way to create the array paths from a parent folder.

Predict the size of the zip file before creating it Use the BufferPredictionSize to compute the correct size of the resulting archive before creating it.

Streaming a large file Efficient way to read a single very large binary file in python

Set a comment Your own comment in the zip file