Zip And Ftp A String On The Fly With Python

I want to zip a string(could be very big) and send it through FTP. So far I am using ftplib and ziplib, but they are not getting along too well. ftp = FTP(self.host) ftp.login(us

Solution 1:

I think you're taking the problem the wrong way round.

ftp.storbinary needs a bytes object, not a ZipFile object. You need to create bytes object with compressed data out of your uncompressed data, and pass that to ftp.storbinary. Plus you have to provide a name for the file in the archive.

this snippet creates such an object from a string (standalone example)

import zipfile,io

output_io = io.BytesIO()

zipfile_ob = zipfile.ZipFile(output_io,"w",zipfile.ZIP_DEFLATED)
zipfile_ob.writestr("your_data.txt",b"big string to be compressed"*20)
zipfile_ob.close()

now adapted to your context:

ftp = FTP(self.host)
ftp.login(user=self.username, passwd=self.password)
ftp.cwd(self.remote_path)

buf = str.encode("This string could be huge!!")
output_io = io.BytesIO()

zipfile_ob = zipfile.ZipFile(output_io,"w",zipfile.ZIP_DEFLATED)
zipfile_ob.writestr("your_data.txt",buf)
zipfile_ob.close()
output_io.seek(0)   # rewind the fake file
ftp.storbinary("STOR " + self.filename, output_io)

ftp.quit()

The seek part is needed else you're passing the output_io file-like object while at the end of the file (you just wrote to it so current position is: end of stream). Using seek(0) rewinds the file-like object so it can be read from the start.

note that for only one file, it may be better to use a Gzip object.