ruby - Upload file to HDFS in chunks -

i use gem 'webhdfs' upload file in chunks hdfs. see in documentation there create method i'm not sure how use , upload large file in chunks. has tried this?

i don't think have chunk yourself. can pass file handle , let library stream it.

file_io_handle = file.open('/tmp/foo.bin', 'rb') # straight documentation: client.create('/path/to/file', file_io_handle, :overwrite => false, :permission => 0666)