ruby - Upload file to HDFS in chunks -
i use gem 'webhdfs' upload file in chunks hdfs. see in documentation there create method i'm not sure how use , upload large file in chunks. has tried this?
i don't think have chunk yourself. can pass file handle , let library stream it.
file_io_handle = file.open('/tmp/foo.bin', 'rb') # straight documentation: client.create('/path/to/file', file_io_handle, :overwrite => false, :permission => 0666)
Comments
Post a Comment