ruby - Upload file to HDFS in chunks -


i use gem 'webhdfs' upload file in chunks hdfs. see in documentation there create method i'm not sure how use , upload large file in chunks. has tried this?

i don't think have chunk yourself. can pass file handle , let library stream it.

file_io_handle = file.open('/tmp/foo.bin', 'rb') # straight documentation: client.create('/path/to/file', file_io_handle, :overwrite => false, :permission => 0666) 

Comments

Popular posts from this blog

c++ - OpenCV Error: Assertion failed <scn == 3 ::scn == 4> in unknown function, -

php - render data via PDO::FETCH_FUNC vs loop -

The canvas has been tainted by cross-origin data in chrome only -