Skip to content Skip to sidebar Skip to footer
Showing posts with the label Hdfs

Python Write To Hdfs File

What is the best way to create/write/update a file in remote HDFS from local python script? I am a… Read more Python Write To Hdfs File

Is It Possible To Save Files In Hadoop Without Saving Them In Local File System?

Is it possible to save files in Hadoop without saving them in local file system? I would like to do… Read more Is It Possible To Save Files In Hadoop Without Saving Them In Local File System?

Get A List Of Subdirectories

I know I can do this: data = sc.textFile('/hadoop_foo/a') data.count() 240 data = sc.textFi… Read more Get A List Of Subdirectories