#so idea: i write a python script that splits the files up into manageable chunks
Explore tagged Tumblr posts
Text
i may have made a mistake trying to copy a 100 gb file over network connection. oops
#tütensuppe#this is gonna take 2 hours#one of our teams was doing measurements that mysteriously produced giant files#and now they cant open them because their program tries to load the entire thing into memory at once#which you might be able to imagine does NOT work out well if the file is 100 gb large#so idea: i write a python script that splits the files up into manageable chunks#(nobody knows im trying this but if i can do it theyll probably be happy)#edit: it DID end up taking a bit over 2 hours
0 notes