linux - how to remove only the duplication file under some directory ( with the same cksum ) -

-

i build following script in order remove files same cksum ( or content )

the problem script can remove files twice following example ( output )

my target remove duplication file , not source file ,

script output:

  starting:   same: /tmp/file_inventury.out /tmp/file_inventury.out.1   remove: /tmp/file_inventury.out.1   same: /tmp/file_inventury.out.1 /tmp/file_inventury.out   remove: /tmp/file_inventury.out   same: /tmp/file_inventury.out.2 /tmp/file_inventury.out.3   remove: /tmp/file_inventury.out.3   same: /tmp/file_inventury.out.3 /tmp/file_inventury.out.2   remove: /tmp/file_inventury.out.2   same: /tmp/file_inventury.out.4 /tmp/file_inventury.out   remove: /tmp/file_inventury.out   done.

.

my script:

 #!/bin/bash   dir="/tmp"  echo "starting:"   file1 in ${dir}/file_inventury.out*;     file2 in ${dir}/file_inventury.out*;             if [ $file1 != $file2 ];                     diff "$file1" "$file2" 1>/dev/null                     stat=$?                     if [ $stat -eq 0 ]                                                  echo "same: $file1 $file2"                             echo "remove: $file2"                             rm "$file1"                             break                     fi             fi     done  done  echo "done."

.

in case want ear – other options how remove files same content or cksum ( need remove duplication file , not primary file )

please advice how can under solaris os , ( options example - find 1 liner , awk , sed ... etc )

this version should more efficient. nervous paste matching correct rows, looks posix specifies glob'ing sorted default.

for in *;     date -u +%y-%m-%dt%tz -r "$i"; done > .stat;         #store last modification time in sortable format cksum * > .cksum;     #store cksum, size, , filename paste .stat .cksum |  #data each file, 1 per row     sort |            #sort mtime original comes first     awk '{         if($2 in f)             system("rm -v " $4); #rm if have seen occurrence of cksum         else             f[$2]++              #count first occurrence     }'

this should run in o(n * log(n)) time, reading each file once.

you can put in shell script as:

#!/bin/sh  in *;     date -u +%y-%m-%dt%tz -r "$i"; done > .stat; cksum * > .cksum; paste .stat .cksum | sort | awk '{if($2 in f) system("rm -v " $4); else f[$2]++}'; rm .stat .cksum; exit 0;

or one-liner:

for in *; date -u +%y-%m-%dt%tz -r "$i"; done > .stat; cksum * > .cksum; paste .stat .cksum | sort | awk '{if($2 in f) system("rm -v " $4); else f[$2]++}'; rm .stat .cksum;

Comments

Post a Comment

Popular posts from this blog

c++ - OpenCV Error: Assertion failed <scn == 3 ::scn == 4> in unknown function, -

-
i read alot other solution still confused should mine... #include <opencv2/objdetect/objdetect.hpp> #include <opencv2/highgui/highgui.hpp> #include <opencv2/imgproc/imgproc.hpp> #include <iostream> #include <stdio.h> using namespace std; using namespace cv; int main(int argc, const char** argv) { //create cascade classifier object used face detection cascadeclassifier face_cascade; //use haarcascade_frontalface_alt.xml library face_cascade.load("haarcascade_frontalface_alt.xml"); //setup video capture device , link first capture device videocapture capturedevice; capturedevice.open(0); //setup image files used in capture process mat captureframe; mat grayscaleframe; //create window present results namedwindow("outputcapture", 1); //create loop capture , find faces while (true) { //capture new image frame capturedevice >> captureframe; ...
Read more

php - render data via PDO::FETCH_FUNC vs loop -

-
i've been using 2 methods render data. the first one: function name($id,$name){ return '<div id="'.$id.'">'.$name.'</div>'; } echo implode($pdo->query("select id,name user")->fetchall(pdo::fetch_func,'name')); the second one: $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); foreach($users $user){ echo name($user->id,$user->name); } i don't understand how pdo::fetch_func works. tried figure out. however, not well-documented. could please explain fetch mode? , also, 1 performs better? thank you. both methods wrong , have learn how use templates , how separate business logic presentation logic. $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); tpl::assign('users', $users); is code business logic part. then in template <?php foreach $users $row): ?> <div id="<?=$...
Read more

The canvas has been tainted by cross-origin data in chrome only -

-
uncaught securityerror: failed execute 'getimagedata' on 'canvasrenderingcontext2d': canvas has been tainted cross-origin data i getting above error in chrome. code(following) works fine in mozilla. have not corss domain issue. why above error in chrome? var wheel_canvas, wheel_context, can_w, can_h, wheel_grd; var large_radius = 160; var small_radius = 120; var wheel_canvas = document.getelementbyid('wheel_canvas'); var wheel_context = wheel_canvas.getcontext('2d'); var can_w = $(wheel_canvas).width(); var can_h = $(wheel_canvas).height(); var centerx = can_w / 2, centery = can_h / 2; var wheel_grd = null; test('#ff0000'); function test(hex) { $('#clrpicker').css({'left': 210, 'top': 210 }); inverted = hexbw(hex); $('#color_val_show').val(hex); current_color_hex_val_selected = hex; $('#color_val_show').css({'color':inverted,'background':hex}); fillgradient...
Read more