Kafka does not start on Windows - key not found: \tmp\kafka-logs -

-

i have put effort getting kafka run on windows 32 (company issued laptop - not choice..).

i successful create handful of topics. after stopping/restarting kafka unable re-read topics. here startup logs

[2014-05-29 12:26:23,097] info [replicafetchermanager on broker 0] removed fetcher partitions [vip_ips_alerts,0],[calls,0],[dropped_calls,0],[calls_online,0],[calls_no_phone,0] (kafka.server.replicafetchermanager) [2014-05-29 12:26:23,106] error [kafkaapi-0] error when handling request name:leaderandisrrequest;version:0;controller:0;controllerepoch:4;correlationid:5;clientid:id_0-host_null-port_9092;leaders:id:0,host:s80035683-sc01.mycompany.com,port:9092;partitionstate:(vip_ips_alerts,0) -> (leaderandisrinfo:(leader:0,isr:0,leaderepoch:3,controllerepoch:4),replicationfactor:1),allreplicas:0),(calls,0) -> (leaderandisrinfo:(leader:0,isr:0,leaderepoch:1,controllerepoch:4),replicationfactor:1),allreplicas:0),(dropped_calls,0) -> (leaderandisrinfo:(leader:0,isr:0,leaderepoch:3,controllerepoch:4),replicationfactor:1),allreplicas:0),(calls_online,0) -> (leaderandisrinfo:(leader:0,isr:0,leaderepoch:3,controllerepoch:4),replicationfactor:1),allreplicas:0),(calls_no_phone,0) -> (leaderandisrinfo:(leader:0,isr:0,leaderepoch:3,controllerepoch:4),replicationfactor:1),allreplicas:0) (kafka.server.kafkaapis) java.util.nosuchelementexception: key not found: \tmp\kafka-logs         @ scala.collection.maplike$class.default(maplike.scala:225)         @ scala.collection.immutable.map$map1.default(map.scala:107)         @ scala.collection.maplike$class.apply(maplike.scala:135)         @ scala.collection.immutable.map$map1.apply(map.scala:107)         @ kafka.cluster.partition.getorcreatereplica(partition.scala:91)         @ kafka.cluster.partition$$anonfun$makeleader$2.apply(partition.scala:175)         @ kafka.cluster.partition$$anonfun$makeleader$2.apply(partition.scala:175)         @ scala.collection.immutable.set$set1.foreach(set.scala:86)         @ kafka.cluster.partition.makeleader(partition.scala:175)         @ kafka.server.replicamanager$$anonfun$makeleaders$5.apply(replicamanager.scala:305)         @ kafka.server.replicamanager$$anonfun$makeleaders$5.apply(replicamanager.scala:304)         @ scala.collection.mutable.hashmap$$anonfun$foreach$1.apply(hashmap.scala:95)         @ scala.collection.mutable.hashmap$$anonfun$foreach$1.apply(hashmap.scala:95)         @ scala.collection.iterator$class.foreach(iterator.scala:772)         @ scala.collection.mutable.hashtable$$anon$1.foreach(hashtable.scala:157)         @ scala.collection.mutable.hashtable$class.foreachentry(hashtable.scala:190)         @ scala.collection.mutable.hashmap.foreachentry(hashmap.scala:45)         @ scala.collection.mutable.hashmap.foreach(hashmap.scala:95)         @ kafka.server.replicamanager.makeleaders(replicamanager.scala:304)         @ kafka.server.replicamanager.becomeleaderorfollower(replicamanager.scala:258)         @ kafka.server.kafkaapis.handleleaderandisrrequest(kafkaapis.scala:100)         @ kafka.server.kafkaapis.handle(kafkaapis.scala:72)         @ kafka.server.kafkarequesthandler.run(kafkarequesthandler.scala:42)         @ java.lang.thread.run(thread.java:744)

now ok drop /re-create topics. have done several times part of investigation (e.g. ensure no zookeeper corruption), tips on how kafka server on out-of-date o/s appreciated.

misinterpret log.dir huge source of pain in kafka in both unixes , windows.

it seems exception caused in following statement in partition. replicamanager.highwatermarkcheckpoints(log.dir.getparent) tries in map of highwatermarkcheckpoint files find key "\kafka8-tmp\kafka-logs", doesn't exist. register keys using property value in log.dirs.

source

make sure don't have trailing slashes , new java.io.file("\tmp\kafka-logs").getparent not distorted (i don't have windows machine right next me figure out forward/backward slashes myself).


Comments

Post a Comment

Popular posts from this blog

php - render data via PDO::FETCH_FUNC vs loop -

-
i've been using 2 methods render data. the first one: function name($id,$name){ return '<div id="'.$id.'">'.$name.'</div>'; } echo implode($pdo->query("select id,name user")->fetchall(pdo::fetch_func,'name')); the second one: $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); foreach($users $user){ echo name($user->id,$user->name); } i don't understand how pdo::fetch_func works. tried figure out. however, not well-documented. could please explain fetch mode? , also, 1 performs better? thank you. both methods wrong , have learn how use templates , how separate business logic presentation logic. $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); tpl::assign('users', $users); is code business logic part. then in template <?php foreach $users $row): ?> <div id="<?=$...
Read more

c++ - OpenCV Error: Assertion failed <scn == 3 ::scn == 4> in unknown function, -

-
i read alot other solution still confused should mine... #include <opencv2/objdetect/objdetect.hpp> #include <opencv2/highgui/highgui.hpp> #include <opencv2/imgproc/imgproc.hpp> #include <iostream> #include <stdio.h> using namespace std; using namespace cv; int main(int argc, const char** argv) { //create cascade classifier object used face detection cascadeclassifier face_cascade; //use haarcascade_frontalface_alt.xml library face_cascade.load("haarcascade_frontalface_alt.xml"); //setup video capture device , link first capture device videocapture capturedevice; capturedevice.open(0); //setup image files used in capture process mat captureframe; mat grayscaleframe; //create window present results namedwindow("outputcapture", 1); //create loop capture , find faces while (true) { //capture new image frame capturedevice >> captureframe; ...
Read more

The canvas has been tainted by cross-origin data in chrome only -

-
uncaught securityerror: failed execute 'getimagedata' on 'canvasrenderingcontext2d': canvas has been tainted cross-origin data i getting above error in chrome. code(following) works fine in mozilla. have not corss domain issue. why above error in chrome? var wheel_canvas, wheel_context, can_w, can_h, wheel_grd; var large_radius = 160; var small_radius = 120; var wheel_canvas = document.getelementbyid('wheel_canvas'); var wheel_context = wheel_canvas.getcontext('2d'); var can_w = $(wheel_canvas).width(); var can_h = $(wheel_canvas).height(); var centerx = can_w / 2, centery = can_h / 2; var wheel_grd = null; test('#ff0000'); function test(hex) { $('#clrpicker').css({'left': 210, 'top': 210 }); inverted = hexbw(hex); $('#color_val_show').val(hex); current_color_hex_val_selected = hex; $('#color_val_show').css({'color':inverted,'background':hex}); fillgradient...
Read more