java - Cassandra Insertion/ write failed -

-

i have installed cassandra 2.0 on centos6.5 server , and while testing simple records working fine, have upload 600 billion rows, when use copy on cqlsh failed after 5 minutes , approx rows inserted 0.2 million rpc timeout, opted pycasso , parsed csv , tried import using inserts commands, after every 10k records, opted close connection , develop new connection again. after around 60k records failed with timeout.

my debug trace shows while server not accepting inserts, without activity it's still busy.

debug [optionaltasks:1] 2014-05-30 04:34:16,305 meteredflusher.java (line 41) flushing 269227480 bytes of 2047868928 max debug [optionaltasks:1] 2014-05-30 04:34:17,306 meteredflusher.java (line 41) flushing 269227480 bytes of 2047868928 max debug [optionaltasks:1] 2014-05-30 04:34:18,306 meteredflusher.java (line 41) flushing 269227480 bytes of 2047868928 max debug [optionaltasks:1] 2014-05-30 04:34:19,012 columnfamilystore.java (line 298) retrypolicy schema_triggers 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,012 columnfamilystore.java (line 298) retrypolicy compaction_history 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,012 columnfamilystore.java (line 298) retrypolicy batchlog 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,012 columnfamilystore.java (line 298) retrypolicy sstable_activity 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,012 columnfamilystore.java (line 298) retrypolicy peer_events 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,012 columnfamilystore.java (line 298) retrypolicy compactions_in_progress 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,013 columnfamilystore.java (line 298) retrypolicy hints 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,013 columnfamilystore.java (line 298) retrypolicy schema_keyspaces 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,013 columnfamilystore.java (line 298) retrypolicy range_xfers 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,013 columnfamilystore.java (line 298) retrypolicy schema_columnfamilies 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,013 columnfamilystore.java (line 298) retrypolicy nodeidinfo 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,013 columnfamilystore.java (line 298) retrypolicy paxos 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,013 columnfamilystore.java (line 298) retrypolicy schema_columns 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,014 columnfamilystore.java (line 298) retrypolicy indexinfo 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,014 columnfamilystore.java (line 298) retrypolicy peers 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,014 columnfamilystore.java (line 298) retrypolicy local 0.99 debug [optionaltasks:1] 2014-05-30 04:34:19,307 meteredflusher.java (line 41) flushing 269227480 bytes of 2047868928 max debug [optionaltasks:1] 2014-05-30 04:34:20,307 meteredflusher.java (line 41) flushing 269227480 bytes of 2047868928 max debug [optionaltasks:1] 2014-05-30 04:34:20,716 columnfamilystore.java (line 298) retrypolicy backup_calls 0.99 debug [optionaltasks:1] 2014-05-30 04:34:20,716 columnfamilystore.java (line 298) retrypolicy sessions 0.99 debug [optionaltasks:1] 2014-05-30 04:34:20,716 columnfamilystore.java (line 298) retrypolicy events 0.99 debug [optionaltasks:1] 2014-05-30 04:34:21,308 meteredflusher.java (line 41) flushing 269

while when try insert records show error in debug log.

debug [optionaltasks:1] 2014-05-30 04:34:40,717 columnfamilystore.java (line 298) retrypolicy backup_calls 0.99 debug [optionaltasks:1] 2014-05-30 04:34:40,717 columnfamilystore.java (line 298) retrypolicy sessions 0.99 debug [optionaltasks:1] 2014-05-30 04:34:40,718 columnfamilystore.java (line 298) retrypolicy events 0.99 debug [thrift:24] 2014-05-30 04:34:40,775 customtthreadpoolserver.java (line 211) thrift transport error occurred during processing of message. org.apache.thrift.transport.ttransportexception     @ org.apache.thrift.transport.tiostreamtransport.read(tiostreamtransport.java:132)     @ org.apache.thrift.transport.ttransport.readall(ttransport.java:84)     @ org.apache.thrift.transport.tframedtransport.readframe(tframedtransport.java:129)     @ org.apache.thrift.transport.tframedtransport.read(tframedtransport.java:101)     @ org.apache.thrift.transport.ttransport.readall(ttransport.java:84)     @ org.apache.thrift.protocol.tbinaryprotocol.readall(tbinaryprotocol.java:362)     @ org.apache.thrift.protocol.tbinaryprotocol.readi32(tbinaryprotocol.java:284)     @ org.apache.thrift.protocol.tbinaryprotocol.readmessagebegin(tbinaryprotocol.java:191)     @ org.apache.thrift.tbaseprocessor.process(tbaseprocessor.java:27)     @ org.apache.cassandra.thrift.customtthreadpoolserver$workerprocess.run(customtthreadpoolserver.java:201)     @ java.util.concurrent.threadpoolexecutor.runworker(unknown source)     @ java.util.concurrent.threadpoolexecutor$worker.run(unknown source)     @ java.lang.thread.run(unknown source) debug [thrift:19] 2014-05-30 04:34:40,775 customtthreadpoolserver.java (line 211) thrift transport error occurred during processing of message. org.apache.thrift.transport.ttransportexception     @ org.apache.thrift.transport.tiostreamtransport.read(tiostreamtransport.java:132)     @ org.apache.thrift.transport.ttransport.readall(ttransport.java:84)     @ org.apache.thrift.transport.tframedtransport.readframe(tframedtransport.java:129)     @ org.apache.thrift.transport.tframedtransport.read(tframedtransport.java:101)     @ org.apache.thrift.transport.ttransport.readall(ttransport.java:84)     @ org.apache.thrift.protocol.tbinaryprotocol.readall(tbinaryprotocol.java:362)     @ org.apache.thrift.protocol.tbinaryprotocol.readi32(tbinaryprotocol.java:284)     @ org.apache.thrift.protocol.tbinaryprotocol.readmessagebegin(tbinaryprotocol.java:191)     @ org.apache.thrift.tbaseprocessor.process(tbaseprocessor.java:27)     @ org.apache.cassandra.thrift.customtthreadpoolserver$workerprocess.run(customtthreadpoolserver.java:201)     @ java.util.concurrent.threadpoolexecutor.runworker(unknown source)     @ java.util.concurrent.threadpoolexecutor$worker.run(unknown source)     @ java.lang.thread.run(unknown source) debug [thrift:21] 2014-05-30 04:34:40,775 customtthreadpoolserver.java (line 211) thrift transport error occurred during processing of message. org.apache.thrift.transport.ttransportexception     @ org.apache.thrift.transport.tiostreamtransport.read(tiostreamtransport.java:132)     @ org.apache.thrift.transport.ttransport.readall(ttransport.java:84)     @ org.apache.thrift.transport.tframedtransport.readframe(tframedtransport.java:129)     @ org.apache.thrift.transport.tframedtransport.read(tframedtransport.java:101)     @ org.apache.thrift.transport.ttransport.readall(ttransport.java:84)     @ org.apache.thrift.protocol.tbinaryprotocol.readall(tbinaryprotocol.java:362)     @ org.apache.thrift.protocol.tbinaryprotocol.readi32(tbinaryprotocol.java:284)     @ org.apache.thrift.protocol.tbinaryprotocol.readmessagebegin(tbinaryprotocol.java:191)     @ org.apache.thrift.tbaseprocessor.process(tbaseprocessor.java:27)     @ org.apache.cassandra.thrift.customtthreadpoolserver$workerprocess.run(customtthreadpoolserver.java:201)     @ java.util.concurrent.threadpoolexecutor.runworker(unknown source)     @ java.util.concurrent.threadpoolexecutor$worker.run(unknown source)     @ java.lang.thread.run(unknown source) debug [thrift:1] 2014-05-30 04:34:40,775 customtthreadpoolserver.java (line 211) thrift transport error occurred during processing of message. org.apache.thrift.transport.ttransportexception     @ org.apache.thrift.transport.tiostreamtransport.read(tiostreamtransport.java:132)     @ org.apache.thrift.transport.ttransport.readall(ttransport.java:84)     @ org.apache.thrift.transport.tframedtransport.readframe(tframedtransport.java:129)     @ org.apache.thrift.transport.tframedtransport.read(tframedtransport.java:101)     @ org.apache.thrift.transport.ttransport.readall(ttransport.java:84)     @ org.apache.thrift.protocol.tbinaryprotocol.readall(tbinaryprotocol.java:362)     @ org.apache.thrift.protocol.tbinaryprotocol.readi32(tbinaryprotocol.java:284)     @ org.apache.thrift.protocol.tbinaryprotocol.readmessagebegin(tbinaryprotocol.java:191)     @ org.apache.thrift.tbaseprocessor.process(tbaseprocessor.java:27)     @ org.apache.cassandra.thrift.customtthreadpoolserver$workerprocess.run(customtthreadpoolserver.java:201)     @ java.util.concurrent.threadpoolexecutor.runworker(unknown source)     @ java.util.concurrent.threadpoolexecutor$worker.run(unknown source)     @ java.lang.thread.run(unknown source) debug [thrift:21] 2014-05-30 04:34:40,789 cassandraserver.java (line 949) batch_mutate debug [thrift:19] 2014-05-30 04:34:41,314 cassandraserver.java (line 949) batch_mutate debug [optionaltasks:1] 2014-05-30 04:34:41,317 meteredflusher.java (line 41) flushing 269227480 bytes of 2047868928 max debug [thrift:24] 2014-05-30 04:34:41,858 cassandraserver.java (line 949) batch_mutate

any idea happening?, after insertion failed not work until server restarted.

node details:

there single node , details given below,

# nodetool describecluster cluster information:     name: test cluster     snitch: org.apache.cassandra.locator.dynamicendpointsnitch     partitioner: org.apache.cassandra.dht.murmur3partitioner     schema versions:         93403140-5bd6-3cfa-9973-b18df44227f9: [127.0.0.1]

my node , running?

# nodetool status note: ownership information not include topology; complete information, specify keyspace datacenter: datacenter1 ======================= status=up/down |/ state=normal/leaving/joining/moving --  address    load       owns   host id                               token                                    rack un  127.0.0.1  35.05 mb   100.0%  6bc340b2-4534-400f-b23d-9fe3ed0c6971  -9120530846114649324                     rack1

server details:

os centos release 6.5 (final)  hdd 8tb ssd drives  ram 32gb  proccessor: model name : intel(r) xeon(r) cpu e5-2620 v2 @ 2.10ghz, 24 core(2 physical

processors 12 cores each)


Comments

Post a Comment

Popular posts from this blog

c++ - OpenCV Error: Assertion failed <scn == 3 ::scn == 4> in unknown function, -

-
i read alot other solution still confused should mine... #include <opencv2/objdetect/objdetect.hpp> #include <opencv2/highgui/highgui.hpp> #include <opencv2/imgproc/imgproc.hpp> #include <iostream> #include <stdio.h> using namespace std; using namespace cv; int main(int argc, const char** argv) { //create cascade classifier object used face detection cascadeclassifier face_cascade; //use haarcascade_frontalface_alt.xml library face_cascade.load("haarcascade_frontalface_alt.xml"); //setup video capture device , link first capture device videocapture capturedevice; capturedevice.open(0); //setup image files used in capture process mat captureframe; mat grayscaleframe; //create window present results namedwindow("outputcapture", 1); //create loop capture , find faces while (true) { //capture new image frame capturedevice >> captureframe; ...
Read more

php - render data via PDO::FETCH_FUNC vs loop -

-
i've been using 2 methods render data. the first one: function name($id,$name){ return '<div id="'.$id.'">'.$name.'</div>'; } echo implode($pdo->query("select id,name user")->fetchall(pdo::fetch_func,'name')); the second one: $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); foreach($users $user){ echo name($user->id,$user->name); } i don't understand how pdo::fetch_func works. tried figure out. however, not well-documented. could please explain fetch mode? , also, 1 performs better? thank you. both methods wrong , have learn how use templates , how separate business logic presentation logic. $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); tpl::assign('users', $users); is code business logic part. then in template <?php foreach $users $row): ?> <div id="<?=$...
Read more

The canvas has been tainted by cross-origin data in chrome only -

-
uncaught securityerror: failed execute 'getimagedata' on 'canvasrenderingcontext2d': canvas has been tainted cross-origin data i getting above error in chrome. code(following) works fine in mozilla. have not corss domain issue. why above error in chrome? var wheel_canvas, wheel_context, can_w, can_h, wheel_grd; var large_radius = 160; var small_radius = 120; var wheel_canvas = document.getelementbyid('wheel_canvas'); var wheel_context = wheel_canvas.getcontext('2d'); var can_w = $(wheel_canvas).width(); var can_h = $(wheel_canvas).height(); var centerx = can_w / 2, centery = can_h / 2; var wheel_grd = null; test('#ff0000'); function test(hex) { $('#clrpicker').css({'left': 210, 'top': 210 }); inverted = hexbw(hex); $('#color_val_show').val(hex); current_color_hex_val_selected = hex; $('#color_val_show').css({'color':inverted,'background':hex}); fillgradient...
Read more