python 2.7 - NLTK - How to use NER -

-

how can invoke ner nltk of results on first 2 hundred characters of each of txt files located in same directory?

when try code:

for filename in os.listdir(ebooksfolder):     fname, fextension = os.path.splitext(filename)         if (fextension == '.txt'):             newname = 'ner_' + filename             file = open(ebooksfolder + '\\' + filename)             rawfile = file.read()             parttouse = rawfile[:50]             segmentedsentences = nltk.sent_tokenize(parttouse)             tokenizedsentences = [nltk.word_tokenize(sent) sent in segmentedsentences]             postaggedsentences = [nltk.pos_tag(sent) sent in tokenizedsentences]             nerresult = nltk.ne_chunk(postaggedsentences)             pathtocopy = 'c:\\users\\felipe\\desktop\\books_txt\\'             nametosave = os.path.join(pathtocopy, newname + '.txt')             newfile = open(nametosave, 'w')             newfile.write(nerresult)             newfile.close()

i these errors:

traceback (most recent call last):   file "<pyshell#77>", line 11, in <module>     nerresult = nltk.ne_chunk(postaggedsentences)   file "c:\python27\lib\site-packages\nltk\chunk\__init__.py", line 177, in ne_chunk     return chunker.parse(tagged_tokens)   file "c:\python27\lib\site-packages\nltk\chunk\named_entity.py", line 116, in parse     tagged = self._tagger.tag(tokens)   file "c:\python27\lib\site-packages\nltk\tag\sequential.py", line 58, in tag     tags.append(self.tag_one(tokens, i, tags))   file "c:\python27\lib\site-packages\nltk\tag\sequential.py", line 78, in tag_one     tag = tagger.choose_tag(tokens, index, history)   file "c:\python27\lib\site-packages\nltk\tag\sequential.py", line 554, in choose_tag     featureset = self.feature_detector(tokens, index, history)   file "c:\python27\lib\site-packages\nltk\tag\sequential.py", line 605, in feature_detector     return self._feature_detector(tokens, index, history)   file "c:\python27\lib\site-packages\nltk\chunk\named_entity.py", line 49, in _feature_detector     pos = simplify_pos(tokens[index][1])   file "c:\python27\lib\site-packages\nltk\chunk\named_entity.py", line 178, in simplify_pos     if s.startswith('v'): return "v" attributeerror: 'tuple' object has no attribute 'startswith'

having tokenized text sentences , pos tags, need iterate on list of tagged sentences so:

nerresult = [nltk.ne_chunk(pts) pts in postaggedsentences]

instead of so:

nerresult = nltk.ne_chunk(postaggedsentences)

Comments

Post a Comment

Popular posts from this blog

php - render data via PDO::FETCH_FUNC vs loop -

-
i've been using 2 methods render data. the first one: function name($id,$name){ return '<div id="'.$id.'">'.$name.'</div>'; } echo implode($pdo->query("select id,name user")->fetchall(pdo::fetch_func,'name')); the second one: $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); foreach($users $user){ echo name($user->id,$user->name); } i don't understand how pdo::fetch_func works. tried figure out. however, not well-documented. could please explain fetch mode? , also, 1 performs better? thank you. both methods wrong , have learn how use templates , how separate business logic presentation logic. $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); tpl::assign('users', $users); is code business logic part. then in template <?php foreach $users $row): ?> <div id="<?=$...
Read more

c++ - OpenCV Error: Assertion failed <scn == 3 ::scn == 4> in unknown function, -

-
i read alot other solution still confused should mine... #include <opencv2/objdetect/objdetect.hpp> #include <opencv2/highgui/highgui.hpp> #include <opencv2/imgproc/imgproc.hpp> #include <iostream> #include <stdio.h> using namespace std; using namespace cv; int main(int argc, const char** argv) { //create cascade classifier object used face detection cascadeclassifier face_cascade; //use haarcascade_frontalface_alt.xml library face_cascade.load("haarcascade_frontalface_alt.xml"); //setup video capture device , link first capture device videocapture capturedevice; capturedevice.open(0); //setup image files used in capture process mat captureframe; mat grayscaleframe; //create window present results namedwindow("outputcapture", 1); //create loop capture , find faces while (true) { //capture new image frame capturedevice >> captureframe; ...
Read more

The canvas has been tainted by cross-origin data in chrome only -

-
uncaught securityerror: failed execute 'getimagedata' on 'canvasrenderingcontext2d': canvas has been tainted cross-origin data i getting above error in chrome. code(following) works fine in mozilla. have not corss domain issue. why above error in chrome? var wheel_canvas, wheel_context, can_w, can_h, wheel_grd; var large_radius = 160; var small_radius = 120; var wheel_canvas = document.getelementbyid('wheel_canvas'); var wheel_context = wheel_canvas.getcontext('2d'); var can_w = $(wheel_canvas).width(); var can_h = $(wheel_canvas).height(); var centerx = can_w / 2, centery = can_h / 2; var wheel_grd = null; test('#ff0000'); function test(hex) { $('#clrpicker').css({'left': 210, 'top': 210 }); inverted = hexbw(hex); $('#color_val_show').val(hex); current_color_hex_val_selected = hex; $('#color_val_show').css({'color':inverted,'background':hex}); fillgradient...
Read more