Scraping .php websites -

-

i'v been having trouble scraping following website content: http://www.qe.com.qa/wp/mw/marketwatch.php

using file_get_contents() never gets me right tag. scrape content of following tag: td aria-describedby="grid_offerprice"

is website protected scraping? because when try same method diffrent websites works. if yes, work around ?

the way see if scraping works output file_get_contents returns. if have nothing or error maybe ip has been restricted admin.

if returns source code it's working maybe tag you're looking has not been found. eliminate failures in process answering these questions first, 1 @ time.

i viewed source code , aria attribute searching doesn't appear exist.

it seems load data on page source @ this page (http://www.qe.com.qa/wp/mw/bg/readdata.php?types=selected&itype=so&dummy=1401401577192&_search=false&nd=1401401577279&rows=100&page=1&sidx=&sord=asc)

if want data page use file_get_contents on directly.

the data page in online json editor gives neat way of seeing whether useful solution you.

a sample of data listed below:

{   "total": "140",   "page": "1",   "records": "140",   "rows": [     {       "topic": "qnbk/nm",       "symbol": "qnbk",       "companyen": "qnb",       "companyar": "qnb",       "trend": "-",       "stateen": "tradeable",       "statear": "المتداوله",       "caten": "listed companies",       "catar": "الشركات المدرجة",       "sectoren": "banks & financial services",       "sectorar": "البنوك والخدمات المالية",       "shariahen": "n/a",       "shariahar": "n/a",       "offervolume": "7503",       "offerprice": "184.00",       "bidprice": "182.00",       "bidvolume": "15807",       "openprice": "190.0",       "high": "191.7",       "low": "181.0",       "imp": "182.0",       "lastprice": "182.0",       "prevclosing": "187.0",       "change": "-5.0",       "percentchange": "-2.6737",       "trades": "980",       "volume": "2588830",       "w52high": "199.0",       "w52low": "145.0",       "value": "481813446.4"     },     {       "topic": "qibk/nm",       "symbol": "qibk",       "companyen": "qatar islamic bank",       "companyar": "المصرف ",       "trend": "+",       "stateen": ...

make sure read link about 'scraping' etiquette.


Comments

Post a Comment

Popular posts from this blog

php - render data via PDO::FETCH_FUNC vs loop -

-
i've been using 2 methods render data. the first one: function name($id,$name){ return '<div id="'.$id.'">'.$name.'</div>'; } echo implode($pdo->query("select id,name user")->fetchall(pdo::fetch_func,'name')); the second one: $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); foreach($users $user){ echo name($user->id,$user->name); } i don't understand how pdo::fetch_func works. tried figure out. however, not well-documented. could please explain fetch mode? , also, 1 performs better? thank you. both methods wrong , have learn how use templates , how separate business logic presentation logic. $users = $pdo->query("select id,name user")->fetchall(pdo::fetch_obj); tpl::assign('users', $users); is code business logic part. then in template <?php foreach $users $row): ?> <div id="<?=$...
Read more

c++ - OpenCV Error: Assertion failed <scn == 3 ::scn == 4> in unknown function, -

-
i read alot other solution still confused should mine... #include <opencv2/objdetect/objdetect.hpp> #include <opencv2/highgui/highgui.hpp> #include <opencv2/imgproc/imgproc.hpp> #include <iostream> #include <stdio.h> using namespace std; using namespace cv; int main(int argc, const char** argv) { //create cascade classifier object used face detection cascadeclassifier face_cascade; //use haarcascade_frontalface_alt.xml library face_cascade.load("haarcascade_frontalface_alt.xml"); //setup video capture device , link first capture device videocapture capturedevice; capturedevice.open(0); //setup image files used in capture process mat captureframe; mat grayscaleframe; //create window present results namedwindow("outputcapture", 1); //create loop capture , find faces while (true) { //capture new image frame capturedevice >> captureframe; ...
Read more

The canvas has been tainted by cross-origin data in chrome only -

-
uncaught securityerror: failed execute 'getimagedata' on 'canvasrenderingcontext2d': canvas has been tainted cross-origin data i getting above error in chrome. code(following) works fine in mozilla. have not corss domain issue. why above error in chrome? var wheel_canvas, wheel_context, can_w, can_h, wheel_grd; var large_radius = 160; var small_radius = 120; var wheel_canvas = document.getelementbyid('wheel_canvas'); var wheel_context = wheel_canvas.getcontext('2d'); var can_w = $(wheel_canvas).width(); var can_h = $(wheel_canvas).height(); var centerx = can_w / 2, centery = can_h / 2; var wheel_grd = null; test('#ff0000'); function test(hex) { $('#clrpicker').css({'left': 210, 'top': 210 }); inverted = hexbw(hex); $('#color_val_show').val(hex); current_color_hex_val_selected = hex; $('#color_val_show').css({'color':inverted,'background':hex}); fillgradient...
Read more