javascript - How to fetch data from ajax.inc.php page, using node modules? -

-

i use node.js , want http://myanimelist.net/includes/ajax.inc.php?t=64&id=1 page , fetch data need. wasn't able make cheerio, because i've never encounter such kind of pages before. i'll glad if tell me how parse such pages , node module use since wasn't able figure out google, understand should easy , i'm asking silly question.

here, simple extracted output html output via code.

{    "description": "in year 2071, humanity has colonized several of planets , moons of solar system leaving uninhabitable surface of planet earth behind. inter solar system police attempts ke...",    "genres": "action, adventure, comedy, drama, sci-fi, space",    "status": "finished airing",    "type": "tv",    "episodes": "26",    "score": "8.83",    "ranked": "#22",    "popularity": "#31",    "members": "419,197" }

below code extracts info page , saves in object (key:value) pair (i.e., above);

var $body = $('body');  $('div').children().empty(); var description = $('div').text().trim(); var keys = $('body span').text().split(':'); keys.splice(-1, 1); $body.children().empty(); var values = $body.text().trim().split('\n');  var result = {     description: description };  for(var j = 0; j<keys.length; j++) {     result[(keys[j].tolowercase().trim())] = (values[j].trim()); }  console.log('result', result);

to test above code need open http://myanimelist.net/includes/ajax.inc.php?t=64&id=1 , paste above script in dev tools inspector -> console. when run code throw result because jquery isn't found page manually add jquery scripts via link: https://stackoverflow.com/a/7474394/5228251

you need use ^code using cheerio parse page.

updated

use request , cheerio npm modules;

installing modules;

$ npm install request --save $ npm install cheerio --save

using script;

var cheerio = require('cheerio'),     request = require('request');  function scrapepage(callback) {     var result = null;     var url = 'http://myanimelist.net/includes/ajax.inc.php?t=64&id=1';      request(url, function (error, response, body) {         if (!error && response.statuscode == 200) {             // console.log(body) // show html page url.              var $ = cheerio.load('<body>' + body + '</body>');             var $body = $('body');              $('body div').children().empty();             var description = $('body div').text().trim();             var keys = $('body span').text().split(':');             keys.splice(-1, 1);             $body.children().empty();             var values = $body.text().trim().split('\n');              result = {                 description: description             };              for(var j = 0; j<keys.length; j++) {                 result[(keys[j].tolowercase().trim())] = (values[j].trim());             }         }          callback(result);     }); }

usage:

scrapepage(function(result) {     console.log('result', result); });

hope helps.


Comments

Post a Comment

Popular posts from this blog

ios - RestKit 0.20 — CoreData: error: Failed to call designated initializer on NSManagedObject class (again) -

-
this error has shown on many times, seems. prominent answer issue seems restkit 0.20 — coredata: error: failed call designated initializer on nsmanagedobject class however, solution posted doesn't work me. let's start beginning: i want upload file server. want parse response make sure uploaded. if not, try again later. model has boolean variable called nsnumber *senttoserver purpose (in coredata, bool saved nsnumber ) . because don't know whether sending going successful, save entity coredata model first before sending via restkit. when post request successful, server returns json string this: {"id":14,"created":true} notice that, of course, id not set on coredata model yet, both id , created new informations model. here's model: @interface recording : nsmanagedobject @property (nonatomic, retain) nsstring * audiofilepath; @property (nonatomic, retain) nsdate * createdat; @property (nonatomic, retain) nsstring * deviceid; @...
Read more

java - Digest auth with Spring Security using javaconfig -

-
so i'm trying create digest authentication spring following documentation trying translate xml "requirements" in java requirements. let's have xml in docs: <bean id="digestfilter" class= "org.springframework.security.web.authentication.www.digestauthenticationfilter"> <property name="userdetailsservice" ref="jdbcdaoimpl"/> <property name="authenticationentrypoint" ref="digestentrypoint"/> <property name="usercache" ref="usercache"/> </bean> <bean id="digestentrypoint" class= "org.springframework.security.web.authentication.www.digestauthenticationentrypoint"> <property name="realmname" value="contacts realm via digest authentication"/> <property name="key" value="acegi"/> <property name="noncevalidityseconds" value="10"/> </b...
Read more

laravel - PDOException in Connector.php line 55: SQLSTATE[HY000] [1045] Access denied for user 'root'@'localhost' (using password: YES) -

-
my .env: app_env=local app_debug=true app_key=myappkey app_url=http://localhost db_connection=mysql db_host=localhost db_port=3306 db_database=gestiontaller db_username=root db_password='root' cache_driver=file session_driver=file queue_driver=sync redis_host=127.0.0.1 redis_password=null redis_port=6379 mail_driver=smtp mail_host=mailtrap.io mail_port=2525 mail_username=null mail_password=null mail_encryption=null i've tried password ", ' , without, restarting server every time. i've tried changing localhost 172.0.0.1. yes, password correct, running mysql -u root -p introducing password root in prompt can go mysql. users table: +------------------+-----------+ | user | host | +------------------+-----------+ | debian-sys-maint | localhost | | mysql.sys | localhost | | root | localhost | | root1 | localhost | +------------------+-----------+ i've added homestead.yaml this: database_port: 3306 ...
Read more