html - nokogiri screen scrape css selector issue -

-

i'm trying css working on rake task.

namespace :task   task test: :environment     ticketmaster_url = "http://www.ticketmaster.co.uk/derren-brown-miracle-glasgow-04-07-2016/event/370050789149169e?artistid=1408737&majorcatid=10002&minorcatid=53&tpab=-1"     doc = nokogiri::html(open(ticketmaster_url))     #psec-p label      doc.css("#psec-p").each |price|       puts price.at_css("#psec-p")       byebug     end   end end

however i'm returning this:

#<nokogiri::xml::element:0x3fd226469e60 name="fieldset" attributes=[#<nokogiri::xml::attr:0x3fd2281c953c name="class" value="group-price widget-group">, #<nokogiri::xml::attr:0x3fd2281c9528 name="id" value="psec-p">] children=[#<nokogiri::xml::text:0x3fd2281c8d44 "\n            ">, #<nokogiri::xml::element:0x3fd2281c8c7c name="legend" attributes=[#<nokogiri::xml::attr:0x3fd2281c8c18 name="id" value="psec-p-legend">] children=[#<nokogiri::xml::text:0x3fd2281c8614 "price:">]>, #<nokogiri::xml::text:0x3fd2281c8448 "\n          ">]>

i'm guessing selected wrong element have chosen psec-p

could let me know i'm going wrong?

i've been following railscast 190

the prices on http://www.ticketmaster.co.uk applied html dynamically, via javascript. partially done hinder scraping efforts. cannot use nokogiri scrape type of content domain, nokogiri processes raw html/xml, , not execute javascript in process. other tools exist this, require entirely different approach.

for learning purposes, should choose less dynamic site. instance, http://www.wallacesuk.com has nice, parseable site. learn basic web scraping techniques site presents information inline page, such this.

scraping http://ticketmaster.co.uk require advanced scraping techniques, beyond railscast 190 demonstrating.


Comments

Post a Comment

Popular posts from this blog

ios - RestKit 0.20 — CoreData: error: Failed to call designated initializer on NSManagedObject class (again) -

-
this error has shown on many times, seems. prominent answer issue seems restkit 0.20 — coredata: error: failed call designated initializer on nsmanagedobject class however, solution posted doesn't work me. let's start beginning: i want upload file server. want parse response make sure uploaded. if not, try again later. model has boolean variable called nsnumber *senttoserver purpose (in coredata, bool saved nsnumber ) . because don't know whether sending going successful, save entity coredata model first before sending via restkit. when post request successful, server returns json string this: {"id":14,"created":true} notice that, of course, id not set on coredata model yet, both id , created new informations model. here's model: @interface recording : nsmanagedobject @property (nonatomic, retain) nsstring * audiofilepath; @property (nonatomic, retain) nsdate * createdat; @property (nonatomic, retain) nsstring * deviceid; @
Read more

java - Digest auth with Spring Security using javaconfig -

-
so i'm trying create digest authentication spring following documentation trying translate xml "requirements" in java requirements. let's have xml in docs: <bean id="digestfilter" class= "org.springframework.security.web.authentication.www.digestauthenticationfilter"> <property name="userdetailsservice" ref="jdbcdaoimpl"/> <property name="authenticationentrypoint" ref="digestentrypoint"/> <property name="usercache" ref="usercache"/> </bean> <bean id="digestentrypoint" class= "org.springframework.security.web.authentication.www.digestauthenticationentrypoint"> <property name="realmname" value="contacts realm via digest authentication"/> <property name="key" value="acegi"/> <property name="noncevalidityseconds" value="10"/> </b
Read more

laravel - PDOException in Connector.php line 55: SQLSTATE[HY000] [1045] Access denied for user 'root'@'localhost' (using password: YES) -

-
my .env: app_env=local app_debug=true app_key=myappkey app_url=http://localhost db_connection=mysql db_host=localhost db_port=3306 db_database=gestiontaller db_username=root db_password='root' cache_driver=file session_driver=file queue_driver=sync redis_host=127.0.0.1 redis_password=null redis_port=6379 mail_driver=smtp mail_host=mailtrap.io mail_port=2525 mail_username=null mail_password=null mail_encryption=null i've tried password ", ' , without, restarting server every time. i've tried changing localhost 172.0.0.1. yes, password correct, running mysql -u root -p introducing password root in prompt can go mysql. users table: +------------------+-----------+ | user | host | +------------------+-----------+ | debian-sys-maint | localhost | | mysql.sys | localhost | | root | localhost | | root1 | localhost | +------------------+-----------+ i've added homestead.yaml this: database_port: 3306
Read more