Hello :)

Such a question has arisen. There is an HTML page that runs javascript. The script every 5 seconds changes the values ​​of variables in the plate. It is necessary to read the values ​​of the variables that appear. I tried to just parse the page with a GET request, but instead of the variable values ​​I got the name of the javascript variable. Actually, how to solve this issue? Tried to find something on the Internet, but really did not find anything.

If you are interested in specifics, you need to receive real-time data from this page http://warehouse.funcube.org.uk/realtime.html (I know that there is a .csv file, but there is not all the data).

Thank you in advance!

  • I haven't tried it, but you can look towards Selenium scraping.pro/… - Serginio

1 answer 1

Judging by the source code, every 5 seconds there is an appeal to the URL http://warehouse.funcube.org.uk/ui/realtime/2.json , from where the values ​​are substituted into the table. It will be enough for you to execute a query to this resource and parse JSON.

  • Oh, and in truth. Thanks :) - Marty Foxy
  • In general, if the content of the page depends on the execution of javascript, you need to use something like PhantomJS. - kmv