I am writing a parser of events on Facebook. The fact is that only 10 events are loaded, the rest are loaded as the page scrolls. How can I get all the events? For parsing I use HtmlAgilityPack, for clicks and cookies - SimpleBrowser

  • 2
    Каким образом можно получить все - work with the server, and not with the interface ... - EvgeniyZ
  • as mentioned earlier, find api, or search in a heap of text (and I thought there were a lot of superfluous pages on me), so you need to find out what causes the update. - Monomax
  • one
    @mtrfnv See ... Sites are divided into 2 types. 1 - those that have static information that is loaded at the time of loading the page, this is simple HTML text, yes there, you have to work with it directly. 2 - these are sites that use dynamic data loading (that is, you get an empty HTML layout and with the help of JS you load information from the server into this layout then (once, by time, or by condition (end of page for example)). So here’s the second The type always works on the client-server principle, that is, a request is sent to the server, which in turn sends the data - EvgeniyZ
  • one
    The request itself may be hidden, purely for the operation of the site, but it always is. You just need to catch this request, see what data it sends and where and emulate it. In response, you will get handy JSON / XML or analogues. As for the "software scrolling" - with the second type of sites, as for me it is simply a perversion and crutches .. - EvgeniyZ
  • one
    You can take a look at this answer, I wrote about it in detail there. And so, open the page you need in the browser, then F12 - Nerwork, turn it down and as soon as new content appears - look for it in the open developer panel, there should be only 1 request (well, there can be all sorts of pictures) that you need. - EvgeniyZ pm

0