The problem is that if you go here https://wordstat.yandex.ru/#!/?words=%D0%BF%D0%BE%D0%B3%D0%BE%D0%B4%D0%B0 BF% D0 https://wordstat.yandex.ru/#!/?words=%D0%BF%D0%BE%D0%B3%D0%BE%D0%B4%D0%B0 BE% D0 https://wordstat.yandex.ru/#!/?words=%D0%BF%D0%BE%D0%B3%D0%BE%D0%B4%D0%B0 B3% D0 https://wordstat.yandex.ru/#!/?words=%D0%BF%D0%BE%D0%B3%D0%BE%D0%B4%D0%B0 BE% D0 https://wordstat.yandex.ru/#!/?words=%D0%BF%D0%BE%D0%B3%D0%BE%D0%B4%D0%B0 B4% D0 https://wordstat.yandex.ru/#!/?words=%D0%BF%D0%BE%D0%B3%D0%BE%D0%B4%D0%B0 B0 a list will appear keywords, I want to collect them, the problem is that they are not in the source code of the page, you can find them if you right-click on the word and select "Explore element"

How to implement it in Delphi? Through a simple idhttp.Get(url); will give the usual source code html document in which there will be no key phrases.

I tried to send a POST request and in the received response I received two JSON parameters encrypted data and some kind of key function

data hX8L^^\u0002@[ZUN\\r[\\A\\6V\…01eQ\\\u000cZ)^\u0013VF|Io\""

key "var f980 = function(v342){var…).reverse().join(''));f980()"

    1 answer 1

    Obviously, the html-a part of the page is created / loaded by javascript. Use the TWebBrowser component.

    • There is no experience with TWebBrowser , I tried to load a page a couple of times in TWebBrowser received a bunch of errors from TWebBrowser itself that the saying "does not support the java element" (alerts from the compiled application came out, but the page was loaded, albeit crooked) as it were, that is, the chronium component a and perhaps If I get the source code of TWebBrowser it not be there the same if I request the source code of the page in the same Firefox browser? Maybe here it is necessary through the DOM to pull out key phrases, in this I also have no experience ... - lib
    • one
      By default, TWebBrowser (on Windows, this is the usual InternetExplorer) works in compatibility mode with IE7, therefore, it also alerts. How to change this is described in msdn.microsoft.com/en-us/library/… . Chromium can be used, it is a component of dcef3 (use Google). The browser (any) is different from the usual get-request, because it processes scripts that can create additional content or load it with created requests. - kami