I am taking data from the site through curl, but the site in 8 out of 10 requests gives me content for bots. How to use php curl as a simple user? thank

  • one
    Take the browser engine. Hang it with scripts of behavior. Get the result. - Visman
  • one
    pauses between requests do not try? - teran
  • 2
    do you use proxy? headers change User-Agent? - Ordman
  • one
    @ J.Doe buy a proxy and you will be happy. Maybe)) - Ordman
  • one
    @Visman, we tried to parse it on the auto Iehoy. It is a pain. - Ordman

1 answer 1

no way. Use all sorts of headless browsers, Kurl does not support the imitation of the user, he only sends a request and receives a response.

If you know a little about js and worked with node.js, that is, casperjs / phantomjs, everything is pretty simple.