Every 5min to 1-3 thousand requests with POST data (not heavy). php curl / curl-multi is missing.
- Describe the task in more detail ... perhaps you can not send these 1000-3000 requests but form a data packet and send it all together? .. - Lesiuk Alexey
- It is necessary to send separate requests. It is impossible to fix the software of all clients (recipients) for forming packages Curl_multi has a bottleneck in the number of streams, there is practically no difference between 30 and 800. So far it only comes to mind to write a C # daemon that will receive the entire array of requests at once and send it to as many as 1000 threads. - Maxim
- why did you need to send post requests so often? ..... i.e. what is the essence of the problem? ... describe in more detail) - Lesiuk Alexey
|
1 answer
use - AngryCurl https://github.com/2naive/AngryCurl
having on hand a list of proxy servers and browser identifiers (useragent), on the fly you can switch + the following buns:
- multithreading
- loading proxy-list from file / array
- remove duplicate proxy servers
- proxy health check
- Proxy Content Validation
- loading useragent-list from file / array
- substitution of proxy / useragent on the fly
- preventing the establishment of direct connections without the use of a proxy / useragent, when using lists
- work with callback function
- work with query chains
- web console mode
- action logging
|