How to send multiple HTTP requests using Python

Nicolas Gandolfo

I'm trying to create a script that checks all possible top level domain combinations based on a given root domain name.

What I've done is generate a list of all possible TLD combinations and what I want to do is make multiple HTTP requests, analyze its results and determine whether a root domain name has multiple active top level domains or not.

Example: A client of mine has this active domains:

  • domain.com
  • domain.com.ar
  • domain.ar

I've tried using grequests but get this error:

TypeError: 'AsyncRequest' object is not iterable

Code:

import grequests


responses = grequests.get([url for url in urls])
grequests.map(responses)
Erik van de Ven

As I mentioned, you cannot put code as a parameter. What you want is to add a list and you can using an inline for loop, like this: [url for url in urls]

It is called list comprehensions and more information about this can be found over here: https://docs.python.org/3/tutorial/datastructures.html#list-comprehensions

So I just added two brackets:

import grequests

responses = (grequests.get(u) for u in urls)
grequests.map(responses)

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

How to send multiple http requests python

Python: How can i send multiple HTTP requests and receive the response?

send multiple http requests using same socket

How to send 10,000 HTTP requests concurrently using Python

how to send multiple requests using same client?

How to send multiple 'GET' requests using get function of requests library?

How to speed up multiple sequential http requests in Python using Http.Client

send cross domain request using python Requests: HTTP for Humans

Send http post request with unicoded data using python requests

Send multiple get requests for the same url using python

Challenge: How to send > 1000 HTTP requests in one second with Python

Java best way to send multiple HTTP requests

Send Cookie Using Python Requests

How to do multiple http requests using the same socket connection in java?

How to make multiple HTTP requests using For loop? TypeScript

How to send a post request with data using python requests module?

How to send form-data using python requests?

How to send an image together with form data using python requests?

How to send '-X POST' using 'requests' library in Python?

How to send OpenCV Image using python requests to Go Endpoint

How to make multiple http requests?

How to send http requests dynamically in Gatling?

How do HTTP redirect requests send cookies?

How to forward HTTP range requests using Python and Flask?

How to send multiple POST requests in JavaScript

How to send multiple requests asynchronously in JavaScript?

how to convert image to base64 to send it using http post requests flutter

Multiple asynchronous HTTP requests using Resttemplate

Multiple http requests while using SSE with NodeJs

TOP Ranking

  1. 1

    Failed to listen on localhost:8000 (reason: Cannot assign requested address)

  2. 2

    Loopback Error: connect ECONNREFUSED 127.0.0.1:3306 (MAMP)

  3. 3

    How to import an asset in swift using Bundle.main.path() in a react-native native module

  4. 4

    pump.io port in URL

  5. 5

    Compiler error CS0246 (type or namespace not found) on using Ninject in ASP.NET vNext

  6. 6

    BigQuery - concatenate ignoring NULL

  7. 7

    ngClass error (Can't bind ngClass since it isn't a known property of div) in Angular 11.0.3

  8. 8

    ggplotly no applicable method for 'plotly_build' applied to an object of class "NULL" if statements

  9. 9

    Spring Boot JPA PostgreSQL Web App - Internal Authentication Error

  10. 10

    How to remove the extra space from right in a webview?

  11. 11

    java.lang.NullPointerException: Cannot read the array length because "<local3>" is null

  12. 12

    Jquery different data trapped from direct mousedown event and simulation via $(this).trigger('mousedown');

  13. 13

    flutter: dropdown item programmatically unselect problem

  14. 14

    How to use merge windows unallocated space into Ubuntu using GParted?

  15. 15

    Change dd-mm-yyyy date format of dataframe date column to yyyy-mm-dd

  16. 16

    Nuget add packages gives access denied errors

  17. 17

    Svchost high CPU from Microsoft.BingWeather app errors

  18. 18

    Can't pre-populate phone number and message body in SMS link on iPhones when SMS app is not running in the background

  19. 19

    12.04.3--- Dconf Editor won't show com>canonical>unity option

  20. 20

    Any way to remove trailing whitespace *FOR EDITED* lines in Eclipse [for Java]?

  21. 21

    maven-jaxb2-plugin cannot generate classes due to two declarations cause a collision in ObjectFactory class

HotTag

Archive