How i extract text from a model dialog in selenium?

186498

Sudhanshu Prajapati

I'm trying to scrape data from "https://free-proxy-list.net/" to simply extract data by clicking on "Get raw list" which opens up a model box inside a website and from that, you can easily copy that or extract that data. So I tried to extract that text using normally

driver.find_element_by_xpath().text

but it showed me an error

ElementNotVisibleException: Message: element not interactable

I followed this answer https://stackoverflow.com/a/54618973/8197487 to overcome this problem

WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.XPATH,'//*[@id="list"]/div/div[1]/ul/li[6]/a'))).click()

p=WebDriverWait(driver, 10).until(EC.presence_of_element_located((By.XPATH,'//*[@id="raw"]/div/div/div[2]/textarea'))).text

After using the above code no error raises but I get no text.

is there any other way or I'm doing something wrong.

frianH

Try the below code:

driver.get('https://free-proxy-list.net/')
get_raw = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, 'a[title="Get raw list"]')))
get_raw.click()
popup = WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.CSS_SELECTOR, 'div.modal-body textarea')))
print(popup.get_attribute('value'))
driver.quit()

Output:

Free proxies from free-proxy-list.net
Updated at 2020-06-11 18:52:02 UTC.

167.172.191.249:39193
51.77.149.1:3134
2.50.154.155:53281
213.6.227.38:54796
122.248.45.35:53281
173.46.67.172:58517
1.186.151.206:36253
182.16.171.65:30679
80.237.20.20:41824
45.225.204.8:999
195.239.178.110:59921
46.41.135.121:8118
5.58.85.32:44937
12.218.209.130:53281
197.89.175.235:8080
119.2.54.204:42510
114.5.128.18:41577
54.169.9.36:3128
199.247.6.29:8080
202.162.196.167:8080
213.98.67.40:41005
103.25.57.83:3128
5.160.72.147:55206
45.230.8.20:51200
191.235.239.149:8080
115.75.1.156:38351
202.57.55.178:60253
209.190.32.28:3128
31.179.224.42:38263
117.103.5.186:44825
85.238.167.170:40088
173.249.30.197:8118
36.72.70.13:8080
13.125.52.156:3128
91.207.147.243:38472
188.92.15.63:59563
3.6.251.241:80
45.236.171.82:999
153.127.6.218:80
176.104.105.218:49141
167.71.91.204:8080
91.134.232.63:3128
103.206.246.214:8080
159.65.171.69:80
223.27.147.121:57726
181.115.168.69:49076
1.179.148.9:61904
159.224.44.19:35697
191.235.104.63:8080
45.64.99.26:8080
183.88.193.179:8080
202.61.49.52:61818
85.223.157.204:40329
167.172.136.107:80
143.0.245.9:39137
103.6.104.105:38898
156.67.117.66:8080
114.57.189.82:54906
217.23.69.146:8080
36.92.57.235:55443
213.0.106.138:3128
130.185.238.103:8080
103.106.219.119:8080
109.238.222.5:45313
41.85.191.6:57797
105.27.237.28:80
142.11.215.136:1321
190.12.95.170:31260
103.31.227.27:8080
105.29.64.221:80
217.61.21.73:3128
159.203.44.118:8080
188.133.165.206:56145
45.235.163.35:33265
103.66.47.97:8080
119.82.252.122:36182
45.71.80.2:59598
178.218.104.8:49707
200.0.46.50:37232
197.242.206.105:59173
1.2.169.49:36335
1.10.188.203:45476
77.48.23.199:57842
45.235.87.65:53781
118.172.51.110:36552
177.66.255.9:51851
103.106.192.166:44689
216.169.73.65:49627
103.29.222.231:52030
184.90.114.134:3128
31.131.67.14:8080
188.235.8.5:54689
46.150.170.10:53281
187.62.191.3:61456
103.87.169.159:31094
190.210.15.194:32302
83.69.93.64:44331
110.77.228.106:8080
94.180.106.94:32767
118.173.233.31:59669
78.186.111.109:8080
154.73.137.157:48896
95.80.98.41:8080
51.158.22.63:5836
178.219.31.252:8080
212.129.55.209:5836
190.111.248.212:8085
213.92.182.235:8080
114.110.21.121:50464
101.51.141.49:57977
125.26.99.212:51591
119.82.253.63:34110
177.84.242.226:54458
188.27.137.163:30987
95.84.137.193:53281
43.229.25.73:38896
202.152.38.77:52740
91.202.240.208:51678
180.250.153.130:53281
118.175.240.205:45232
185.56.209.114:51386
118.97.235.234:8080
61.19.40.50:33665
103.57.143.229:61148
92.52.186.123:32329
79.127.110.29:53293
14.162.145.116:30762
111.235.65.211:35949
193.95.228.13:53281
180.211.183.178:37850
94.243.140.162:40960
200.25.254.135:56897
1.20.97.96:54205
123.200.20.242:58847
187.60.36.164:53597
124.41.243.72:44716
45.188.156.154:8080
90.189.209.127:80
115.127.109.2:45067
187.178.4.242:34125
118.174.196.112:36314
202.77.120.38:57716
109.248.62.207:51672
186.29.163.97:49787
202.179.21.49:23500
178.93.59.22:61135
1.10.189.156:34899
185.100.13.72:47382
176.62.188.158:56351
195.209.176.2:8080
103.141.108.237:3128
12.139.101.99:80
31.28.228.252:8080
36.67.68.21:59436
184.75.210.62:80
1.10.187.149:44976
91.220.166.148:39915
12.139.101.100:80
36.66.19.10:8080
40.121.198.48:80
95.158.63.46:54597
103.28.121.58:3128
194.187.150.40:3128
103.35.132.50:36555
46.197.209.217:3128
103.129.195.108:54033
94.237.75.117:80
176.98.76.203:36651
177.91.127.56:41941
43.229.25.128:52893
88.119.54.44:41382
190.90.63.111:49225
147.78.160.2:8080
91.67.240.45:3128
190.103.178.15:8080
186.42.124.130:65301
178.205.254.106:8080
176.235.99.33:33976
118.174.65.137:31682
14.207.57.235:3128
159.138.3.119:443
45.236.88.42:8880
159.138.1.185:80
105.29.64.217:80
185.134.23.198:80
189.14.193.242:53281
5.9.56.112:3128
144.91.92.67:3128
105.29.64.222:80
64.227.126.52:3128
185.138.123.78:55337
112.78.143.26:47718
5.189.133.231:80
36.67.24.109:37641
92.112.49.152:8080
41.50.139.238:8080
183.89.43.235:8080
36.69.49.246:8080
195.154.47.39:5836
190.80.11.32:8080
113.161.186.101:8080
183.88.195.185:8080
41.60.237.63:8080
181.78.12.133:999
61.91.100.34:8080
181.113.135.254:52058
103.240.206.152:55740
185.141.38.164:51834
41.217.217.60:58734
85.10.219.100:1080
91.150.189.122:43102
93.109.241.246:51587
91.211.107.204:41258
177.73.188.110:54459
219.94.220.147:80
45.71.80.1:51460
200.35.56.161:35945
77.55.214.240:80
5.196.255.171:3128
95.31.5.29:54651
183.182.101.32:56814
46.20.59.243:47497
195.4.164.127:8080
113.161.116.94:8080
81.163.51.69:53281
81.144.138.35:3128
194.183.168.129:31385
189.204.241.42:56792
94.141.233.66:53171
170.82.253.146:53281
103.216.82.190:6666
46.221.57.62:31740
190.200.191.171:8080
79.143.225.152:34155
187.109.118.27:45065
41.160.40.2:37741
95.65.73.200:60952
45.91.94.134:8080
85.21.63.219:53281
185.23.128.180:3128
212.95.180.50:53281
202.51.68.14:61361
138.122.140.18:3128
203.153.20.64:53281
182.52.90.117:45535
1.20.101.62:39928
95.80.254.162:53295
36.255.234.243:46857
91.192.7.36:53281
49.248.154.233:80
138.122.8.49:40818
36.89.180.103:61867
132.255.92.34:53281
31.173.94.93:31504
91.207.238.107:40071
1.20.97.173:46790
125.26.7.124:61642
118.175.93.148:55169
62.122.201.241:46176
177.46.148.142:3128
96.87.16.153:41344
187.130.139.197:8080
81.3.175.15:8080
110.44.133.135:3128
114.199.111.162:80
89.216.48.230:44061
103.215.177.180:80
185.159.87.102:6660
65.152.119.226:39408
114.5.35.98:38554
109.73.181.228:46352
89.36.195.238:39131
185.141.38.93:47607
180.243.67.2:8080
13.66.88.8:3128
182.253.82.156:35955
59.153.18.170:53281
169.239.223.136:49337
186.125.59.8:44363
103.245.182.1:8080
103.95.40.2:8080
62.112.118.14:8080
212.83.175.206:5836
103.42.255.145:50344
5.59.145.129:8080
94.228.85.166:38510
111.220.90.41:40938
188.226.141.211:3128
51.68.228.131:80
110.74.219.189:42074
128.199.202.122:3128
200.106.55.125:80
139.162.78.109:8080
181.196.151.82:45717
124.41.211.188:37746
85.10.219.103:1080
119.81.189.194:80
123.63.110.23:80
182.53.197.156:30082
167.71.5.83:8080

Collected from the Internet

Please contact javaer1[email protected] to delete if infringement.

edited at2020-12-15

Comments

0 comments

How i extract text from a model dialog in selenium?

How i extract text from a model dialog in selenium?

Spring Data MongoRepository save(T) not working... sometimes

pump.io port in URL

Title not updating in nextjs, tailwind css app

redirect your computer port to url

ngClass error (Can't bind ngClass since it isn't a known property of div) in Angular 11.0.3

Convert prompt-sync require into import method

The prop `checked` is marked as required in `ToggleSwitch`, but its value is `undefined`

Transparent Background for TextEditor in SwiftUI

BigQuery - concatenate ignoring NULL

AirflowException: Celery command failed - The recorded hostname does not match this instance's hostname

How to specify proptypes to allow nullable, required prop value?

"django.db.utils.ProgrammingError: relation "auth_user" does not exist" Django V2.0

How to exclude a specific git submodule from update?

Must use destructuring props assignment error in constructor

Kartik's yii2-grid: Setting unknown property: kartik\grid\GridView::panel

How does SwiftUI pass EnvironmentObjects between HostingController?

Format certain floating dataframe columns into percentage in pandas

maven-jaxb2-plugin cannot generate classes due to two declarations cause a collision in ObjectFactory class

Getting video id "Live Stream" from Youtube

How to clear / reset input[type=file] after uploading a file?

Is it possible to change firefox's maximize button position in windows?