104 lines
2.6 KiB
Plaintext
104 lines
2.6 KiB
Plaintext
Prefixes with most flags:
|
|
|
|
M 18
|
|
S 18
|
|
B 17
|
|
C 15
|
|
T 13
|
|
G 12
|
|
A 11
|
|
L 11
|
|
K 10
|
|
|
|
There are no flags with prefix X
|
|
|
|
Errors with threadpool:
|
|
|
|
$ python3 flags_threadpool2.py _
|
|
|
|
ZT failed: 503 - Service Temporarily Unavailable
|
|
ZU failed: 503 - Service Temporarily Unavailable
|
|
ZV failed: 503 - Service Temporarily Unavailable
|
|
ZY failed: 503 - Service Temporarily Unavailable
|
|
--------------------
|
|
24 flags downloaded.
|
|
37 not found.
|
|
615 errors.
|
|
Elapsed time: 3.86s
|
|
|
|
|
|
$ python3 flags_sequential2.py
|
|
Searching for 10 flags: BD, BR, CN, ID, IN, JP, NG, PK, RU, US
|
|
BD failed: (ProtocolError('Connection aborted.', gaierror(8, 'nodename nor servname provided, or not known')),)
|
|
--------------------
|
|
0 flag downloaded.
|
|
1 error.
|
|
Elapsed time: 0.02s
|
|
*** WARNING: 9 downloads never started! ***
|
|
|
|
|
|
194 flags downloaded.
|
|
482 not found.
|
|
Elapsed time: 683.71s
|
|
|
|
real 11m23.870s
|
|
user 0m3.214s
|
|
sys 0m0.603s
|
|
|
|
|
|
$ python3 flags2.py -a
|
|
LOCAL site: http://localhost:8001/flags
|
|
Searching for 194 flags: from AD to ZW
|
|
1 concurrent conection will be used.
|
|
--------------------
|
|
194 flags downloaded.
|
|
Elapsed time: 0.90s
|
|
(.env34) 192:countries luciano$ python3 flags2.py -e
|
|
LOCAL site: http://localhost:8001/flags
|
|
Searching for 676 flags: from AA to ZZ
|
|
1 concurrent conection will be used.
|
|
--------------------
|
|
194 flags downloaded.
|
|
482 not found.
|
|
Elapsed time: 4.71s
|
|
(.env34) 192:countries luciano$ python3 flags2.py -s remote
|
|
(.env34) 192:countries luciano$ python3 flags2.py -s remote -a -l 100
|
|
REMOTE site: http://python.pro.br/fluent/data/flags
|
|
Searching for 100 flags: from AD to LK
|
|
1 concurrent conection will be used.
|
|
--------------------
|
|
100 flags downloaded.
|
|
Elapsed time: 72.58s
|
|
(.env34) 192:countries luciano$ python3 flags2.py -s remote -e
|
|
REMOTE site: http://python.pro.br/fluent/data/flags
|
|
Searching for 676 flags: from AA to ZZ
|
|
1 concurrent conection will be used.
|
|
--------------------
|
|
194 flags downloaded.
|
|
482 not found.
|
|
Elapsed time: 436.09s
|
|
(.env34) 192:countries luciano$ python3 flags2_threadpool.py -s remote -e
|
|
REMOTE site: http://python.pro.br/fluent/data/flags
|
|
Searching for 676 flags: from AA to ZZ
|
|
30 concurrent conections will be used.
|
|
--------------------
|
|
194 flags downloaded.
|
|
482 not found.
|
|
Elapsed time: 12.32s
|
|
(.env34) 192:countries luciano$ python3 flags2_threadpool.py -s remote -e -m 100
|
|
REMOTE site: http://python.pro.br/fluent/data/flags
|
|
Searching for 676 flags: from AA to ZZ
|
|
100 concurrent conections will be used.
|
|
--------------------
|
|
89 flags downloaded.
|
|
184 not found.
|
|
403 errors.
|
|
Elapsed time: 7.62s
|
|
(.env34) 192:countries luciano$
|
|
|
|
wait_with_progress
|
|
http://compiletoi.net/fast-scraping-in-python-with-asyncio.html
|
|
|
|
http://blog.condi.me/asynchronous-part-1/
|
|
|