summaryrefslogtreecommitdiff
path: root/searx/network/network.py
Commit message (Collapse)AuthorAge
* Bump httpx 0.21.2 from to 0.24.1Alexandre Flament2023-08-21
|
* Update network.pyEvhorizon2022-11-06
|
* searx.network: add "verify" option to the networksAlexandre Flament2022-10-14
| | | | | | | | | Each network can define a verify option: * false to disable certificate verification * a path to existing certificate. SearXNG uses SSL_CERT_FILE and SSL_CERT_DIR when they are defined see https://www.python-httpx.org/environment_variables/#ssl_cert_file
* bing.py: resolve bing.com/ck/a redirectionsAlexandre Flament2022-07-08
| | | | add a new function searx.network.multi_requests to send multiple HTTP requests at once
* Allow 'using_tor_proxy' to be set for each engine individuallyLéon Tiekötter2022-01-27
| | | | | | | | Check 'using_tor_proxy' for each engine individually instead of checking globally [fix] searx.network: update _rdns test to the last httpx version Co-authored-by: Alexandre Flament <alex@al-f.net>
* [typing] add type hints for dictionariesMartin Fischer2022-01-17
|
* [mod] upgrade httpx 0.21.2Alexandre Flament2022-01-05
| | | | | | | | httpx 0.21.2 and httpcore 0.14.4 fix multiple issues: * https://github.com/encode/httpx/releases/tag/0.21.2 * https://github.com/encode/httpcore/releases/tag/0.14.4 so most of the workarounds in searx.network have been removed.
* [format.python] initial formatting of the python codeMarkus Heiser2021-12-27
| | | | | | | | | | This patch was generated by black [1]:: make format.python [1] https://github.com/psf/black Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [enh] verify that Tor proxy works every time searx startsAlexandre Flament2021-10-12
| | | | based on @MarcAbonce commit on searx
* Merge pull request #261 from dalf/upgrade_httpxAlexandre Flament2021-09-17
|\ | | | | [upd] upgrade httpx 0.19.0
| * [upd] upgrade httpx 0.19.0Alexandre Flament2021-09-17
| | | | | | | | | | adjust searx.network module to the new internal API see https://github.com/encode/httpx/pull/1522
* | [pylint] fix global-variable-not-assigned issuesMarkus Heiser2021-09-17
|/ | | | | | | | | | | | | | | | | | | If there is no write access, there is no need for global. Remove global statement if there is no assignment. global-variable-not-assigned: Using global for names but no assignment is done Used when a variable is defined through the "global" statement but no assignment to this variable is done. In Pylint 2.11 the global-variable-not-assigned checker now catches global variables that are never reassigned in a local scope and catches (reassigned) functions [1][2] [1] https://pylint.pycqa.org/en/latest/whatsnew/2.11.html [2] https://github.com/PyCQA/pylint/issues/1375 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] debug mode: log HTTP requests with network nameAlexandre Flament2021-09-11
| | | | | | For example wikipedia requests use the logger name "searx.network.wikipedia" Log is disable when searx_debug is False
* [pylint] searx: drop no longer needed 'missing-function-docstring'Markus Heiser2021-09-07
| | | | | Suggested-by: @dalf https://github.com/searxng/searxng/issues/102#issuecomment-914168470 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] /image_proxy: use HTTP/1 instead of HTTP/2Alexandre Flament2021-08-24
| | | | | | | httpx: HTTP/2 is slow when a lot data is downloaded. https://github.com/dalf/pyhttp-benchmark also, the usage of HTTP/1 decreases the load average
* [mod] move all default settings into searx.settings_defaultsAlexandre Flament2021-06-01
|
* [coding-style] searx/network/network.py - normalized indentationsMarkus Heiser2021-05-24
| | | | | | No functional change! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [pylint] searx/network/network.py & add global (NETWORKS)Markus Heiser2021-05-24
| | | | | | | | | No functional change! - fix messages from pylint - add ``global NETWORKS`` Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] searx.network: fix rare cases where LOOP is NoneAlexandre Flament2021-04-27
| | | | | | | | | * searx.network.client.LOOP is initialized in a thread * searx.network.__init__ imports LOOP which may happen before the thread has initialized LOOP This commit adds a new function "searx.network.client.get_loop()" to fix this issue
* [mod] refactoring: processorsAlexandre Flament2021-04-21
| | | | | | | | | | Report to the user suspended engines. searx.search.processor.abstract: * manages suspend time (per network). * reports suspended time to the ResultContainer (method extend_container_if_suspended) * adds the results to the ResultContainer (method extend_container) * handles exceptions (method handle_exception)
* [httpx] replace searx.poolrequests by searx.networkAlexandre Flament2021-04-12
settings.yml: * outgoing.networks: * can contains network definition * propertiers: enable_http, verify, http2, max_connections, max_keepalive_connections, keepalive_expiry, local_addresses, support_ipv4, support_ipv6, proxies, max_redirects, retries * retries: 0 by default, number of times searx retries to send the HTTP request (using different IP & proxy each time) * local_addresses can be "192.168.0.1/24" (it supports IPv6) * support_ipv4 & support_ipv6: both True by default see https://github.com/searx/searx/pull/1034 * each engine can define a "network" section: * either a full network description * either reference an existing network * all HTTP requests of engine use the same HTTP configuration (it was not the case before, see proxy configuration in master)