summaryrefslogtreecommitdiff
path: root/Makefile
Commit message (Collapse)AuthorAge
* [mod] replace pycodestyle by blackAlexandre Flament2021-12-27
| | | | | "make test.black" checks for the code style "make format.python" format the python code
* [simple theme] activate - SearXNG JavaScript Style GuideMarkus Heiser2021-12-14
| | | | | | | | | | | | | | Add the 'SearXNG JavaScript Style Guide' as one quality gate in the build chain of the simple theme:: make themes.simple make themes.simple.test In the github CI the `themes.all` target enforce a `themes.simple`. BTW: Remove 'jshint' left overs from 0ee316f3d Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* Merge pull request #508 from return42/arm64Markus Heiser2021-11-18
|\ | | | | [mod] Tools to install and maintain golang binaries & packages.
| * [mod] Tools to install and maintain golang [1] binaries & packages.Markus Heiser2021-11-16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | [1] https://golang.org/doc/devel/release#policy A simple *helloworld* test with user 'my_user' : sudo -H adduser my_user ./manage go.golang go1.17.3 my_user ./manage go.install github.com/go-training/helloworld@latest my_user ./manage go.bash my_user $ helloword Hello World!! Don't forget to remove 'my_user': sudo -H deluser --remove-home my_user Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* | [mod] Makefile - remove targets marked as deprecatedMarkus Heiser2021-11-17
| | | | | | | | | | | | | | | | Remove targets marked as deprecated and convert selected to short hands [1]. [1] https://github.com/searxng/searxng/pull/511#issuecomment-971324265 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* | [mod] Tools to install and maintain NVM versions manager for Node.jsMarkus Heiser2021-11-16
|/ | | | | | [1] https://github.com/nvm-sh/nvm Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* SearXNG: environment variablesAlexandre Flament2021-10-02
|
* SearXNG: .github, searxng-dockerAlexandre Flament2021-10-01
|
* [mod] debug mode: use coloredlogs packageAlexandre Flament2021-09-10
| | | | | in debug mode, add some padding to make the output more readable in procution mode, add the timestamp
* [translations] ./manage rename shell functions to integrate weblateMarkus Heiser2021-08-16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Functions implemented to run *Weblate* workflows should use prefix 'weblate.': - babel.setup.translations.worktree --> weblate.translations.worktree Create git worktree ${TRANSLATIONS_WORKTREE} and checkout branch 'translations' from Weblate's counterpart (weblate) of the SearXNG (origin):: remote weblate https://weblate.bubu1.eu/git/searxng/searxng/ - babel.weblate.to.translations --> weblate.to.translations Update 'translations' branch of SearXNG (origin) with last additions from Weblate. - babel.translations.to.master --> weblate.translations.commit Update 'translations' branch of SearXNG (origin) with last additions from Weblate. Copy the changes to the master branch, compile translations and create a commit in the local branch (master) - babel.master.to.translations --> weblate.push.translations Push *translation changes* from SearXNG (origin) to Weblate's counterpart (weblate). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [translations] web integrationAlexandre Flament2021-08-07
| | | | | * make babel.translations.to.master: pull weblate updates * make babel.master.to.translations: push .pot and .po files to weblate
* [mod] manage - implement babel commands, drop update_translations.shMarkus Heiser2021-08-02
| | | | | | | | | | | | | | In ./manage implement babel.*: - extract : extract messages from source files and generate POT file - update : update existing message catalogs from POT file - compile : compile translation catalogs into binary MO files Replace searx_extra/update/update_translations.sh by command: - ci.babel.update Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] load .config.sh from installation (utils/lib_install.sh)Markus Heiser2021-07-21
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | **new** utils/lib_install.sh: Used to initialize installation procedures - Modified source_dot_config function that - loads .config.sh from an existing installation (at SEARX_SRC). - initialize **SEARX_SRC_INIT_FILES** - functions like: - install_log_searx_instance() - install_searx_get_state() **modified** utils/searx.sh - obsolete environment SEARX_INSTANCE_NAME has been replaced by string 'SearXNG'. **modified** utils/filtron.sh, utils/morty.sh, utils/searx.sh - source utils/lib_install.sh - normalize logging of environment variables using new function install_log_searx_instance() **modified** utils/lib.sh - fix marginal typos **Installation scripts** The utils/lib_install.sh is sourced by the installations scripts: - utils/searx.sh - utils/morty.sh - utils/filtron.sh If '${SEARX_SRC}/.config.sh' exists, the modified source_dot_config() function loads this configuration (instead of './.config.sh'). **SEARX_SRC_INIT_FILES** Array of file names to sync into a installation at $SEARX_SRC. The file names are relative to the $REPO_ROOT. Set by function init_SEARX_SRC_INIT_FILES(). Most often theses are files like: - .config.sh - searx/settings.yml - utils/brand.env - ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] add Makfile target lxc.clean which deletes ./lxc-envMarkus Heiser2021-07-03
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] move functions from utils/manage_static.sh to ./manage scriptMarkus Heiser2021-06-26
| | | | | | | | | | | | | The functions: - static.build.commit - static.build.commit.drop - static.build.restore are imported into the ./manage script. To avoid name collisions some variables and fucntions has been renamed by adding the prefix *static_*. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] utils/manage_static.sh: add script to shellcheckMarkus Heiser2021-06-26
| | | | | | | | | | - add script to shellcheck, - fix error messages from shellcheck and - moved global variables to local variables (lower case) No functional change! Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] add make targets to manage the build files in the /searx/static directoryAlexandre Flament2021-06-26
| | | | | | | | | | | | | | | | | | | | | | | | | The idea is to avoid conflict when there are differents branches with changes are made on the static files. A solution is to ask the administrators to build the files from the sources, but it requires to install the npm dependencies. So the solution in this commit keep the sources and the build files in the same git repository. In one branch, the modification of the source (*.less, *.js) are commited without the built files. The built files are commited in a uniq commit, with a commit message "Static build" In case of merge or rebase, this commit can be dropped. New make targets: * static.build.commit.drop: drop the last "Static build". The command checks that there are only build files in the commit. * static.build.commit : call "make static.build.commit.drop" call "make themes.all" commit the files * static.git.restore.staged: git restore --staged <build files> * static.git.restore: git restore <build files> Related to https://github.com/searxng/searxng/issues/137
* [fix] Makefile: remove themes.bootstrapAlexandre Flament2021-06-22
|
* [fix] pygments.less - remove pyenv_OK conditionMarkus Heiser2021-06-22
| | | | | | BTW: add pygments.less to the help message Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [data.all] add searx_extra/update/update_osm_keys_tags.pyMarkus Heiser2021-06-09
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [enh] add test.yamllint - lint yaml filesMarkus Heiser2021-06-05
| | | | | | | | | | | | Usage:: make test.yamllint ./manage test.yamllint test.yamllint is also added to the `test` makefile target. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] docker-entrypoint.sh - add script to make test.sh (shellcheck)Markus Heiser2021-05-17
| | | | | | | | | | | | Add script docker-entrypoint.sh to shellcheck and try to _simplify_ and _normalize_ some parts: - fix issues reported by shellcheck - don't mix tab and space indent - command 'help' replaced by '-h': ./dockerfiles/docker-entrypoint.sh -h - replace printf in help() by 'cat <<EOF' Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [docker] multiarch support: linux/amd64,linux/arm64,linux/arm/v7Alexandre Flament2021-04-28
| | | | | | | | make docker.buildx : build and push multiarch build. (it can't be only build) use buildx with the --cache-from and --cache-to options to cache the layers (only the last built is cached)
* [fix] Makefile fix target 'test' & 'test.sh'Markus Heiser2021-04-23
| | | | | | | | | | | | | | | | | Renamed 'test.sh' to 'test.shell' seems to solve this issue on my ubu204:: $ make test.sh ... TEST robot ... INSTALL gecko.driver ... Running 7 tests cat test.sh >test cat: test.sh: Datei oder Verzeichnis nicht gefunden make: *** [<eingebaut>: test] Fehler 1 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] replace makefile boilerplate by 'manage' scriptMarkus Heiser2021-04-23
| | | | | | Replaces the make targets with the bash scripts Signed-off-by: Markus Heiser <markus@darmarit.de>
* Merge pull request #15 from return42/add-springerAlexandre Flament2021-04-22
|\ | | | | Add a search engine for Springer Nature
| * [enh] Add Springer Nature enginePierre Chevalier2021-04-22
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Springer Nature is a global publisher dedicated to providing service to research community [1] with official API [2]. To test this PR, first get your API key following this page: https://dev.springernature.com/signup In searx/engines/springer.py at line 24, add this API key. I left my own key, commented out in the line aboce. Feel free to use it, if needed. [1] https://www.springernature.com/ [2] https://dev.springernature.com/
* | [enh] add engine using API from "The Art Institute of Chicago"habsinn2021-04-22
|/
* Add Meilisearch engineNoémi Ványi2021-04-06
| | | | Website: https://www.meilisearch.com/
* Add Solr engineNoémi Ványi2021-03-13
|
* Merge pull request #2346 from dalf/upgrade-oscarAlexandre Flament2021-03-13
|\ | | | | [mod] oscar: upgrade dependencies
| * [mod] oscar: get bootstrap and typeahead from NPMAlexandre Flament2021-03-11
| |
* | Merge pull request #2626 from mikeri/solidtorrentsAlexandre Flament2021-03-12
|\ \ | | | | | | Add Solid Torrents engine
| * | Add Solid Torrents engineMichael Ilsaas2021-03-07
| | |
* | | Merge pull request #2642 from return42/fix-apkmirrorAlexandre Flament2021-03-11
|\ \ \ | | | | | | | | [fix] APKMirror engine - update xpath selectors and fix img_src
| * | | [fix] APKMirror engine - update xpath selectors and fix img_srcMarkus Heiser2021-03-09
| | |/ | |/| | | | | | | | | | | | | BTW: make the code slightly more readable Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* | | Merge pull request #2643 from return42/fix-makefileAlexandre Flament2021-03-11
|\ \ \ | |/ / |/| | [fix] make targets engines.languages and useragents.update
| * | [fix] make targets engines.languages and useragents.updateMarkus Heiser2021-03-08
| |/ | | | | | | | | | | | | | | | | | | | | Since [PR 2600] is merged the update scripts for languages and useragent has been moved to folder: searx_extra/update/ [PR 2600] https://github.com/searx/searx/pull/2600 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* / [fix] rewrite Yahoo-News engineMarkus Heiser2021-03-08
|/ | | | | | | | Many things have been changed since last review of this engine. This patch fix xpath selectors, implements suggestion and is a complete review / rewrite of the engine. Signed-off-by: Markus Heiser <markus@darmarit.de>
* Add searx_extra packageAlexandre Flament2021-03-04
| | | | | | Split the utils directory into: * searx_extra contains update scripts, standalone_searx.py * utils contains the files to build and setup searx.
* [enh] google scholar - python implementation of the engineMarkus Heiser2021-03-01
| | | | | | | The old xpath configuration for google scholar did not work and is replaced by a python implementation. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] add utils/fetch_external_bangs.pyAlexandre Flament2021-02-24
| | | | | Based on duckduckgo bangs Store bangs on a trie to allow autocomplete (not in this commit)
* [enh] add engine MediathekViewWeb (API)Markus Heiser2021-02-09
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [hardening] github workflows - corrupted cacheMarkus Heiser2021-02-01
| | | | | | | | | | | | | | | | | | | | | aka: ensure that 'make test' works as expected The cache contains a copy './local' which is - under some circumstance - corrupted. It is not possible to clear the cache [1] (see the top of the page). Ensure that 'make test' works as expected [2] even if - the python interpreter is missing - the virtualenv exists but pyyaml is missing To hardening when the workflow cache fails, this patch adds the new target 'travis.test' into the workflow. This target probes to import a python module 'yaml'. If this fails the virtualenv will be completely new build. [1] https://github.com/actions/cache/issues/2#issuecomment-673493515 [2] https://github.com/searx/searx/pull/2517#discussion_r567240235 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] add Makfile targets for search.checker.<engine_name>Markus Heiser2021-01-26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | To check all engines: make search.checker To check a engine 'google news' replace space by underline: make search.checker.google_news To see HTTP requests and more use SEARX_DEBUG: make SEARX_DEBUG=1 search.checker.google_news To filter out HTTP redirects: make SEARX_DEBUG=1 search.checker.google_news | grep -A1 "HTTP/1.1\" 3[0-9][0-9]" ... Engine google news Checking https://news.google.com:443 "GET /search?q=life&hl=en&lr=lang_en&ie=utf8&oe=utf8&ceid=US%3Aen&gl=US HTTP/1.1" 302 0 https://news.google.com:443 "GET /search?q=life&hl=en-US&lr=lang_en&ie=utf8&oe=utf8&ceid=US:en&gl=US HTTP/1.1" 200 None -- https://news.google.com:443 "GET /search?q=computer&hl=en&lr=lang_en&ie=utf8&oe=utf8&ceid=US%3Aen&gl=US HTTP/1.1" 302 0 https://news.google.com:443 "GET /search?q=computer&hl=en-US&lr=lang_en&ie=utf8&oe=utf8&ceid=US:en&gl=US HTTP/1.1" 200 None -- Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] revise of the google-Video engineMarkus Heiser2021-01-24
| | | | | | | This revise is based on the methods developed in the revise of the google engine (see commit 410c2f9). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] revise of the google-news engineMarkus Heiser2021-01-22
| | | | | | | This revise is based on the methods developed in the revise of the google engine (see commit 410c2f9). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* Merge pull request #2459 from dalf/update-pythonAlexandre Flament2021-01-12
|\ | | | | Update python
| * [mod] add Python 3.9 supportAlexandre Flament2021-01-12
| |
* | [mod] move brand options from Makefile to settings.ymlMarkus Heiser2021-01-11
|/ | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>