summaryrefslogtreecommitdiff
path: root/manage
Commit message (Collapse)AuthorAge
* [fix] test.yamllint: return non-zero exit code on warningsMarkus Heiser2022-06-15
| | | | | | | | | SearXNG's YAML files should be free of any warnings. This will stop the test when there are warnings like:: [warning] truthy value should be one of [false, true] (truthy) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] format.python: regexp argument '--include' in BLACK_TARGETSMarkus Heiser2022-05-07
| | | | | | | | | | | | --include TEXT A regular expression that matches files and directories that should be included on recursive searches. An empty value means all files are included regardless of the name. ... Exclusions are calculated first, inclusions later. [default: \.pyi?$] Closes: https://github.com/searxng/searxng/issues/1142 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [theme] peel out oscar from SearXNG developmentMarkus Heiser2022-04-30
| | | | | | This is the first step of removing oscar theme Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] add test.pybabel to cover issues in translation tasksMarkus Heiser2022-04-23
| | | | | | | | | | | | We need to cover issue related to pybabel/translation tasks. By example there was an issue [1] (fixed [2]) when upgrading jinja2 from 3.0.3 to 3.1.0 [3] that has not been covered by the CI tests. [1] https://github.com/searxng/searxng/runs/5688624325?check_suite_focus=true#step:6:348 [2] https://github.com/searxng/searxng/pull/1011 [3] https://github.com/searxng/searxng/pull/1008 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [test.pyright] suppress unneeded error & warning messagesMarkus Heiser2022-04-22
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] add i18n infrastructure for SearXNG message files (searxng.msg)Markus Heiser2022-03-16
| | | | | | | | | With this patch ``searxng.msg`` files can be added to SearXNG. In ``searxng.msg`` files messages can be defined which are not captured by babel's gettext, like the generic names of the categories or messages that are stored in constants. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] replace /help by /info pages and include pages in project docsMarkus Heiser2022-03-12
| | | | | | | | | | | | | | | | | This patch implements a bolierplate to share content from info-pages of the SearXNG instance (URL /info) with the project documentation (path /docs/user). The info pages are using Markdown (CommonMark), to include them in the project documentation (reST) the myst-parser [1] is used in the Sphinx-doc build chain. If base_url is known (defined in settings.yml) links to the instance are also inserted into the project documentation:: searxng_extra/docs_prebuild [1] https://www.sphinx-doc.org/en/master/usage/markdown.html Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [test.pyright] suppress warnings about intentional monkey patchingMarkus Heiser2022-01-25
| | | | | | | | | | | | | | | The warnings: - "logger" is not defined' - "supported_languages" is not defined' - "language_aliases" is not defined' are very verbose and superfluous, since these messages are related to intentional monkey patching. [1] https://github.com/searxng/searxng/pull/783#issuecomment-1019818178 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] introduce node.env.devtools functionMarkus Heiser2022-01-24
|
* [fix] ensure that test.pyright installs pyrightMartin Fischer2022-01-23
| | | | | | | | | | nodejs.ensure only sets up NVM if there isn't a system-wide installation of Node that matches our NODE_MINIMUM_VERSION. The ubuntu image in the CI comes with an up to date node version, so pyright from .nvm_packages is never installed. This commit fixes this by introducing a package.json file.
* [mod] add test.pyright to test & ci.test targetsMartin Fischer2022-01-23
| | | | | | | | | | | | | | Since we currently have many type checking errors, we for now only test with typeCheckingMode: off which makes pyright only check files that contain a comment: # pyright: basic to enable basic type checking, or # pyright: strict to enable strict type checking.
* [enh] clarify why we run pyright in the pyenvMartin Fischer2022-01-23
|
* [mod] manage test.pyright: a commandline to run pyright testsMarkus Heiser2022-01-23
| | | | | | | | | This patch implements the command and Makefile target:: ./manage test.pyright make test.pyright Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] issue reported by: make test.shellMarkus Heiser2022-01-18
| | | | | | | | | $ make test.shell ./manage line 716: build_msg TEST "[reST markup] ${RST_FILES[@]}"" ^-------------^ SC2145: Argument mixes string and array. Use * or separate argument. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] CI target test.rst: test reST markup of README.rstMarkus Heiser2022-01-17
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* Merge pull request #686 from return42/lib_redisMarkus Heiser2022-01-11
|\ | | | | Add redis DB and connector
| * [mod] script to build & install a redis instanceMarkus Heiser2022-01-03
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | A script to build & install a simple & isolated redis service, dedicated to SearXNG and connected via Unix socket. $ ./manage redis.help redis.: devpkg : install essential packages to compile redis build : build redis binaries at /800GBPCIex4/share/SearXNG/dist/redis/6.2.6/amd64 install : create user (searxng-redis) and install systemd service (searxng-redis) remove : delete user (searxng-redis) and remove service (searxng-redis) shell : start bash interpreter from user searxng-redis src : clone redis source code to <path> and checkput 6.2.6 useradd : create user (searxng-redis) at /usr/local/searxng-redis userdel : delete user (searxng-redis) addgrp : add <user> to group (searxng-redis) rmgrp : remove <user> from group (searxng-redis) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* | [fix] debug console (pdb) in a session started by `make run`Markus Heiser2022-01-05
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Commit c7f27404 moves the `python -m searx.webapp` process to the background. A background job can't open a simple python-debugger (pdb) console. This patch moves all processes to the background except the searx.webapp. Insert a break point somewhere in the webapp application:: import pdb pdb.set_trace() And start a debug session by:: make run and test you break point. To test that the entire 'make run' stops in the case of an error in the themes.live [1] background process try: make LIVE_THEME=typo-theme-name run [1] https://github.com/searxng/searxng/pull/664#discussion_r776419585 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* | Merge pull request #664 from return42/themes.liveMarkus Heiser2022-01-04
|\ \ | |/ |/| [mod] manage: add themes.live command (rebuild on modification)
| * [mod] live build of a theme: LIVE_THEME=simple make runMarkus Heiser2021-12-29
| | | | | | | | | | | | | | | | Environment variable to get live builds while modifying CSS & JS of a theme:: LIVE_THEME=simple make run Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
| * [fix] remove leftover from 59f4c792Markus Heiser2021-12-29
| | | | | | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
| * [mod] manage: add themes.live command (rebuild on modification)Markus Heiser2021-12-29
| | | | | | | | | | | | | | | | | | To have a live build while editing the HTML client of a theme. The first argument of the command is the theme name: ./manage themes.live simple Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* | [mod] test.black: show issues (diff) reported by python-blackMarkus Heiser2021-12-27
| | | | | | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* | [mod] replace pycodestyle by blackAlexandre Flament2021-12-27
|/ | | | | "make test.black" checks for the code style "make format.python" format the python code
* [fix] ./manage: upgrade geckodriver when GECKODRIVER_VERSION changeAlexandre Flament2021-12-24
|
* [test.robot] update gecko driver / required by selenium 4.1.0Markus Heiser2021-12-23
| | | | | | | | Update gecko driver to v0.30.0 [1] [1] https://github.com/mozilla/geckodriver/releases/tag/v0.30.0 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] weblate: separate commit description from commit bodyMarkus Heiser2021-12-17
| | | | | | | | | It is a common convention to separate commit description from commit body by a empty line [1]. [1] https://www.conventionalcommits.org/en/v1.0.0/#summary Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [simple theme] activate - SearXNG JavaScript Style GuideMarkus Heiser2021-12-14
| | | | | | | | | | | | | | Add the 'SearXNG JavaScript Style Guide' as one quality gate in the build chain of the simple theme:: make themes.simple make themes.simple.test In the github CI the `themes.all` target enforce a `themes.simple`. BTW: Remove 'jshint' left overs from 0ee316f3d Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] simple theme: use sharp instead of convert to create .png from .svgAlexandre Flament2021-11-28
| | | | | | | define a custom grunt task, since grunt-sharp is too old (it can't be installed). in gruntfile.js, the image tasks are moved at the end the build chain. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [brand] initial - folder src/brand for searxng-wordmarkMarkus Heiser2021-11-20
| | | | | | | | | | | | | Folder src/brand is intended to place logo, wordmark and more in. This commit moves the origin (source) of searxng-wordmark.svg from the simple theme into this folder About the new created src/ folder: On the long term we can move all the files from static/themes/<name>/src/* into a src/themes/<name>/* folder. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* Merge pull request #508 from return42/arm64Markus Heiser2021-11-18
|\ | | | | [mod] Tools to install and maintain golang binaries & packages.
| * [mod] Tools to install and maintain golang [1] binaries & packages.Markus Heiser2021-11-16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | [1] https://golang.org/doc/devel/release#policy A simple *helloworld* test with user 'my_user' : sudo -H adduser my_user ./manage go.golang go1.17.3 my_user ./manage go.install github.com/go-training/helloworld@latest my_user ./manage go.bash my_user $ helloword Hello World!! Don't forget to remove 'my_user': sudo -H deluser --remove-home my_user Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* | [mod] Tools to install and maintain NVM versions manager for Node.jsMarkus Heiser2021-11-16
|/ | | | | | [1] https://github.com/nvm-sh/nvm Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] make test.shell - ./manage line 80Markus Heiser2021-11-15
| | | | | | | | | | | | | | make test.shell reports an issue that has been added in [PR-500]:: In ./manage line 80: yamllint : lint YAML files: $YAMLLINT_FILES ^-------------^ SC2128: Expanding an array without an index only gives the first element. [PR-500] https://github.com/searxng/searxng/pull/500 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] manage help - add description of test.yamllintMarkus Heiser2021-11-13
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [simple theme] create favicon.png from src/svg/searxng-wordmark.svgMarkus Heiser2021-11-13
| | | | | | | | | | | | | | | | | | | | new bash function convert_if_newer() / usage:: convert_if_newer <origfile> <outfile> [<options>, ...] convert_if_newer "path/to/origin.svg" "path/to/converted.png" -transparent white -resize 64x64 Run's ImageMagik' convert comand to generate <outfile> from <origfile>, if <origfile> is newer than <outfile>. The command line is to convert is:: convert <origfile> [<options>, ...] <outfile> PNG 'searx/static/themes/simple/img/favicon.png' has been created by:: $ make themes.simple CONVERT searx/static/themes/simple/src/svg/searxng-wordmark.svg -transparent white -resize 64x64 searx/static/themes/simple/img/favicon.png ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [brand] SearXNG - bash env PYLINT_SEARXNG_DISABLE_OPTIONMarkus Heiser2021-10-30
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* SearXNG: dockerAlexandre Flament2021-10-12
|
* [brand] SearXNG - reference /etc/searxng/settings.ymlMarkus Heiser2021-10-11
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* SearXNG: partial update: reference /etc/searxng/settings.ymlAlexandre Flament2021-10-11
|
* [fix] commit message of 'make weblate.push.translations'Markus Heiser2021-10-04
| | | | | | | | | | | Fix `\n` issue in the commit message [1] by using multiple `-m` options [2]:: 7d9ffd680 translations [translations] update messages.pot and messages.po files\nFrom cebc0e39 - 2021-10-04 - Markus Heiser <markus.heiser@darmarIT.de> [1] https://github.com/searxng/searxng/pull/379#issuecomment-933242702 [2] https://git-scm.com/docs/git-commit#Documentation/git-commit.txt--mltmsggt Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] make weblate.push.translationsAlexandre Flament2021-10-03
| | | Even when there are changes, the function exit without pushing them.
* Merge pull request #375 from dalf/searxng_extraAlexandre Flament2021-10-03
|\ | | | | SearXNG: searx_extra
| * SearXNG: searxng_extraAlexandre Flament2021-10-02
| |
* | SearXNG: SEARXNG_SETTINGS_PATHAlexandre Flament2021-10-02
| |
* | SearXNG: environment variablesAlexandre Flament2021-10-02
|/
* [mod] manage - use pyenv.activate where it makes senseMarkus Heiser2021-09-17
| | | | Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [mod] utils/lib.sh: add pyenv.activateAlexandre Flament2021-09-17
| | | | | | | * initialize virtualenv (pyenv.install) * activate virtualenv close #310
* [fix] manage help(): commands babel.* has been renamed to weblate.*Markus Heiser2021-09-12
| | | | | | | In commit 97355672c the functions named babel.* has been renamed to weblate.* but it was forgotten to change it also in the help(). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
* [fix] add 'categories' to PYLINT_ADDITIONAL_BUILTINS_FOR_ENGINESMarkus Heiser2021-09-07
| | | | | | | | | androp no longer needed (see line 591 in 7b235a1):: # pylint: disable=undefined-variable Suggested-by: @dalf https://github.com/searxng/searxng/issues/102#issuecomment-914068609 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>