Sascha L. Teichmann
f32fba683d
Add concurrent downloads to downloader. ( #363 )
...
* Add concurrent downloads to downloader.
* Moved to Go 1.20
* close files channel on producer side.
* Improve error handling
* New flag to ignore signature check results. Improve docs. Do not use number of CPUs to determine number of download workers.
* Set number of default workers in downloader to two.
2023-05-02 10:10:12 +02:00
Bernhard E. Reiter
8ad805e1e5
doc: improve rate default documentation ( #364 )
...
* doc: improve rate default documentation
solve #359
* Adjust downloader doc, too.
* doc(csaf_checker): Add missing phrase, correct spelling
* docs(csaf_checker): correct format mistake
---------
Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
Co-authored-by: tschmidtb51 <65305130+tschmidtb51@users.noreply.github.com>
2023-05-01 20:38:19 +02:00
JanHoefelmeyer
b0d7df69b8
Change default location of lock file for csaf aggregator and rephrase error message if lock is in use.
2023-03-27 11:05:59 +02:00
JanHoefelmeyer
f638ae9a23
Move disabling of lockfile from explicit option to empty string in lockfile
2023-03-21 08:26:51 +01:00
JanHoefelmeyer
a28ebe39cb
Update doc to include default location instead of only name. (which is not the default)
2023-03-17 13:03:36 +01:00
JanHoefelmeyer
bb053bd427
Add option no_lock to use no lock file if none was configured
2023-03-17 13:00:51 +01:00
JanHoefelmeyer
8f87273837
Remote validator output ( #347 )
...
* The validator is now able to print the details of the remote validations.
---------
Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
Co-authored-by: JanHoefelmeyer <Jan Höfelmeyer jhoefelmeyer@intevation.de>
Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
2023-03-15 11:02:06 +01:00
Sascha L. Teichmann
aa574406cf
Upgrade jsonschema library to 5.2.0 ( #349 )
...
* make jsonschema loading work with current versions of the jsonschema library
again and simplify the code while at it.
* Improve itest workflow for validation service, to make them more robust.
* Use a github action to setup nodejs and use a version that is
required by https://github.com/secvisogram/csaf-validator-service/ .
* Add nodejs16 installation to prepareUbuntuInstanceForITests.sh.
(so it can be done once in manual settings)
* Add refreshing of apt cache before apt install because sometimes
the cached ubuntu image does not have the apt cache current.
---------
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
2023-03-10 10:39:23 +01:00
Bernhard Reiter
dbad3e3c7f
remove two typos
2023-02-28 15:09:56 +01:00
Bernhard Reiter
1bdf207e4b
Improve aggregator docs and config
...
* Fix that TOML key `update_interval` can be processed on top level.
* Add missing keys to top level and provider entries.
* Move explanations to first mention of keys.
* Describe overriding ability and defaults early on and only once.
2023-02-28 15:09:56 +01:00
Bernhard Reiter
704a98ab38
Improve aggregator docs
2023-02-28 15:09:56 +01:00
Bernhard Reiter
a3ee00568f
Improve aggregator docs
...
* improve phrasings and remove some typos
2023-02-28 15:09:56 +01:00
JanHoefelmeyer
bebeec30e0
Adds explanations about which options are mandatory and which are optional
2023-02-28 15:09:56 +01:00
JanHoefelmeyer
f38cff13d6
Add explanation of order in which rate variables are taken into account if existant.
2023-02-28 15:09:56 +01:00
JanHoefelmeyer
39b48e083c
Improve docs for checker and downloader
...
* make it more clear that a domain can also be interpreted as a direct URL.
resolve #316
---------
Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
2023-02-28 14:11:15 +01:00
JanHoefelmeyer
05ad714619
Update csaf_aggregator.md
...
add comma to the end of subordinate clause
2023-02-08 16:17:19 +01:00
JanHoefelmeyer
4b4a6a4dbd
Update docs/csaf_aggregator.md
...
Rephrases csaf_aggregator.md for better readability
Co-authored-by: tschmidtb51 <65305130+tschmidtb51@users.noreply.github.com>
2023-02-08 16:17:19 +01:00
JanHoefelmeyer
38c6da8212
Update docs/csaf_aggregator.md
...
Refer to specific section of provider options instead just provider options
Co-authored-by: tschmidtb51 <65305130+tschmidtb51@users.noreply.github.com>
2023-02-08 16:17:19 +01:00
JanHoefelmeyer
35dc25a5e7
Splits overly long sentence into two. Adds reference to provider documentation
2023-02-08 16:17:19 +01:00
JanHoefelmeyer
a3897ae21f
improve phrasing
2023-02-08 16:17:19 +01:00
JanHoefelmeyer
3bf1af0e9f
Add short explanations the createservicedocument and categories provider options.
2023-02-08 16:17:19 +01:00
Sascha L. Teichmann
052dbbe1d0
Merge pull request #323 from csaf-poc/csaf-validator
...
Add csaf_validator
2023-01-31 11:30:17 +01:00
Sascha L. Teichmann
f60ec5fea4
Merge pull request #312 from csaf-poc/downloader-validator
...
Add remote validator support to downloader
2023-01-30 19:35:48 +01:00
Sascha L. Teichmann
1004fe7c65
Merge branch 'main' into checker-validator
2023-01-30 19:30:36 +01:00
JanHoefelmeyer
0c39819930
Merge pull request #318 from csaf-poc/improve-docs26
...
Improves aggregator docs
2023-01-30 07:51:05 +01:00
Sascha L. Teichmann
adf98736cc
Add csaf_validator
2023-01-29 19:31:36 +01:00
tschmidtb51
2b55bbb341
gt the order right
2023-01-27 18:44:08 +01:00
Sascha L. Teichmann
c8e0804eba
Merged main into branch
2023-01-27 18:25:22 +01:00
tschmidtb51
0383e951a8
Merge branch 'main' into checker-validator
2023-01-27 17:58:37 +01:00
Sascha L. Teichmann
9abc83edc1
Set the default of 'validatorpresets' to 'mandatory'.
2023-01-27 17:40:17 +01:00
Sascha L. Teichmann
2a40ab6393
Set the default of 'validatorpresets' to 'mandatory'.
2023-01-27 17:16:45 +01:00
Bernhard E. Reiter
ec2881a7e1
Update docs/proxy-provider-for-aggregator.md
...
Co-authored-by: tschmidtb51 <65305130+tschmidtb51@users.noreply.github.com>
2023-01-27 09:42:51 +01:00
Bernhard E. Reiter
8e5dd88a62
Update docs/csaf_aggregator.md
...
Co-authored-by: tschmidtb51 <65305130+tschmidtb51@users.noreply.github.com>
2023-01-27 09:41:02 +01:00
JanHoefelmeyer
ddf0747327
Merge pull request #307 from csaf-poc/issue299
...
Extract more than one string from expr: category fields.
2023-01-27 09:24:06 +01:00
Sascha L. Teichmann
51fba46893
Add extra http header support to downloader and checker.
2023-01-26 22:09:38 +01:00
Sascha L. Teichmann
ff31ebfa0f
Fixed typos
2023-01-26 20:02:05 +01:00
Sascha L. Teichmann
ad5c678abf
Mention the single quote limitation of the jsonpath implementation
2023-01-26 18:55:21 +01:00
Bernhard Reiter
c143a4620b
Further improve documentation for aggregator
2023-01-26 16:30:27 +01:00
Bernhard Reiter
de64b88491
Improve documentation for aggregator
...
* Add term "CSAF proxy provider", because it is mentioned now in
https://docs.oasis-open.org/csaf/csaf/v2.0/os/csaf-v2.0-os.html .
* Improve formatting and phrasing.
* Improve description of configuration of update_intervall.
2023-01-26 16:23:08 +01:00
Bernhard Reiter
7e9ea2c9ac
Improve setup script für Ubuntu systems
...
* Make sure that we do not have an old go installation around,
because otherwise it maybe broken by untarring the newer one.
As documented on https://go.dev/doc/install .
2023-01-26 11:56:51 +01:00
Sascha L. Teichmann
69dda45bac
Dedup doc
2023-01-25 13:42:26 +01:00
Sascha L. Teichmann
e004939abf
Implement remote validation in checker.
2023-01-25 10:27:44 +01:00
Sascha L. Teichmann
bcc31c0cd6
Add remote validator support to downloader.
2023-01-25 01:12:18 +01:00
Sascha L. Teichmann
bf6dfafffd
Address remarks from review.
2023-01-24 01:34:23 +01:00
Sascha L. Teichmann
8c8ccf6a2e
Extract more than one string from expr: category fields.
2023-01-22 20:55:26 +01:00
s-l-teichmann s-l-teichmann@users.noreply.github.com
d28869f083
Apply automatic changes
2022-09-02 12:19:28 +00:00
JanHoefelmeyer
87b7844b8b
Fixes canonical url prefix not being quoted and an extra ' at line 67 in the provider_config.toml ( #293 )
...
Co-authored-by: JanHoefelmeyer <Jan Höfelmeyer jhoefelmeyer@intevation.de>
2022-09-02 14:18:34 +02:00
bernhardreiter bernhardreiter@users.noreply.github.com
a62484c31c
Apply automatic changes
2022-08-26 10:24:45 +00:00
Bernhard E. Reiter
124794c4aa
Improve DNS example and itest setup ( #285 )
...
* Make nginx only try to map the root (URL /) request to the
provider-metadata.json for DNSPath, otherwise /index.txt will
also serve that file.
2022-08-26 12:23:51 +02:00
Fadi Abbud
0e1b908695
Fix typo
2022-08-24 09:07:56 +02:00