Sascha L. Teichmann
c09e5f66f3
Add type to checker messages
...
* Add a type to checker messages, so the results can be interpreted better.
Especially the difference between warning and errors can be used.
2022-06-09 12:26:19 +02:00
Bernhard E. Reiter
a849ac0d5f
Improve https get diagnostics, add verbose option
...
* Implement a logging client and activate it using verbose parameter or option
in checker and aggregator.
Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
2022-06-02 15:07:55 +02:00
Sascha L. Teichmann
527a6f6005
Implement better search for provider-metadata.json
...
* Decouple loading of provider metadata from processor and moved in the base library.
* Integrate new code into checker and aggregator
* Adhere to csd02 revision of CSAF 2.0.
resolve #60
2022-05-31 18:10:18 +02:00
Sascha L. Teichmann
bc90389090
Use factored out rate throttling client in checker.
2022-05-30 23:25:21 +02:00
Fadi Abbud
a1036c3847
Add 'Rate' config option for download throttling (Checker)
2022-05-30 13:38:29 +02:00
Fadi Abbud
13423c3d4d
Add datetime and version info to report of checker
...
Resolve #142
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
2022-05-24 16:59:27 +02:00
Sascha L. Teichmann
17f22855ee
Add filename conformity check
...
* Add util function to check a filename for confirming to csaf-v2.0-csd02.
* Add code to reject bad filenames in provider, checker, aggregator and uploader.
2022-05-20 18:57:27 +02:00
Sascha L. Teichmann
d779a3fd7e
Merge pull request #135 from csaf-poc/link-checker
...
Link checker
2022-05-17 17:26:35 +02:00
Sascha L. Teichmann
16556cd8bb
check each advisory is listable
2022-05-17 17:20:43 +02:00
Bernhard Reiter
9eca8a924f
Improved searching for provider-metadata.json
...
* Changes order to try the DNS path after security.txt.
* Add diagnostic output which URL is looked for.
2022-05-17 16:08:38 +02:00
Sascha L. Teichmann
131a7155fa
If there are year folders in directory listings, fetch files from the extra level.
2022-05-17 15:58:34 +02:00
Bernhard Reiter
2cfb4b8e49
Fix DNS path check
...
* Make it dynamic by the domain given for the check.
* Change reporting text to be more clear about which is the dynamic
part (in lack of direct access to the path which was checked.)
2022-05-17 15:34:39 +02:00
Bernhard Reiter
29f26e0299
Merge branch 'main' into link-checker
2022-05-17 14:45:01 +02:00
Fadi Abbud
f5b7f81aa4
Fix path for locating provider-metadata.json
2022-05-17 12:54:14 +02:00
Sascha L. Teichmann
3bbd37c441
Implemented links on directory listings checking
2022-05-17 01:22:30 +02:00
Fadi Abbud
726711c688
Implement validation for ROLIE json schema
2022-05-16 11:15:46 +02:00
Sascha L. Teichmann
8a1ebe0b7a
Add aggregator; improve itest workflow
...
* Factor JSON evaluation and construction base URLs out of of checker.
* Move json path matching to util.
* Add csaf_aggregator (as additional command)
* Improve itest workflow to checkout the branch where it is running on.
resolve #105
resolve #72
Co-authored-by: tschmidtb51 <65305130+tschmidtb51@users.noreply.github.com>
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
Co-authored-by: Fadi Abbud <fadi.abbud@intevation.de>
2022-05-10 18:12:38 +02:00
Fadi Abbud
72e6df2987
Rename some variables
2022-05-04 15:39:22 +02:00
Fadi Abbud
a69d35ab3c
Add code documentation
2022-05-04 15:31:26 +02:00
Fadi Abbud
ea9c6b4502
Implement more tests for checker
...
* Implement testing if the provider-metadata.json is under
/.well-known/csaf/ available.
* Implement testing if the DNS is available and serves the
provider-metadata.json
2022-05-04 15:23:03 +02:00
Fadi Abbud
8bf48a2de2
Adjust provider for new CSAF CSD02 schema
...
* Replace "pgp_keys" with "public_openpgp_key" in the provider-metadata.json.
resolve #112
2022-04-28 20:46:37 +02:00
Sascha L. Teichmann
dad549c392
Move code from checker to library
2022-04-28 13:47:35 +02:00
Sascha L. Teichmann
3df91fa051
Type messages of a checker topic to avoid code duplication
2022-04-22 12:02:21 +02:00
Bernhard Reiter
880122315d
Correct minor typo in check output message
2022-04-21 17:16:18 +02:00
Bernhard Reiter
de738d2c56
Add message to explain a stopped check
...
* In case of errStop, add a message to show which check aborted the
others.
2022-04-21 16:26:11 +02:00
Bernhard Reiter
dd48fc8b6c
Fix minor typo in code comment
2022-04-21 16:16:01 +02:00
Bernhard Reiter
cbb41588ea
Fix minor typos in code comments
2022-04-21 15:40:56 +02:00
Fadi Abbud
a91d36cc95
Add options to use TLS client certificate for authentication (Checker)
...
* Add "client-cert" and "client-key" flag options to allow the checker to use TLS client certificate for authentication.
* Fix typo TSL -> TLS in docs.
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
2022-03-31 17:57:43 +02:00
Fadi Abbud
4fae2ec627
Fix typo
2022-03-22 08:39:13 +01:00
Sascha L. Teichmann
45ac434871
Merge pull request #80 from csaf-poc/checker-documentation
...
Checker documentation
2022-03-21 22:20:00 +01:00
Fadi Abbud
9e2a9d7fad
Code documentation and fix typo
2022-03-08 17:31:13 +01:00
Fadi Abbud
41a2d50773
Code documentation
2022-03-07 14:39:29 +01:00
Fadi Abbud
aa60e8f245
Add some code documentation
2022-03-04 16:04:21 +01:00
Bernhard Reiter
1c5664d8cb
Improve Texts "PGP key" -> "public OpenPGP key"
2022-03-03 14:46:07 +01:00
Bernhard Reiter
1f4f32435d
Fixing `CASF' typos
...
* Bump copyright year 2021 -> 2022 on a few files.
2022-02-25 17:38:07 +01:00
Sascha L. Teichmann
b12ad718c5
Factor out summary extraction from advisories.
2022-02-24 12:22:10 +01:00
Sascha L. Teichmann
4fc6bc5509
Add another layer aound the ROLIE feed documents.
2022-02-23 21:10:19 +01:00
Sascha L. Teichmann
b894950b63
Load location of provider-metadata.json from security.txt
2022-02-07 20:12:32 +01:00
Sascha L. Teichmann
27f1aa5461
Started with loading provider-metadata.json from a list of possible locations.
2022-02-07 17:37:01 +01:00
Sascha L. Teichmann
9adab13948
Do not report success on checks which were not performed.
...
Second part of the Fix of issue #24 .
2022-01-12 19:48:33 +01:00
Sascha L. Teichmann
09de416a4a
Stop checker run of a domain after an error occurrs making a continuation pointless.
...
Fixes issue #24 .
TODO: Improve handling of checks that are not run due to the stop.
They currently report success which is not correct.
2022-01-12 12:32:07 +01:00
Sascha L. Teichmann
da9bee4ff5
Implemented one folder per year requirement.
2021-12-16 15:17:38 +01:00
Sascha L. Teichmann
0d7ca0db53
Renamed processing of ROLIE feeds more fittingly.
2021-12-16 11:29:18 +01:00
Sascha L. Teichmann
287a393b6c
Fixed passing to less arguments to fmt.
2021-12-16 03:26:25 +01:00
Sascha L. Teichmann
68cab9ec58
Search for index.txt and changes.csv in csaf folder, too.
2021-12-16 03:17:37 +01:00
Sascha L. Teichmann
deaf8a5722
Cross validate where CSAFs where found.
2021-12-16 02:59:33 +01:00
Sascha L. Teichmann
8e16650512
Implemented changes.csv check.
2021-12-16 01:17:23 +01:00
Sascha L. Teichmann
57f8f06257
Implemented index.txt check
2021-12-16 00:43:50 +01:00
Sascha L. Teichmann
30789e60d5
Call the checks again.
2021-12-15 21:22:38 +01:00
Sascha L. Teichmann
534b96d211
WIP: Refactored for simpler reporting.
2021-12-15 19:41:29 +01:00