1
0
Fork 0
mirror of https://github.com/gocsaf/csaf.git synced 2025-12-22 18:15:42 +01:00
Commit graph

50 commits

Author SHA1 Message Date
JanHoefelmeyer
8f87273837
Remote validator output (#347)
* The validator is now able to print the details of the remote validations.
---------

Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
Co-authored-by: JanHoefelmeyer <Jan Höfelmeyer jhoefelmeyer@intevation.de>
Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
2023-03-15 11:02:06 +01:00
Bernhard Reiter
1bdf207e4b Improve aggregator docs and config
* Fix that TOML key `update_interval` can be processed on top level.
 * Add missing keys to top level and provider entries.
 * Move explanations to first mention of keys.
 * Describe overriding ability and defaults early on and only once.
2023-02-28 15:09:56 +01:00
Sascha L. Teichmann
ffb29f5ba4 Replace 'confirming filename' with 'conforming filename' 2023-02-03 16:21:15 +01:00
JanHoefelmeyer
0c39819930
Merge pull request #318 from csaf-poc/improve-docs26
Improves aggregator docs
2023-01-30 07:51:05 +01:00
Sascha L. Teichmann
0745a0943d Separate compiling and evaluation of dynamic categories. 2023-01-26 21:54:46 +01:00
Bernhard Reiter
de64b88491
Improve documentation for aggregator
* Add term "CSAF proxy provider", because it is mentioned now in
   https://docs.oasis-open.org/csaf/csaf/v2.0/os/csaf-v2.0-os.html .
 * Improve formatting and phrasing.
 * Improve description of configuration of update_intervall.
2023-01-26 16:23:08 +01:00
Sascha L. Teichmann
8c8ccf6a2e Extract more than one string from expr: category fields. 2023-01-22 20:55:26 +01:00
Sascha L. Teichmann
1d0499ddea Removed unused doc.go file in aggregator. 2023-01-19 16:45:26 +01:00
Sascha L. Teichmann
5b60e7d728 Add package comments to make revive happy. 2023-01-19 16:45:26 +01:00
Sascha L. Teichmann
c4b70d20cd Demand Go 1.19 in go.mod. Replaced interface{} with any 2023-01-19 16:45:26 +01:00
Sascha L. Teichmann
70b4e18b58
Treat invalid PMDs as error and stop processing if needed
*  Improve how PMD validation result is used when searching for a valid PMD.
   We now stop if no PMD can be validated against the json schema.
2022-08-26 16:53:18 +02:00
Sascha L. Teichmann
a1f446f443 Use fully quoted CSV writer for changes.csv 2022-08-17 12:08:38 +02:00
Sascha L. Teichmann
37d8a8d6df Conversion provider -> publisher is not worth the method. 2022-08-16 12:28:14 +02:00
Sascha L. Teichmann
b608746fac support publishers in aggregator 2022-08-16 11:55:56 +02:00
Sascha L. Teichmann
696fb74b36 Do not export function in config. 2022-08-03 15:32:05 +02:00
Sascha L. Teichmann
b6f4172ff9 s/iterim/interim/ 2022-08-02 22:21:38 +02:00
Sascha L. Teichmann
bdb24e72ab Ensure that interims.csv is deleted as soon as the last entry is removed from it. 2022-08-02 22:12:56 +02:00
Sascha L. Teichmann
00a0fb68d2 Fix transaction part two 2022-08-02 21:52:02 +02:00
Sascha L. Teichmann
9a7fbea7b6 Fix first part of transaction. 2022-08-02 18:36:20 +02:00
Sascha L. Teichmann
bf95140dbe if all interims have not changed do nothing 2022-08-02 18:20:04 +02:00
Sascha L. Teichmann
c27fa41c2f Fixed index bug in accessing column of interims.csv 2022-08-02 18:11:25 +02:00
Sascha L. Teichmann
2f65019e45 Merge remote-tracking branch 'origin/unify-spelling-interims-csv' into rework-interim 2022-08-02 17:06:39 +02:00
Sascha L. Teichmann
ef829131e1 reworked loading, checking and storing interims. 2022-08-02 17:01:48 +02:00
Sascha L. Teichmann
6547ed0a4b Fixed spelling of interims.csv 2022-08-02 14:12:41 +02:00
Sascha L. Teichmann
8e13d37756 If we do directory distributions write directory_urls 2022-08-01 07:09:21 +02:00
Sascha L. Teichmann
60b1db2da1
Fix aggregator to create valid uppercase TLPs. (#250)
Resolve #249
2022-07-22 09:09:25 +02:00
JanHoefelmeyer
3769f1d338
Add abilities to aggregator to mirror and list
* Aggregator now checks every provider on whether its mirrored or listed. 
*Add the option to the docs.
* Clean up the example  toml file to still contain two mirrors and one example-lister.

Co-authored-by: Jan Höfelmeyer <Jan Höfelmeyer jhoefelmeyer@intevation.de>
Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
2022-07-21 17:59:58 +02:00
Sascha L. Teichmann
d1855a9c30
Improve checks and messages for bad entries in files
* Ignore bad URLs in index.txt, improve messages.

resolve #158
2022-07-21 17:11:46 +02:00
Sascha L. Teichmann
86a015d6bf
Correct field order in changes.csv (#228) 2022-07-18 18:37:55 +02:00
JanHoefelmeyer
46f79a9e24
Bailout unknown config (#216)
* provider now checks for undecoded config entries and returns an error if any are found

* Specific error message now in server logs, more general message for user

* Changes spaces to tabs for formatting consistency

* Further formatting

* Improved handling of undecoded TOML fields in config.

* aggregator now checks for not decoded config options

Co-authored-by: Jan Höfelmeyer <Jan Höfelmeyer jhoefelmeyer@intevation.de>
Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
2022-07-12 14:07:12 +02:00
Sascha L. Teichmann
dc8c89c886 Merge branch 'main' into rolie-categories 2022-07-05 16:54:12 +02:00
Sascha L. Teichmann
20f5937240
Only create/update index.txt, changes.csv, security.txt when configured. (#210)
* Change default to not write index.txt, changes.csv and security.txt 
  (for provider and aggregator)
* Add config file options to reenable writing.
2022-07-05 16:44:45 +02:00
Sascha L. Teichmann
141acc802e Add service document support for aggregator 2022-06-30 18:51:22 +02:00
Sascha L. Teichmann
7bafb210cf Add category support for aggregator 2022-06-30 13:54:51 +02:00
Sascha L. Teichmann
b359fd0a62
Add CSAF downloader
* Dense and refactor ROLIE code in aggregator a bit.
* Move  advisory file processor to csaf package.
* Fix minor typo on main readme
2022-06-23 14:14:44 +02:00
Sascha L. Teichmann
78d8b89aca
Add support for remote validation services. (#185)
* Simple tool to test the remote validation

* Added remote validator support to provider.

* Added remote validation to aggregator.

* Calm golint

* Removed csaf_remote_validator tool as it was only for dev.

* Re-added csaf_remote_validator tool. Testing is not done.

* Embed the document entirely

* Include testing the remote validator in the Itests

* Change permission of the script

* Remove code for Itests

* As these will be done in another branch

Co-authored-by: Fadi Abbud <fadi.abbud@intevation.de>
2022-06-21 14:47:06 +02:00
Bernhard E. Reiter
2961a70bf2
Change OpenPGP signatures to be without headers (#183)
* Change options when creating the armored version of the signature
   to leave out the optional headers, which would be `Version:`
   and `Comment:`, as it is considered uncommon for a while now to
   set these.
2022-06-14 13:18:42 +02:00
Sascha L. Teichmann
589547fa94
Improve writing ROLIE feed documents
* Add signature and two time has as link rel attributes to each rolie entry
   for provider and aggregator. Thus following CSAF 2.0 csd02. 
resolve #74
2022-06-14 09:50:36 +02:00
Fadi Abbud
714814a44b
Fix datetime format (#174)
* #173
2022-06-10 10:57:08 +02:00
Sascha L. Teichmann
69f0f3499a
Change openpgp key providing code to use local directory
* Adjust provider and aggregator to copy the used openpgp pubkey into a locally
  provided directory `openpgp` beside the `prodiver-metadata.json`.
  This more robust and self-reliant than using a public pubkey server,
  which is the reason why the CSAF 2.0 csd02 mentions it as example in
  "7.1.20 Requirement 20: Public OpenPGP Key".
 * Improve aggregator by removing a typo `aggreator` from one written paths.
   (Done with this change as it also affects the openpgp/ paths writing.)

solve #85
2022-06-09 10:42:44 +02:00
Bernhard E. Reiter
a849ac0d5f
Improve https get diagnostics, add verbose option
* Implement a logging client and activate it using verbose parameter or option
   in checker and aggregator.

Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
2022-06-02 15:07:55 +02:00
Sascha L. Teichmann
527a6f6005
Implement better search for provider-metadata.json
* Decouple loading of provider metadata from processor and moved in the base library.
* Integrate new code into checker and aggregator
* Adhere to csd02 revision of CSAF 2.0.

resolve #60
2022-05-31 18:10:18 +02:00
Sascha L. Teichmann
07ab770a35 Factored throttling client out of aggregator. 2022-05-30 23:12:08 +02:00
Sascha L. Teichmann
86070629e2 Forget to add indices in aggregator. 2022-05-25 14:41:30 +02:00
Sascha L. Teichmann
de595f5da9 Add missing category list in ROLIE feeds. Resolves issue #41 2022-05-25 10:17:17 +02:00
Sascha L. Teichmann
17f22855ee
Add filename conformity check
* Add util function to check a filename for confirming to csaf-v2.0-csd02.
* Add code to reject bad filenames in provider, checker, aggregator and uploader.
2022-05-20 18:57:27 +02:00
Sascha L. Teichmann
a50ed4ab01 Write correct url prefix to provider-metadata. 2022-05-19 12:22:06 +02:00
Sascha L. Teichmann
6295466ef5 Partially role back last commit. WIP 2022-05-19 11:33:11 +02:00
Sascha L. Teichmann
c69709c1ec Move ROLIE feed to respective folder. For Issue #143, #144 2022-05-19 10:20:20 +02:00
Sascha L. Teichmann
8a1ebe0b7a
Add aggregator; improve itest workflow
* Factor JSON evaluation and  construction base URLs out of of checker.
* Move json path matching to util.
* Add csaf_aggregator (as additional command)
* Improve itest workflow to checkout the branch where it is running on.

resolve #105
resolve  #72

Co-authored-by: tschmidtb51 <65305130+tschmidtb51@users.noreply.github.com>
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
Co-authored-by: Fadi Abbud <fadi.abbud@intevation.de>
2022-05-10 18:12:38 +02:00