koplas
990c74a1a6
Merge branch 'sha-handling' into unittest
2024-11-22 16:58:46 +01:00
koplas
7824f3b48d
Improve hash fetching and logging
2024-11-22 16:56:58 +01:00
koplas
a6807d24d6
Merge branch 'sha-handling' into unittest
2024-11-22 16:51:55 +01:00
koplas
d18d2c3bf1
Improve hash fetching and logging
2024-11-22 16:47:26 +01:00
koplas
ddb5518c6d
Extend SHA marking tests
2024-09-17 10:45:25 +02:00
koplas
6ca6dfee25
Add initial downloader tests
2024-09-16 16:01:41 +02:00
koplas
37c9eaf346
Add CLI flags to specify what hash is preferred
2024-09-09 10:35:41 +02:00
koplas
be2e4e7424
Improve hash path handling of directory feeds
2024-07-31 11:42:45 +02:00
koplas
a131b0fb4b
Improve SHA* marking
2024-07-25 15:39:40 +02:00
Marius Goetze
bcf4d2f64a
fix error message
...
The error message had a trailing `:` which suggest that there are some details which were truncated. However the details are already printed before in the log.
2024-07-16 12:00:09 +02:00
Marius Goetze
1e531de82d
fix: don't require debug level to print error details on failed loading of provider metadata json
2024-07-15 14:22:15 +02:00
Sascha L. Teichmann
5c6736b178
Remove data races in downloader caused by shared use of json path eval. ( #547 )
2024-06-24 11:57:38 +02:00
Bernhard Herzog
617deb4c17
Merge pull request #530 from oxisto/slog
...
Added support for structured logging in `csaf_aggregator`
2024-04-25 13:13:11 +02:00
Immanuel Kunz
c704275a38
Merge branch 'csaf-poc:main' into main
2024-04-25 09:42:51 +02:00
Kunz, Immanuel
005e661479
add config flag to use enumerate-only
2024-04-23 20:24:18 +02:00
Kunz, Immanuel
457d519990
minor updates to Enumerate method, integrate enumerate in cmd downloader
2024-04-23 19:09:22 +02:00
Christian Banse
9b1480ae3d
Bumped Go version to Go 1.21. Using log/slog instead of golang.org/x/exp/slog
2024-04-23 15:37:43 +02:00
Kunz, Immanuel
d64aa20cee
first draft for downloader using enumerate
2024-04-22 17:53:45 +02:00
JanHoefelmeyer
39a29e39f1
Change Licenses from MIT to Apache 2.0
2024-04-22 13:11:30 +02:00
Sascha L. Teichmann
91ab7f6b1c
Chance supported minimal Go version back to 1.20 ( #514 )
2023-11-28 10:37:16 +01:00
Sascha L. Teichmann
6f8870154c
Break overly long line. Fix typo in comment.
2023-11-20 21:13:24 +01:00
JanHoefelmeyer
a413852627
Downloader: Only add tlp label to path if no custom directory is configured. Refactor accordingly
2023-11-20 11:05:57 +01:00
Sascha L. Teichmann
8f6e6ee8bb
improve logging output
2023-10-17 18:52:38 +02:00
Bernhard Reiter
3923dc7044
fix: improve logging for downloader and aggregator
...
* use full name for printing out the used logfile for the downloader.
* for debug or verbose, log the timeintervall that will be used
for downloader and aggregator. (The checker has this as part
of its output already.)
2023-10-17 11:33:03 +02:00
Sascha L. Teichmann
7a8cdb6d19
Lift distribution from v2 to v3. ( #467 )
...
* v2 -> v3
* Increase version within Makefile
---------
Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
2023-09-27 15:46:57 +02:00
Sascha L. Teichmann
7cd076d4f8
Downloader: Remove verbose flag ( #464 )
...
* Remove verbose flag from downloader.
* Do structured http logging in forwarder, too.
* Use structured logging to separate http traffic of downloader from forwarder.
2023-09-27 11:30:24 +02:00
cintek
49da14d47f
feat: log redirects ( #458 )
...
* feat: log redirects
* improved logging and renamed function
2023-09-26 10:03:09 +02:00
Sascha L. Teichmann
5459f10d39
Downloader: Add structured logging, fails storing and statistics
...
* add forwarding support in downloader
* Raise needed Go version to 1.21+ so slog can be used.
* Introduce validation mode flag (strict, unsafe)
* Add structured logging and place log into the download folder.
* Improve some code comment (bernhardreiter)
* Add counting stats to downloader.
2023-08-28 15:03:01 +02:00
Sascha L. Teichmann
e0475791ff
Downloader: Add forwarding to HTTP endpoint ( #442 )
...
* started with forwarding support in downloader
* Add missing files.
* Add missing files.
* Raise needed Go version
* More Go version bumping.
* Fix forwarding
* Go 1.21+ needed
* Make terminating forwarder more robust.
* Better var naming
* Remove dead code. Improve commentary.
* Prepare validation status adjustment.
* Move validations to functions to make them executable in a loop.
* Introduce validation mode flag (strict, unsafe)
2023-08-25 10:31:27 +02:00
Sascha L. Teichmann
f31ee53c27
Add client certificate support to the downloader
2023-08-02 21:16:32 +02:00
Sascha L. Teichmann
8aa31984df
Add docs and fix output.
2023-08-01 09:54:43 +02:00
Sascha L. Teichmann
2864176111
Add ignore patterns to downloader.
2023-08-01 01:46:58 +02:00
Sascha L. Teichmann
383b0ca77b
Add an option to downloader to store advisories into a given folder.
2023-07-31 17:19:38 +02:00
Sascha L. Teichmann
0ad4ed9e36
Expose logging as field in AdvisoryFileProcessor to shrink constructor signature.
2023-07-26 03:31:00 +02:00
Sascha L. Teichmann
de0599ebe3
Add time interval filtering to downloader.
2023-07-26 03:22:33 +02:00
Sascha L. Teichmann
8630e8bac2
Add support for config files in downloader. ( #404 )
...
* Add support for config files in downloader.
* Add no-ini for the version flag, too.
* Add config file options in doc to downloader.
2023-07-19 10:49:17 +02:00
Bernhard E. Reiter
cf49c7e414
Fix go.mod and internal dependencies ( #371 )
...
* Use a "/v2" in the module path to match the git version tag which
lead with a 2. Change all mention of the module as dependency
internally as well.
2023-06-05 10:24:35 +02:00
Bernhard Herzog
02d476360b
Merge pull request #366 from csaf-poc/cleanup_provider_metadata_loading
...
Prepare infrastructure for role based reporting
2023-05-16 17:53:18 +02:00
JanHoefelmeyer
4461bd6892
Merge pull request #365 from csaf-poc/filename-id
...
Check that filename matches /document/tracking/id
2023-05-16 08:50:48 +02:00
Sascha L. Teichmann
2e968b197d
Removed old pmd loader.
2023-05-15 08:47:18 +02:00
Sascha L. Teichmann
f32fba683d
Add concurrent downloads to downloader. ( #363 )
...
* Add concurrent downloads to downloader.
* Moved to Go 1.20
* close files channel on producer side.
* Improve error handling
* New flag to ignore signature check results. Improve docs. Do not use number of CPUs to determine number of download workers.
* Set number of default workers in downloader to two.
2023-05-02 10:10:12 +02:00
Bernhard Herzog
a92c033a5e
Check that filename matches ID in csaf_downloader
2023-04-25 18:28:07 +02:00
JanHoefelmeyer
8f87273837
Remote validator output ( #347 )
...
* The validator is now able to print the details of the remote validations.
---------
Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
Co-authored-by: JanHoefelmeyer <Jan Höfelmeyer jhoefelmeyer@intevation.de>
Co-authored-by: Sascha L. Teichmann <sascha.teichmann@intevation.de>
2023-03-15 11:02:06 +01:00
Sascha L. Teichmann
ffb29f5ba4
Replace 'confirming filename' with 'conforming filename'
2023-02-03 16:21:15 +01:00
Sascha L. Teichmann
cbd9dead37
Fix small typo in reporting wromg content type
2023-02-02 00:54:39 +01:00
Sascha L. Teichmann
6430712dad
Warn in checker and downloader if advisories are delivered as none 'application/json'
2023-02-02 00:54:39 +01:00
Sascha L. Teichmann
c8e0804eba
Merged main into branch
2023-01-27 18:25:22 +01:00
Sascha L. Teichmann
51fba46893
Add extra http header support to downloader and checker.
2023-01-26 22:09:38 +01:00
Sascha L. Teichmann
bcc31c0cd6
Add remote validator support to downloader.
2023-01-25 01:12:18 +01:00
Sascha L. Teichmann
c4b70d20cd
Demand Go 1.19 in go.mod. Replaced interface{} with any
2023-01-19 16:45:26 +01:00