koplas
9275a37a9f
Format
2025-01-08 08:50:30 +01:00
koplas
b8a5fa72d5
Fix nil check in downloader
2025-01-08 08:49:42 +01:00
koplas
a51964be3f
Add initial csaf_checker provider test
2024-12-04 16:02:03 +01:00
koplas
56509bbb4d
Use new path in tests
2024-11-27 12:51:38 +01:00
koplas
a5f4b10c4e
Merge branch 'main' into sha-handling
2024-11-27 12:39:14 +01:00
koplas
ffb4eff933
Merge unittest into sha-handling
...
commit 990c74a1a6
Merge: 86d7ce1 7824f3b
Author: koplas <pschwabauer@intevation.de>
Date: Fri Nov 22 16:58:46 2024 +0100
Merge branch 'sha-handling' into unittest
commit 86d7ce13dc
Merge: a6807d2 79b8900
Author: koplas <pschwabauer@intevation.de>
Date: Fri Nov 22 16:54:45 2024 +0100
Merge branch 'sha-handling' into unittest
commit 79b89009dd
Author: koplas <pschwabauer@intevation.de>
Date: Fri Nov 22 16:31:56 2024 +0100
Improve hash fetching and logging
commit a6807d24d6
Merge: ddb5518 d18d2c3
Author: koplas <pschwabauer@intevation.de>
Date: Fri Nov 22 16:51:55 2024 +0100
Merge branch 'sha-handling' into unittest
commit d18d2c3bf1
Author: koplas <pschwabauer@intevation.de>
Date: Fri Nov 22 16:31:56 2024 +0100
Improve hash fetching and logging
commit ddb5518c6d
Author: koplas <54645365+koplas@users.noreply.github.com>
Date: Tue Sep 17 10:45:25 2024 +0200
Extend SHA marking tests
commit 13c94f4fa0
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 20:46:31 2024 +0200
Use temp directory for downloads
commit 1819b4896b
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 20:37:55 2024 +0200
Fix rolie feed
commit 989e3667ba
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 20:23:22 2024 +0200
Fix provider-metadata.json
commit 714735d74a
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 20:08:21 2024 +0200
Implement provider handler
commit d488e39947
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 16:26:37 2024 +0200
Add info about gpg key
commit a9bf9da130
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 16:12:49 2024 +0200
Rename directory testdata
commit 6ca6dfee25
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 16:01:41 2024 +0200
Add initial downloader tests
commit 20bee797c6
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 15:58:31 2024 +0200
Fix: Remove unecessary error print
commit 8e4e508073
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 14:50:48 2024 +0200
Extend links test
commit 3ba29f94de
Author: koplas <pschwabauer@intevation.de>
Date: Mon Sep 16 14:11:14 2024 +0200
Add initial directory feed testdata
commit dee55aafd9
Author: koplas <54645365+koplas@users.noreply.github.com>
Date: Mon Sep 16 10:47:32 2024 +0200
Add initial testdata
commit cd9338ae72
Author: koplas <54645365+koplas@users.noreply.github.com>
Date: Thu Sep 12 15:54:42 2024 +0200
Add initial download unittests
2024-11-27 12:15:21 +01:00
koplas
7824f3b48d
Improve hash fetching and logging
2024-11-22 16:56:58 +01:00
koplas
c00dc36547
Remove -h for preferred hash configuration
...
This option was in conflict with the help display.
2024-11-21 12:31:58 +01:00
Bernhard Reiter
e8706e5eb9
feat: perform go path repo move
...
* Change the go module path
from github.com/csaf-poc/csaf_distribution to github.com/gocsaf/csaf.
* Rename archive for release tarballs.
* Adjust testing scripts and documentation.
2024-11-04 13:20:47 +01:00
JanHoefelmeyer
464e88b530
Merge pull request #571 from csaf-poc/fingerprint-no-breaking
...
Improve PGP fingerprint handling
2024-09-09 11:51:09 +02:00
koplas
37c9eaf346
Add CLI flags to specify what hash is preferred
2024-09-09 10:35:41 +02:00
koplas
c2e24f7bbb
Remove check for empty fingerprint
...
The schema validation already catches this error and this check will
never run.
2024-09-06 18:21:25 +02:00
koplas
9037574d96
Improve PGP fingerprint handling
...
Warn if no fingerprint is specified and give more details, if
fingerprint comparison fails.
Closes #555
2024-08-08 12:42:19 +02:00
koplas
be2e4e7424
Improve hash path handling of directory feeds
2024-07-31 11:42:45 +02:00
koplas
0ab851a874
Use a default user agent
2024-07-31 10:16:08 +02:00
koplas
a131b0fb4b
Improve SHA* marking
2024-07-25 15:39:40 +02:00
Marius Goetze
bcf4d2f64a
fix error message
...
The error message had a trailing `:` which suggest that there are some details which were truncated. However the details are already printed before in the log.
2024-07-16 12:00:09 +02:00
Marius Goetze
1e531de82d
fix: don't require debug level to print error details on failed loading of provider metadata json
2024-07-15 14:22:15 +02:00
Sascha L. Teichmann
5c6736b178
Remove data races in downloader caused by shared use of json path eval. ( #547 )
2024-06-24 11:57:38 +02:00
Bernhard Herzog
617deb4c17
Merge pull request #530 from oxisto/slog
...
Added support for structured logging in `csaf_aggregator`
2024-04-25 13:13:11 +02:00
Immanuel Kunz
c704275a38
Merge branch 'csaf-poc:main' into main
2024-04-25 09:42:51 +02:00
Kunz, Immanuel
684770ff2e
fix typo, fix linting errors
2024-04-24 17:53:47 +02:00
Kunz, Immanuel
005e661479
add config flag to use enumerate-only
2024-04-23 20:24:18 +02:00
Kunz, Immanuel
457d519990
minor updates to Enumerate method, integrate enumerate in cmd downloader
2024-04-23 19:09:22 +02:00
Christian Banse
9b1480ae3d
Bumped Go version to Go 1.21. Using log/slog instead of golang.org/x/exp/slog
2024-04-23 15:37:43 +02:00
Kunz, Immanuel
d64aa20cee
first draft for downloader using enumerate
2024-04-22 17:53:45 +02:00
JanHoefelmeyer
39a29e39f1
Change Licenses from MIT to Apache 2.0
2024-04-22 13:11:30 +02:00
Sascha L. Teichmann
91ab7f6b1c
Chance supported minimal Go version back to 1.20 ( #514 )
2023-11-28 10:37:16 +01:00
Sascha L. Teichmann
6f8870154c
Break overly long line. Fix typo in comment.
2023-11-20 21:13:24 +01:00
JanHoefelmeyer
a413852627
Downloader: Only add tlp label to path if no custom directory is configured. Refactor accordingly
2023-11-20 11:05:57 +01:00
JanHoefelmeyer
086c4ab48b
Convert a lot of command line arguments to snake case ( #498 )
...
* Convert a lot of variables to snake case
* Add snakecase for variables made out of two words that had it in no version yet (for consistency)
* Adjust example files too
---------
Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
2023-11-06 14:33:05 +01:00
Sascha L. Teichmann
8f6e6ee8bb
improve logging output
2023-10-17 18:52:38 +02:00
Bernhard Reiter
3923dc7044
fix: improve logging for downloader and aggregator
...
* use full name for printing out the used logfile for the downloader.
* for debug or verbose, log the timeintervall that will be used
for downloader and aggregator. (The checker has this as part
of its output already.)
2023-10-17 11:33:03 +02:00
Sascha L. Teichmann
1cc42f0ec0
Downloader: unit test forwarder ( #470 )
...
* Simplify forward method
* Add unit test for validation status
* Add unit test for stats logging in forwarder.
* Add unit test for http client creation.
* Add unit test for replaceExt
* Add unit test for buildRequest
* Add unit test for limitedString
* Add unit test for storeFailedAdvisory
* Add unit test for storeFailedAdvisory ... fixed
* Add unit test for storeFailed
* Add unit test for forward
* comment wording
2023-09-29 09:46:51 +02:00
Sascha L. Teichmann
7a8cdb6d19
Lift distribution from v2 to v3. ( #467 )
...
* v2 -> v3
* Increase version within Makefile
---------
Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
2023-09-27 15:46:57 +02:00
JanHoefelmeyer
37f770ed3d
Merge pull request #463 from csaf-poc/downloader-unit-tests
...
Downloader: unit tests for stats
2023-09-27 12:16:05 +02:00
Sascha L. Teichmann
7cd076d4f8
Downloader: Remove verbose flag ( #464 )
...
* Remove verbose flag from downloader.
* Do structured http logging in forwarder, too.
* Use structured logging to separate http traffic of downloader from forwarder.
2023-09-27 11:30:24 +02:00
cintek
49da14d47f
feat: log redirects ( #458 )
...
* feat: log redirects
* improved logging and renamed function
2023-09-26 10:03:09 +02:00
Sascha L. Teichmann
fca3f5bb9b
Fix stats unit test.
2023-09-25 23:32:19 +02:00
Sascha L. Teichmann
b0d7dbb387
Add unit test for stats.
2023-09-25 23:23:28 +02:00
Sascha L. Teichmann
24151345f5
Drop time precision below seconds in log output. ( #450 )
2023-08-31 17:07:34 +02:00
Sascha L. Teichmann
018e0e55f7
Fix downloader logging docs and some comments. ( #447 )
2023-08-29 10:24:02 +02:00
Sascha L. Teichmann
5459f10d39
Downloader: Add structured logging, fails storing and statistics
...
* add forwarding support in downloader
* Raise needed Go version to 1.21+ so slog can be used.
* Introduce validation mode flag (strict, unsafe)
* Add structured logging and place log into the download folder.
* Improve some code comment (bernhardreiter)
* Add counting stats to downloader.
2023-08-28 15:03:01 +02:00
Sascha L. Teichmann
e0475791ff
Downloader: Add forwarding to HTTP endpoint ( #442 )
...
* started with forwarding support in downloader
* Add missing files.
* Add missing files.
* Raise needed Go version
* More Go version bumping.
* Fix forwarding
* Go 1.21+ needed
* Make terminating forwarder more robust.
* Better var naming
* Remove dead code. Improve commentary.
* Prepare validation status adjustment.
* Move validations to functions to make them executable in a loop.
* Introduce validation mode flag (strict, unsafe)
2023-08-25 10:31:27 +02:00
Sascha L. Teichmann
a153906d03
Document that client-passphrase option is experimental
...
* Label the option experimental and limited at all places.
* Point to the downloader documentation as single point to write more.
* Add more hints on how the old PEM block encryption is experimental
and why it often shall not be used.
---------
Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
2023-08-18 11:24:39 +02:00
Sascha L. Teichmann
a7be72b740
Merge branch 'main' into downloader-client-certs
2023-08-16 11:23:14 +02:00
Bernhard Reiter
6276866cad
Merge branch 'main' into download-ignore-pattern
...
* Improve some text parts during the merge.
2023-08-16 08:59:42 +02:00
Sascha L. Teichmann
8c95795b96
Add option to specify download folder
...
* Add an option to downloader to store advisories into a given subfolder.
---------
Co-authored-by: JanHoefelmeyer <hoefelmeyer.jan@gmail.com>
Co-authored-by: Bernhard Reiter <bernhard@intevation.de>
2023-08-16 08:45:34 +02:00
Sascha L. Teichmann
d42db07bec
Fix version config and make aggreator use new command line parser. ( #416 )
...
* Fix version config and make aggreator use new command line parser.
* Replace old error check with check from the library.
2023-08-15 17:54:56 +02:00
Sascha L. Teichmann
f31ee53c27
Add client certificate support to the downloader
2023-08-02 21:16:32 +02:00