Commit graph

15284 commits

Author SHA1 Message Date
Tim Wojtulewicz
3cf68e3868 CI: Install missing packages on opensuse
(cherry picked from commit a3ad1a24f1)
2024-01-18 14:09:51 -08:00
Tim Wojtulewicz
15e5d4aee5 CI: Use other base64 options on macOS Sonoma too
(cherry picked from commit b1e63ffd26)
2024-01-18 14:09:51 -08:00
Tim Wojtulewicz
147fa3b184 CI: Add macOS Sonoma build, remove macOS Monterey build
(cherry picked from commit 35ca1e88c7)
2024-01-18 14:09:51 -08:00
Benjamin Bannier
b169f56098 Fix tests so they work both with GNU and BSD tools
The GNU and BSD versions of `touch` and `truncate` allow slightly
different arguments, change the tests so they work in both versions.

(cherry picked from commit caaffd0324)
2024-01-18 14:09:51 -08:00
Benjamin Bannier
279372b6f9 Install libmaxminddb in macOS CI
(cherry picked from commit dfba2d6df7)
2024-01-18 14:09:51 -08:00
Tim Wojtulewicz
fe7a21874d CI: Pass -A flag to btest for cluster-testing builds
(cherry picked from commit ac7685c679)
2024-01-18 14:09:51 -08:00
Tim Wojtulewicz
80085ba018 CI: Add more logging during docker builds
(cherry picked from commit 3d1380305b)
2024-01-18 14:09:51 -08:00
Christian Kreibich
63a771103a CI: disable Spicy on CentOS 7
Based on 1774a25f00 in master, which mainly
touched QUIC configuration that does not apply here just yet, hence not a
cherry-pick.
2024-01-18 14:09:51 -08:00
Tim Wojtulewicz
23742165f3 CI: Disable spicy on arm_debian11 and opensuse_leap_15_4 builds
These two builds are struggling to complete due to OOM issues. Reducing the
number of CPUs didn't help, so this temporarily disables Spicy from
building on those hosts to reduce the memory usage.

(cherry picked from commit bbf7f34cdc)
2024-01-18 14:09:51 -08:00
Tim Wojtulewicz
a6096cf751 CI: Remove sanitizers resource template
This template was added when the sanitizer builds needed more memory than all
of the other builds. We've since increased the amount of memory that the other
builds use beyond what's requested in this template, so it doesn't make sense
to keep it around.

(cherry picked from commit 4c6c89d863)
2024-01-18 14:09:51 -08:00
Benjamin Bannier
0122d9d934 Enable ccache-backed Spicy JIT for users of developer scripts.
For CI and more general BTest execution we already enabled ccache
previously, but developers using a Spicy build out of the build
directory still needed to manually set up caching.

With this patch we enable it for such cases as well via
`zeek-path-dev.*sh`.

(cherry picked from commit e624c7500e)
2024-01-18 14:09:51 -08:00
Johanna Amann
0388090f08 Add OpenSUSE Leap 15.5 to ci
This also adds 15.4 to the list of distributions that are skipped by
default - let me know if this is not a good idea. I assume that by now
most people will be running 15.5 (15.4 will be EOL in ~3 months).

(cherry picked from commit 4ad2a6ab9a)
2024-01-18 14:07:13 -08:00
Tim Wojtulewicz
637bf5010c Update NEWS for 6.0.3 2024-01-18 15:06:14 -07:00
Tim Wojtulewicz
6cfe41e5ba Update docs submodule 2024-01-17 23:01:01 -07:00
Tim Wojtulewicz
b2429f4def Run clang-format on the branch to fix some issues from patch merges 2024-01-17 11:26:49 -07:00
Tim Wojtulewicz
4deb53bbfb Enable darwin builds for zeek-security repo
(cherry picked from commit c4edd8410e)
2024-01-17 10:01:01 -07:00
Arne Welzel
ce0410f283 OCSP: Open-code unknown revoke reason strings
OpenSSL 3.2.0 knows about more reasons. Add some backwards compatibility.

Reference: 1c8a7f5091
(cherry picked from commit 02d00a1984)
2024-01-12 14:40:52 -07:00
Tim Wojtulewicz
ed40e2e0f9 Revert update to scripts.base.protocols.ssl.ocsp-revoked btest baseline 2024-01-12 13:52:41 -07:00
Tim Wojtulewicz
db7dffdca3 Merge remote-tracking branch 'origin/topic/bbannier/bump-spicy-1.8' into release/6.0
* origin/topic/bbannier/bump-spicy-1.8:
  Bump Spicy to latest LTS release.
2024-01-12 13:33:29 -07:00
Tim Wojtulewicz
a3b5a7a7f8 CI: Remove EOL (and broken) FreeBSD 12 build 2024-01-12 12:39:11 -07:00
Tim Wojtulewicz
0f343ba0c3 Pick up upstream CAF patch for flow::from_steps 2024-01-12 12:22:36 -07:00
Tim Wojtulewicz
1542f3209a Update zeekctl submodule [nomail] 2024-01-12 12:17:04 -07:00
Arne Welzel
fb34ab4a52 Merge remote-tracking branch 'origin/topic/awelzel/3540-known-hosts-expire-time'
* origin/topic/awelzel/3540-known-hosts-expire-time:
  Known: Keep &create_expire on local tables/sets valid

(cherry picked from commit 2ce4823c7a)
2024-01-12 12:15:38 -07:00
Arne Welzel
af5b6b8c13 Merge remote-tracking branch 'origin/topic/awelzel/3523-expiration-iteration-at-termination'
* origin/topic/awelzel/3523-expiration-iteration-at-termination:
  Dict: Invalidate iterators during Clear()

(cherry picked from commit f1e94594f9)
2024-01-12 12:14:45 -07:00
Tim Wojtulewicz
1cb8c0bd42 Update cmake submodule [nomail] 2024-01-12 12:00:05 -07:00
Tim Wojtulewicz
009bbae7c6 Merge remote-tracking branch 'origin/topic/awelzel/smb-unbounded-recent-files-growth'
* origin/topic/awelzel/smb-unbounded-recent-files-growth:
  smb: Fix &read_expire not in effect due to &default=string_set() usage

(cherry picked from commit 5740dbcf20)
2024-01-12 11:46:16 -07:00
Arne Welzel
a2af53cbf9 Merge remote-tracking branch 'origin/topic/awelzel/3453-dnssec-ed448-ed25519'
* origin/topic/awelzel/3453-dnssec-ed448-ed25519:
  DNS: Add Ed25519 and Ed448 enum values to parser

(cherry picked from commit a5a79d3f3a)
2024-01-12 11:34:51 -07:00
Johanna Amann
2b5ac7ce19 Merge remote-tracking branch 'origin/topic/johanna/its-time-to-add-more-tls-extension-types'
* origin/topic/johanna/its-time-to-add-more-tls-extension-types:
  SSL: Add new extension types and ECH test

(cherry picked from commit 3257c0e216)
2024-01-12 11:34:51 -07:00
Arne Welzel
7fbc085c40 Merge remote-tracking branch 'matti/topic/matti/docker-jq'
* matti/topic/matti/docker-jq:
  Add jq to final.Dockerfile

(cherry picked from commit 5ef5733fcc)
2024-01-12 11:20:48 -07:00
Arne Welzel
8ff101273f Merge branch 'topic/xb-anssi/http_signature_body_end_match' of https://github.com/xb-anssi/zeek
* 'topic/xb-anssi/http_signature_body_end_match' of https://github.com/xb-anssi/zeek:
  Let signature framework match HTTP body end
  Test how the signature framework matches HTTP body

(cherry picked from commit 8a13155a41)
2024-01-12 11:19:58 -07:00
Benjamin Bannier
f0e5dda379 Bump Spicy to latest LTS release. 2024-01-12 08:06:36 +01:00
Arne Welzel
87663c4618 Merge remote-tracking branch 'origin/topic/awelzel/release-6.0-openssl-include-dir' into release/6.0
* origin/topic/awelzel/release-6.0-openssl-include-dir:
  CMakeLists: Fix OPENSSL_INCLUDE_DIR reference
2023-11-23 10:02:39 +01:00
Arne Welzel
afa164984b CMakeLists: Fix OPENSSL_INCLUDE_DIR reference
Seems the intention was to always add OPENSSL_INCLUDE_DIR to the
zeek_dynamic_plugin_base target, but finding of the OpenSSL package
and setting OPENSSL_INCLUDE_DIR happens much later, so this was never
functional.

Relates to #3408 - this is the fix for Zeek 6.0.3, #3420 is the
better fix for the future.
2023-11-22 10:25:21 +01:00
Tim Wojtulewicz
dbaa9bf33d Update CHANGES, VERSION, and NEWS for 6.0.2 release 2023-10-27 11:37:26 -07:00
Tim Wojtulewicz
e57bbf6ff6 Update docs submodule for 6.0.2 release [nomail] [skip ci] 2023-10-27 11:35:15 -07:00
Tim Wojtulewicz
ed9eddabb5 Merge remote-tracking branch 'security/topic/timw/6.0.2-patches' into release/6.0
* security/topic/timw/6.0.2-patches:
  ftp: Do not base seq on number of pending commands
  ssl: Prevent unbounded ssl_history growth
  ssl: Cap number of alerts parsed from SSL record
  X509Common/SCT parsing: Fix memory leak in error case
  IEEE802_11: Fix buffer-overflow due to not accounting for the amsdu header
2023-10-27 10:53:27 -07:00
Tim Wojtulewicz
fe4aa31b5f Merge remote-tracking branch 'origin/topic/bbannier/bump-spicy-6.0' into release/6.0
* origin/topic/bbannier/bump-spicy-6.0:
  Bump auxil/spicy to latest 1.8 release
2023-10-26 08:52:12 -07:00
Benjamin Bannier
8af0200f4a Bump auxil/spicy to latest 1.8 release 2023-10-26 14:16:18 +02:00
Arne Welzel
b745556d36 ftp: Do not base seq on number of pending commands
Previously, seq was computed as the result of |pending_commands|+1. This
opened the possibility to override queued commands, as well as logging
the same pending ftp reply multiple times.

For example, when commands 1, 2, 3 are pending, command 1 may be dequeued,
but the incoming command then receives seq 3 and overrides the already
pending command 3. The second scenario happens when ftp_reply() selected
command 3 as pending for logging, but is then followed by many ftp_request()
events. This resulted in command 3's response being logged for every
following ftp_request() over and over again.

Avoid both scenarios by tracking the command sequence as an absolute counter.
2023-10-25 10:05:09 -07:00
Arne Welzel
f6615753f1 ssl: Prevent unbounded ssl_history growth
The previous fix also made it clear that the ssl_history field may grow
unbounded via the ssl_alert event. Prevent by capping using a configurable
limit (default 100) and raise a weird once reached.
2023-10-25 10:05:09 -07:00
Arne Welzel
da91cee022 ssl: Cap number of alerts parsed from SSL record
Limit the number of events raised from an SSL record with content_type
alert (21) to a configurable maximum number (default 10). For TLS 1.3,
the limit is set to 1 as specified in the RFC. Add a new weird for the
in cases where the limit is exceeded.

OSS-Fuzz managed to generate a reproducer that raised ~660k ssl_plaintext
and ssl_alert events together given ~810kb of input data. This prevents
it with hopefully no negative side-effect in the real-world.
2023-10-25 10:05:09 -07:00
Arne Welzel
3933102c84 X509Common/SCT parsing: Fix memory leak in error case
Failed to free the copy of the OCSP extension's value the inner
octet string couldn't be parsed.
2023-10-24 18:05:06 -07:00
Arne Welzel
72a54376bc IEEE802_11: Fix buffer-overflow due to not accounting for the amsdu header
The fuzzer generated input where data length left was 14 and the amsdu_len
field set to 14. That caused buffer overread due not taking into account
the amsdu header length of 14.
2023-10-24 18:02:56 -07:00
Tim Wojtulewicz
63391d974a Updating CHANGES and VERSION. 2023-10-24 14:53:13 -07:00
Tim Wojtulewicz
506fd92ec7 Update cmake submodule for caching fix [nomail] 2023-10-24 14:51:14 -07:00
Arne Welzel
65f8222b92 Merge remote-tracking branch 'origin/topic/awelzel/mmdb-fix-and-tests'
* origin/topic/awelzel/mmdb-fix-and-tests:
  base/frameworks/spicy: Do not load base/misc/version
  btest/core/mmdb: Basic lookup_autonomous_system / lookup_location tests
  btest/files: Add mmdb testing databases and generator code
  zeek.bif: Switch mmdb stale check to network_time
  Fix mmdb pointer destruction

(cherry picked from commit 44b67894ac)
2023-10-24 13:49:25 -07:00
Arne Welzel
4d80668f1f Merge remote-tracking branch 'origin/topic/awelzel/3190-supervisor-eventmgr-shared-pipe-fix'
* origin/topic/awelzel/3190-supervisor-eventmgr-shared-pipe-fix:
  event: Reinitialize EventMgr's flare after fork() from stem

(cherry picked from commit 22fb445a7f)
2023-10-24 13:34:11 -07:00
Tim Wojtulewicz
143f112a5c Bump libunistd submodule to get poll() implementation 2023-10-17 09:05:32 -07:00
Tim Wojtulewicz
c6c5650e88 Updating CHANGES and VERSION. 2023-10-16 13:39:30 -07:00
Tim Wojtulewicz
e778daa9af Update zeekjs submodule to v0.9.6 [nomail] 2023-10-16 13:32:12 -07:00