Commit graph

15276 commits

Author SHA1 Message Date
Tim Wojtulewicz
23742165f3 CI: Disable spicy on arm_debian11 and opensuse_leap_15_4 builds
These two builds are struggling to complete due to OOM issues. Reducing the
number of CPUs didn't help, so this temporarily disables Spicy from
building on those hosts to reduce the memory usage.

(cherry picked from commit bbf7f34cdc)
2024-01-18 14:09:51 -08:00
Tim Wojtulewicz
a6096cf751 CI: Remove sanitizers resource template
This template was added when the sanitizer builds needed more memory than all
of the other builds. We've since increased the amount of memory that the other
builds use beyond what's requested in this template, so it doesn't make sense
to keep it around.

(cherry picked from commit 4c6c89d863)
2024-01-18 14:09:51 -08:00
Benjamin Bannier
0122d9d934 Enable ccache-backed Spicy JIT for users of developer scripts.
For CI and more general BTest execution we already enabled ccache
previously, but developers using a Spicy build out of the build
directory still needed to manually set up caching.

With this patch we enable it for such cases as well via
`zeek-path-dev.*sh`.

(cherry picked from commit e624c7500e)
2024-01-18 14:09:51 -08:00
Johanna Amann
0388090f08 Add OpenSUSE Leap 15.5 to ci
This also adds 15.4 to the list of distributions that are skipped by
default - let me know if this is not a good idea. I assume that by now
most people will be running 15.5 (15.4 will be EOL in ~3 months).

(cherry picked from commit 4ad2a6ab9a)
2024-01-18 14:07:13 -08:00
Tim Wojtulewicz
637bf5010c Update NEWS for 6.0.3 2024-01-18 15:06:14 -07:00
Tim Wojtulewicz
6cfe41e5ba Update docs submodule 2024-01-17 23:01:01 -07:00
Tim Wojtulewicz
b2429f4def Run clang-format on the branch to fix some issues from patch merges 2024-01-17 11:26:49 -07:00
Tim Wojtulewicz
4deb53bbfb Enable darwin builds for zeek-security repo
(cherry picked from commit c4edd8410e)
2024-01-17 10:01:01 -07:00
Arne Welzel
ce0410f283 OCSP: Open-code unknown revoke reason strings
OpenSSL 3.2.0 knows about more reasons. Add some backwards compatibility.

Reference: 1c8a7f5091
(cherry picked from commit 02d00a1984)
2024-01-12 14:40:52 -07:00
Tim Wojtulewicz
ed40e2e0f9 Revert update to scripts.base.protocols.ssl.ocsp-revoked btest baseline 2024-01-12 13:52:41 -07:00
Tim Wojtulewicz
db7dffdca3 Merge remote-tracking branch 'origin/topic/bbannier/bump-spicy-1.8' into release/6.0
* origin/topic/bbannier/bump-spicy-1.8:
  Bump Spicy to latest LTS release.
2024-01-12 13:33:29 -07:00
Tim Wojtulewicz
a3b5a7a7f8 CI: Remove EOL (and broken) FreeBSD 12 build 2024-01-12 12:39:11 -07:00
Tim Wojtulewicz
0f343ba0c3 Pick up upstream CAF patch for flow::from_steps 2024-01-12 12:22:36 -07:00
Tim Wojtulewicz
1542f3209a Update zeekctl submodule [nomail] 2024-01-12 12:17:04 -07:00
Arne Welzel
fb34ab4a52 Merge remote-tracking branch 'origin/topic/awelzel/3540-known-hosts-expire-time'
* origin/topic/awelzel/3540-known-hosts-expire-time:
  Known: Keep &create_expire on local tables/sets valid

(cherry picked from commit 2ce4823c7a)
2024-01-12 12:15:38 -07:00
Arne Welzel
af5b6b8c13 Merge remote-tracking branch 'origin/topic/awelzel/3523-expiration-iteration-at-termination'
* origin/topic/awelzel/3523-expiration-iteration-at-termination:
  Dict: Invalidate iterators during Clear()

(cherry picked from commit f1e94594f9)
2024-01-12 12:14:45 -07:00
Tim Wojtulewicz
1cb8c0bd42 Update cmake submodule [nomail] 2024-01-12 12:00:05 -07:00
Tim Wojtulewicz
009bbae7c6 Merge remote-tracking branch 'origin/topic/awelzel/smb-unbounded-recent-files-growth'
* origin/topic/awelzel/smb-unbounded-recent-files-growth:
  smb: Fix &read_expire not in effect due to &default=string_set() usage

(cherry picked from commit 5740dbcf20)
2024-01-12 11:46:16 -07:00
Arne Welzel
a2af53cbf9 Merge remote-tracking branch 'origin/topic/awelzel/3453-dnssec-ed448-ed25519'
* origin/topic/awelzel/3453-dnssec-ed448-ed25519:
  DNS: Add Ed25519 and Ed448 enum values to parser

(cherry picked from commit a5a79d3f3a)
2024-01-12 11:34:51 -07:00
Johanna Amann
2b5ac7ce19 Merge remote-tracking branch 'origin/topic/johanna/its-time-to-add-more-tls-extension-types'
* origin/topic/johanna/its-time-to-add-more-tls-extension-types:
  SSL: Add new extension types and ECH test

(cherry picked from commit 3257c0e216)
2024-01-12 11:34:51 -07:00
Arne Welzel
7fbc085c40 Merge remote-tracking branch 'matti/topic/matti/docker-jq'
* matti/topic/matti/docker-jq:
  Add jq to final.Dockerfile

(cherry picked from commit 5ef5733fcc)
2024-01-12 11:20:48 -07:00
Arne Welzel
8ff101273f Merge branch 'topic/xb-anssi/http_signature_body_end_match' of https://github.com/xb-anssi/zeek
* 'topic/xb-anssi/http_signature_body_end_match' of https://github.com/xb-anssi/zeek:
  Let signature framework match HTTP body end
  Test how the signature framework matches HTTP body

(cherry picked from commit 8a13155a41)
2024-01-12 11:19:58 -07:00
Benjamin Bannier
f0e5dda379 Bump Spicy to latest LTS release. 2024-01-12 08:06:36 +01:00
Arne Welzel
87663c4618 Merge remote-tracking branch 'origin/topic/awelzel/release-6.0-openssl-include-dir' into release/6.0
* origin/topic/awelzel/release-6.0-openssl-include-dir:
  CMakeLists: Fix OPENSSL_INCLUDE_DIR reference
2023-11-23 10:02:39 +01:00
Arne Welzel
afa164984b CMakeLists: Fix OPENSSL_INCLUDE_DIR reference
Seems the intention was to always add OPENSSL_INCLUDE_DIR to the
zeek_dynamic_plugin_base target, but finding of the OpenSSL package
and setting OPENSSL_INCLUDE_DIR happens much later, so this was never
functional.

Relates to #3408 - this is the fix for Zeek 6.0.3, #3420 is the
better fix for the future.
2023-11-22 10:25:21 +01:00
Tim Wojtulewicz
dbaa9bf33d Update CHANGES, VERSION, and NEWS for 6.0.2 release 2023-10-27 11:37:26 -07:00
Tim Wojtulewicz
e57bbf6ff6 Update docs submodule for 6.0.2 release [nomail] [skip ci] 2023-10-27 11:35:15 -07:00
Tim Wojtulewicz
ed9eddabb5 Merge remote-tracking branch 'security/topic/timw/6.0.2-patches' into release/6.0
* security/topic/timw/6.0.2-patches:
  ftp: Do not base seq on number of pending commands
  ssl: Prevent unbounded ssl_history growth
  ssl: Cap number of alerts parsed from SSL record
  X509Common/SCT parsing: Fix memory leak in error case
  IEEE802_11: Fix buffer-overflow due to not accounting for the amsdu header
2023-10-27 10:53:27 -07:00
Tim Wojtulewicz
fe4aa31b5f Merge remote-tracking branch 'origin/topic/bbannier/bump-spicy-6.0' into release/6.0
* origin/topic/bbannier/bump-spicy-6.0:
  Bump auxil/spicy to latest 1.8 release
2023-10-26 08:52:12 -07:00
Benjamin Bannier
8af0200f4a Bump auxil/spicy to latest 1.8 release 2023-10-26 14:16:18 +02:00
Arne Welzel
b745556d36 ftp: Do not base seq on number of pending commands
Previously, seq was computed as the result of |pending_commands|+1. This
opened the possibility to override queued commands, as well as logging
the same pending ftp reply multiple times.

For example, when commands 1, 2, 3 are pending, command 1 may be dequeued,
but the incoming command then receives seq 3 and overrides the already
pending command 3. The second scenario happens when ftp_reply() selected
command 3 as pending for logging, but is then followed by many ftp_request()
events. This resulted in command 3's response being logged for every
following ftp_request() over and over again.

Avoid both scenarios by tracking the command sequence as an absolute counter.
2023-10-25 10:05:09 -07:00
Arne Welzel
f6615753f1 ssl: Prevent unbounded ssl_history growth
The previous fix also made it clear that the ssl_history field may grow
unbounded via the ssl_alert event. Prevent by capping using a configurable
limit (default 100) and raise a weird once reached.
2023-10-25 10:05:09 -07:00
Arne Welzel
da91cee022 ssl: Cap number of alerts parsed from SSL record
Limit the number of events raised from an SSL record with content_type
alert (21) to a configurable maximum number (default 10). For TLS 1.3,
the limit is set to 1 as specified in the RFC. Add a new weird for the
in cases where the limit is exceeded.

OSS-Fuzz managed to generate a reproducer that raised ~660k ssl_plaintext
and ssl_alert events together given ~810kb of input data. This prevents
it with hopefully no negative side-effect in the real-world.
2023-10-25 10:05:09 -07:00
Arne Welzel
3933102c84 X509Common/SCT parsing: Fix memory leak in error case
Failed to free the copy of the OCSP extension's value the inner
octet string couldn't be parsed.
2023-10-24 18:05:06 -07:00
Arne Welzel
72a54376bc IEEE802_11: Fix buffer-overflow due to not accounting for the amsdu header
The fuzzer generated input where data length left was 14 and the amsdu_len
field set to 14. That caused buffer overread due not taking into account
the amsdu header length of 14.
2023-10-24 18:02:56 -07:00
Tim Wojtulewicz
63391d974a Updating CHANGES and VERSION. 2023-10-24 14:53:13 -07:00
Tim Wojtulewicz
506fd92ec7 Update cmake submodule for caching fix [nomail] 2023-10-24 14:51:14 -07:00
Arne Welzel
65f8222b92 Merge remote-tracking branch 'origin/topic/awelzel/mmdb-fix-and-tests'
* origin/topic/awelzel/mmdb-fix-and-tests:
  base/frameworks/spicy: Do not load base/misc/version
  btest/core/mmdb: Basic lookup_autonomous_system / lookup_location tests
  btest/files: Add mmdb testing databases and generator code
  zeek.bif: Switch mmdb stale check to network_time
  Fix mmdb pointer destruction

(cherry picked from commit 44b67894ac)
2023-10-24 13:49:25 -07:00
Arne Welzel
4d80668f1f Merge remote-tracking branch 'origin/topic/awelzel/3190-supervisor-eventmgr-shared-pipe-fix'
* origin/topic/awelzel/3190-supervisor-eventmgr-shared-pipe-fix:
  event: Reinitialize EventMgr's flare after fork() from stem

(cherry picked from commit 22fb445a7f)
2023-10-24 13:34:11 -07:00
Tim Wojtulewicz
143f112a5c Bump libunistd submodule to get poll() implementation 2023-10-17 09:05:32 -07:00
Tim Wojtulewicz
c6c5650e88 Updating CHANGES and VERSION. 2023-10-16 13:39:30 -07:00
Tim Wojtulewicz
e778daa9af Update zeekjs submodule to v0.9.6 [nomail] 2023-10-16 13:32:12 -07:00
Tim Wojtulewicz
190df38f12 Updating CHANGES and VERSION. 2023-10-16 13:30:20 -07:00
Benjamin Bannier
3d2c69a13b Merge branch 'origin/topic/bbannier/spicy-reject_protocol-during-teardown'
(cherry picked from commit 03597d210d)
2023-10-16 13:27:18 -07:00
Tim Wojtulewicz
64f96e0a78 Updating CHANGES and VERSION. 2023-10-16 13:25:10 -07:00
Tim Wojtulewicz
6de304e0dd Merge remote-tracking branch 'origin/topic/awelzel/3309-dns-mgr-revents-ouch'
* origin/topic/awelzel/3309-dns-mgr-revents-ouch:
  DNS_Mgr: Fix | vs & for pollfd.revents

(cherry picked from commit 0424eefd96)
2023-10-16 13:23:01 -07:00
Arne Welzel
7291ac4f26 DNS_Mgr: Replace ares_fds() with ares_getsock()
On Slack, a user reported "fortify source" aborts within ares_fds() due
to the FDs used by c-ares exceeding 1024 and thereby larger than the
maximum fd value that a fd_set can hold.

Switch to ares_get_socks() and poll() to avoid this.

Closes #3309.

(cherry picked from commit c4c4a23bfd)
2023-10-16 13:22:14 -07:00
Tim Wojtulewicz
526e0ae0ad Update cmake submodule [nomail] 2023-10-16 13:21:18 -07:00
Arne Welzel
651b208937 Merge remote-tracking branch 'origin/topic/bbannier/issue-3279'
* origin/topic/bbannier/issue-3279:
  Fix handling of module scope when checking exported Spicy types for collisions

(cherry picked from commit 30dc6af831)
2023-10-16 13:15:40 -07:00
Tim Wojtulewicz
b6090f1fe6 Merge remote-tracking branch 'origin/topic/bbannier/bump-spicy-6.0' into release/6.0
* origin/topic/bbannier/bump-spicy-6.0:
  Bump auxil/spicy to latest 1.8 development snapshot
2023-10-13 12:59:21 -07:00