Commit graph

16273 commits

Author SHA1 Message Date
zeek-bot
151a4999a3 Update doc submodule [nomail] [skip ci] 2023-09-07 00:22:26 +00:00
Benjamin Bannier
d7c3e0ac69 Propagate failure reason in spicy::decline_input/zeek::reject_protocol.
Closes #3276.
2023-09-06 10:32:11 +02:00
Arne Welzel
1441b83411 Merge remote-tracking branch 'origin/topic/awelzel/dns-mgr-fixes'
* origin/topic/awelzel/dns-mgr-fixes:
  DNS_Mgr: Use Process() for timeout expiration
  DNS_Mgr: Fix GetNextTimeout() returning absolute values
2023-09-05 19:57:10 +02:00
Arne Welzel
a57c45428f DNS_Mgr: Use Process() for timeout expiration
DNS_Mgr has a GetNextTimeout() implementation that may return 0.0. When
that is the case, its IO source is enqueued as ready with an fd of -1.
This in turn results in Process() being called instead of ProcessFd()
in RunState.cc.

Ensure timeouts behavior is properly handled by actually forwarding
timeout indications to c-ares via DNS_Mgr::Process(). This results
in pending DNS queries for which a timeout happened to actually
timeout (when there's no other connectivity).
2023-09-04 18:09:40 +02:00
Arne Welzel
62c06f7e3a DNS_Mgr: Fix GetNextTimeout() returning absolute values
Not sure, must have been some sort of left-over, but wasn't really
effective due to Process() not being implemented.
2023-09-04 17:50:15 +02:00
Arne Welzel
7e11501d3c Merge remote-tracking branch 'origin/topic/jazoff/gh-3268t '
* origin/topic/jazoff/gh-3268:
  Fix check for emailed notices

Changes: Added a test-case printing email_delay_tokens to compare email vs
non-email notice types. Previously, both notice types would have email
delay tokens at that point in the flow.
2023-09-04 14:01:23 +02:00
zeek-bot
7a04dad95c Update doc submodule [nomail] [skip ci] 2023-09-02 00:20:12 +00:00
Vern Paxson
a36c06e5cd fix for ZAM statement-level profiling (broken by GH-3199) 2023-09-01 12:20:46 -07:00
Vern Paxson
e78570ad89 ZAM fixes for compatibility with GH-3249 changes 2023-09-01 12:20:35 -07:00
Vern Paxson
80eed34985 -O gen-C++ fixes for compatibility with GH-3249 changes
minor -O gen-C++ BTest updates
2023-09-01 12:17:38 -07:00
Vern Paxson
85cd1d69a4 minor BTest reordering to diminish differences with script optimization 2023-09-01 12:17:06 -07:00
Justin Azoff
047232df37 Fix check for emailed notices
This bug was introduced in 9d0bd96
2023-09-01 13:23:45 -04:00
Arne Welzel
14a2c02f9d Merge remote-tracking branch 'origin/topic/awelzel/1705-http-pending-requests'
* origin/topic/awelzel/1705-http-pending-requests:
  http: Prevent request/response de-synchronization and unbounded state growth
2023-09-01 11:54:10 +02:00
Arne Welzel
4b71b7d05c Merge branch 'topic/awelzel/no-telemetry-log-in-external-baselines'
* topic/awelzel/no-telemetry-log-in-external-baselines:
  testing/external: Exclude telemetry.log from baselines
2023-08-30 11:25:39 +02:00
Arne Welzel
e12e873461 testing/external: Exclude telemetry.log from baselines
The diffs produced by telemetry.log when introducing a weird or
removing/adding protocol specific logs is overwhelming and distracting
without providing value. Exclude telemetry.log similar to how we already
exclude stats.log.

Some more targeted telemetry.log tests exists in the normal testing/btest
suite and that appears more sensible.
2023-08-30 10:49:46 +02:00
Tim Wojtulewicz
19719b1862 Merge remote-tracking branch 'origin/topic/neverlord/gh-3247'
* origin/topic/neverlord/gh-3247:
  Forward OpenSSL include path to plugins
2023-08-29 12:14:04 -07:00
Tim Wojtulewicz
c9f4bacd73 Revert "Merge remote-tracking branch 'origin/topic/neverlord/gh-3247'"
This reverts commit 1673f1db05, reversing
changes made to 619113f674.
2023-08-29 12:13:40 -07:00
Tim Wojtulewicz
1673f1db05 Merge remote-tracking branch 'origin/topic/neverlord/gh-3247'
* origin/topic/neverlord/gh-3247:
  Forward OpenSSL include path to plugins
2023-08-29 12:07:56 -07:00
Dominik Charousset
f60a208b8d Forward OpenSSL include path to plugins 2023-08-29 20:05:41 +02:00
Tim Wojtulewicz
619113f674 Merge remote-tracking branch 'origin/topic/timw/remove-ubuntu-22-10'
* origin/topic/timw/remove-ubuntu-22-10:
  CI: Add ubuntu 23.04 build
  CI: Remove EOL ubuntu 22.10 build
2023-08-29 09:11:42 -07:00
Tim Wojtulewicz
ac82d4bcbd CI: Add ubuntu 23.04 build 2023-08-29 09:11:07 -07:00
Tim Wojtulewicz
b551bc9fc3 CI: Remove EOL ubuntu 22.10 build 2023-08-29 09:11:07 -07:00
Arne Welzel
c1edf2e276 Merge remote-tracking branch 'origin/topic/awelzel/pre-commit-autoupdate'
* origin/topic/awelzel/pre-commit-autoupdate:
  pre-commit: autoupdate
2023-08-29 09:39:20 +02:00
Arne Welzel
f766669b73 pre-commit: autoupdate
...except for clang-format, because versions after v13.0.0 have
borked the Whitesmith formatting. Also moves yapf from
pre-commit/mirrors-yapf to google/yapf.
2023-08-29 09:38:06 +02:00
zeek-bot
f4de133c12 Update doc submodule [nomail] [skip ci] 2023-08-29 00:28:06 +00:00
Dominik Charousset
80846a7971 Forward OpenSSL include path to plugins 2023-08-28 20:25:08 +02:00
Arne Welzel
d81cb9d10e Merge remote-tracking branch 'origin/topic/awelzel/ditch-file-krb-include'
* origin/topic/awelzel/ditch-file-krb-include:
  cmake: Bump submodule for removal of NEED_KRB5_H
  zeek-config.h: Drop NEED_KRB5_H
  File: Drop krb5.h include
2023-08-28 20:08:01 +02:00
Tim Wojtulewicz
9c15a2f6a6 Merge remote-tracking branch 'origin/topic/vern/trigger-constructor'
* origin/topic/vern/trigger-constructor:
  change Trigger constructor to not potentially auto-delete itself
2023-08-28 10:54:06 -07:00
Vern Paxson
e8f4e54475 change Trigger constructor to not potentially auto-delete itself 2023-08-28 10:17:26 -07:00
Arne Welzel
af1714853f http: Prevent request/response de-synchronization and unbounded state growth
When http_reply events are received before http_request events, either
through faking traffic or possible re-ordering, it is possible to trigger
unbounded state growth due to later http_requests never being matched
again with responses.

Prevent this by synchronizing request/response counters when late
requests come in.

Also forcefully flush pending requests when http_replies are never
observed either due to the analyzer having been disabled or because
half-duplex traffic.

Fixes #1705
2023-08-28 15:02:58 +02:00
Arne Welzel
8c2a9ec5f5 Update doc, cmake submodules for installing .spicy files 2023-08-28 12:57:21 +02:00
Arne Welzel
a84d6cd66c Merge branch 'topic/awelzel/3235-dont-flip-broadcasts'
* topic/awelzel/3235-dont-flip-broadcasts:
  testing: Bump external test suite
  dhcp: Handle is_orig=T for connections from server to 255.255.255.255
  IPBasedAnalyzer: Don't flip connections when destination is broadcast
2023-08-28 12:20:18 +02:00
Arne Welzel
4cabcd43c6 testing: Bump external test suite 2023-08-28 12:15:58 +02:00
Arne Welzel
fc768a9e01 dhcp: Handle is_orig=T for connections from server to 255.255.255.255
This works around the new semantics of is_orig=T for "connections"
from DHCP servers to broadcast addresses. IMO, having the server address
as originator in the conn.log is still more intuitive.
2023-08-28 12:15:55 +02:00
Arne Welzel
ba04f4c31d IPBasedAnalyzer: Don't flip connections when destination is broadcast
Closes #3235
2023-08-28 12:15:55 +02:00
Arne Welzel
7664bb6913 cmake: Bump submodule for removal of NEED_KRB5_H 2023-08-28 11:53:48 +02:00
Arne Welzel
33875c7bf0 zeek-config.h: Drop NEED_KRB5_H
This is unused in the Zeek tree after the previous commit, remove it
from zeek-config.h
2023-08-28 11:31:05 +02:00
Arne Welzel
18ae12f9e3 File: Drop krb5.h include
It looks as if krb5.h was only ever needed together with OpenSSL, then
OpenSSL includes were removed, but the krb5.h ones stayed around.

References:
610d081c4b
d7c10ca7c3
2023-08-28 11:31:05 +02:00
zeek-bot
8822555240 Update doc submodule [nomail] [skip ci] 2023-08-26 00:22:12 +00:00
Arne Welzel
de65671a0a Merge remote-tracking branch 'origin/topic/vern/GH-3191'
* origin/topic/vern/GH-3191:
  BTests for any/vector-of-any fixes
  fixes for vector assignments involving "any"/"vector of any" types
2023-08-25 21:43:03 +02:00
zeek-bot
b63e8fb544 Update doc submodule [nomail] [skip ci] 2023-08-25 00:31:47 +00:00
Vern Paxson
8e5dac3900 BTests for any/vector-of-any fixes 2023-08-24 15:49:13 -07:00
Vern Paxson
d70a0fae85 fixes for vector assignments involving "any"/"vector of any" types 2023-08-24 15:48:00 -07:00
Tim Wojtulewicz
ae03d591b8 Merge remote-tracking branch 'origin/topic/vern/script-opt-maint.Aug23'
* origin/topic/vern/script-opt-maint.Aug23:
  updated notes regarding "-O gen-C++" maintenance
  "-O gen-C++" support for "assert" statements
  addressed some nits re "-O gen-C++" script optimization
  fixes for compiling lambdas to C++
  fixes to avoid ambiguities in analyzing captures for script optimization
  disambiguate lambdas by adding scoping and consideration of captures
  addressed performance and correctness issues flagged by Coverity
2023-08-24 12:17:55 -07:00
Vern Paxson
1473149579 updated notes regarding "-O gen-C++" maintenance 2023-08-24 11:47:01 -07:00
Vern Paxson
81a9745fb3 "-O gen-C++" support for "assert" statements 2023-08-24 11:46:59 -07:00
Arne Welzel
9bbc3a55d4 Merge remote-tracking branch 'origin/topic/awelzel/serial-ppp-0x9'
* origin/topic/awelzel/serial-ppp-0x9:
  PPP: Add PPP analyzer to handle LINKTYPE_PPP (0x9)
2023-08-24 13:49:33 +02:00
zeek-bot
d5d600b360 Update doc submodule [nomail] [skip ci] 2023-08-24 00:16:53 +00:00
Tim Wojtulewicz
39478ebc78 Merge remote-tracking branch 'origin/topic/timw/python37-builds'
* origin/topic/timw/python37-builds:
  CI: Force alpine image to rebuild
  CI: Install python3.8 on older distros
  CI: Remove Ubuntu 18 build (EOL)
2023-08-23 13:05:14 -07:00
Tim Wojtulewicz
8d5b9a9293 CI: Force alpine image to rebuild 2023-08-23 11:12:19 -07:00