Commit graph

13381 commits

Author SHA1 Message Date
Tim Wojtulewicz
509718b51c GH-2229: Fix some typos in weak-keys.zeek 2022-06-30 15:12:10 -07:00
Tim Wojtulewicz
94c9747440 Merge remote-tracking branch 'origin/topic/bbannier/bump-spicy'
* origin/topic/bbannier/bump-spicy:
  Bump Spicy and spicy-plugin to their latest release.
2022-06-30 13:38:49 -07:00
Tim Wojtulewicz
1c3c88fd2a Merge remote-tracking branch 'origin/topic/johanna/rand64bit'
* origin/topic/johanna/rand64bit:
  Optimize 64 bit random number generation
2022-06-30 13:37:49 -07:00
Tim Wojtulewicz
5ce7e2c12b Merge remote-tracking branch 'origin/topic/timw/remove-5.1-deprecations'
* origin/topic/timw/remove-5.1-deprecations:
  Remove other general deprecations
  Remove some deprecated ocsp/ssl base scripts
  Remove deprecated DESC_PORTABLE ODesc mode and ODesc::IsPortable()
  Remove deprecated UDP, ICMP, and TCP analyzers
  Remove deprecated protocol_confirmation/violation events and methods
  Remove deprecated IterCookie-based dictionary iteration
  Remove deprecated MemoryAllocation() methods and related code
  Remove deprecated --enable-mobile-ipv6 configure argument
  Add helpers for syncing commit files with external testsuites
  Fix typo in update-timing target for external testsuites
2022-06-30 12:28:01 -07:00
Tim Wojtulewicz
fb16ce3711 Remove other general deprecations 2022-06-30 19:17:13 +00:00
Tim Wojtulewicz
6130d32440 Remove some deprecated ocsp/ssl base scripts 2022-06-30 19:17:08 +00:00
Tim Wojtulewicz
765a8535e0 Remove deprecated DESC_PORTABLE ODesc mode and ODesc::IsPortable() 2022-06-30 19:11:59 +00:00
Tim Wojtulewicz
77aa80033b Remove deprecated UDP, ICMP, and TCP analyzers 2022-06-30 19:11:59 +00:00
Tim Wojtulewicz
644ed5d314 Remove deprecated protocol_confirmation/violation events and methods 2022-06-30 19:11:57 +00:00
Tim Wojtulewicz
392c2f3810 Remove deprecated IterCookie-based dictionary iteration 2022-06-30 19:06:01 +00:00
Tim Wojtulewicz
70e63d4749 Remove deprecated MemoryAllocation() methods and related code 2022-06-30 18:56:52 +00:00
Tim Wojtulewicz
d3169e48c0 Remove deprecated --enable-mobile-ipv6 configure argument 2022-06-30 17:42:18 +00:00
Christian Kreibich
b3de9a0faf Merge branch 'topic/christian/external-testsuite-tweaks'
* topic/christian/external-testsuite-tweaks:
  Add helpers for syncing commit files with external testsuites
  Fix typo in update-timing target for external testsuites
2022-06-30 09:56:46 -07:00
Benjamin Bannier
e8bc953e8a Bump Spicy and spicy-plugin to their latest release. 2022-06-30 15:44:05 +02:00
Johanna Amann
31cf270565 Optimize 64 bit random number generation
rand64bit called random 4 times to generate one 64 bit number. There is
no reason to do this - random() is basically guaranteed to return a 32
bit number.

This also adds a static check to make sure that it does.
2022-06-29 14:37:39 +02:00
Christian Kreibich
bf9b1ebbbe Add helpers for syncing commit files with external testsuites
This provides "make sync-repos" to check out all locally available testsuites at
the commits indicated in their commit files, and "make sync-commits" to update
the commit files to the HEADs of the local testsuite repos.

Also adds the commit -> repo sync for the Makefile init target so initialization
always lands on the right version, and removes the corresponding explicit
checkout from the CI repo setup.
2022-06-28 13:20:14 -07:00
Christian Kreibich
9f3dfbdb13 Fix typo in update-timing target for external testsuites
Also includes whitespace tweaks for consistency.
2022-06-28 13:20:03 -07:00
Tim Wojtulewicz
86f874b31b Merge remote-tracking branch 'origin/topic/timw/bump-broker'
* origin/topic/timw/bump-broker:
  Update broker submodule [nomail]
2022-06-28 09:25:19 -07:00
Tim Wojtulewicz
342354343c Update broker submodule [nomail] 2022-06-27 15:56:39 -07:00
Tim Wojtulewicz
9e953f50cb Merge remote-tracking branch 'origin/topic/vern/remove-deprecated-closures'
* origin/topic/vern/remove-deprecated-closures:
  removed deprecated capture-by-reference closures
2022-06-27 13:04:57 -07:00
Tim Wojtulewicz
11bcb26ab5 Merge remote-tracking branch 'origin/topic/timw/2183-checksum-variables'
* origin/topic/timw/2183-checksum-variables:
  GH-2183: Rework Packet checksummed variable naming
2022-06-27 11:43:37 -07:00
Tim Wojtulewicz
1b5741d905 GH-2183: Rework Packet checksummed variable naming 2022-06-27 11:07:31 -07:00
Tim Wojtulewicz
1af3039ca3 Merge remote-tracking branch 'origin/topic/timw/modernize-cpp-headers'
* origin/topic/timw/modernize-cpp-headers:
  Code modernization: Convert from deprecated C standard library headers
  Bump cmake submodule for run-clang-tidy fix [skip ci] [nomail]
2022-06-27 10:37:25 -07:00
Tim Wojtulewicz
7c4fd382d9 Code modernization: Convert from deprecated C standard library headers 2022-06-27 09:47:31 -07:00
Tim Wojtulewicz
823d80494b Bump cmake submodule for run-clang-tidy fix [skip ci] [nomail] 2022-06-27 09:27:50 -07:00
Tim Wojtulewicz
c5b435f2cc Merge remote-tracking branch 'origin/topic/timw/2021-signal-handler-deadlock'
* origin/topic/timw/2021-signal-handler-deadlock:
  Mark bools in BasicThread as atomic to avoid data races
  Avoid calling DBG_LOG during signal handling
  Fixes for iosource::Manager for deadlocks during shutdown
2022-06-27 09:27:07 -07:00
Tim Wojtulewicz
268ebbaffd Mark bools in BasicThread as atomic to avoid data races 2022-06-26 20:54:04 +00:00
Tim Wojtulewicz
f50777cdab Avoid calling DBG_LOG during signal handling 2022-06-26 20:54:04 +00:00
Tim Wojtulewicz
d06387d4d3 Fixes for iosource::Manager for deadlocks during shutdown 2022-06-26 20:54:04 +00:00
Tim Wojtulewicz
6acb626ece Add initial NEWS block for 5.1 2022-06-25 08:23:16 -07:00
Tim Wojtulewicz
bf7b6e5ed0 Merge remote-tracking branch 'origin/topic/timw/bump-broker'
* origin/topic/timw/bump-broker:
  Bump broker submodule to pick up two fixes
2022-06-24 14:18:54 -07:00
Tim Wojtulewicz
a6dd3af831 Bump broker submodule to pick up two fixes
- https://github.com/zeek/broker/pull/244
- https://github.com/zeek/broker/pull/245
2022-06-24 14:18:23 -07:00
Tim Wojtulewicz
5162732598 Add NEWS entry for 5.0 management changes [nomail] [skip ci] 2022-06-24 09:09:31 -07:00
Tim Wojtulewicz
693a0c71c4 Merge remote-tracking branch 'origin/topic/johanna/bf-news'
* origin/topic/johanna/bf-news:
  News entry about Bloom Filter changes in 5.0.
2022-06-24 09:08:19 -07:00
Johanna Amann
ce410b7ed5 News entry about Bloom Filter changes in 5.0. 2022-06-24 14:52:54 +02:00
zeek-bot
a7aa345c76 Update doc submodule [nomail] [skip ci] 2022-06-24 00:43:53 +00:00
Tim Wojtulewicz
e60c305ac1 Merge remote-tracking branch 'origin/topic/bbannier/bump-spicy'
* origin/topic/bbannier/bump-spicy:
  Bump Spicy to the latest development version.
2022-06-23 13:04:08 -07:00
Christian Kreibich
3287b8b793 Merge branch 'topic/christian/management-restart'
* topic/christian/management-restart:
  Management framework: bump external cluster testsuite
  Management framework: bump zeek-client
  Management framework: edit pass over docstrings
  Management framework: node restart support
  Management framework: more consistent Supervisor interaction in the agent
  Management framework: log the controller's startup deployment attempt
  Management framework: bugfix for a get_id_value corner case
  Management framework: minor timeout bugfix
  Management framework: make "result" argument plural in multi-result response events
2022-06-23 12:27:19 -07:00
Benjamin Bannier
dd2fe2548b Bump Spicy to the latest development version. 2022-06-23 21:09:00 +02:00
Christian Kreibich
ec25723283 Management framework: bump external cluster testsuite 2022-06-23 00:02:11 -07:00
Christian Kreibich
99cd416552 Management framework: bump zeek-client 2022-06-23 00:02:10 -07:00
Christian Kreibich
3aa0409792 Management framework: edit pass over docstrings
This expands cross-referencing in the doc strings and adds a bit more
explanation.
2022-06-22 23:26:11 -07:00
Christian Kreibich
b9879a50a0 Management framework: node restart support
This adds restart request/response event pairs that restart nodes in the running
Zeek cluster. The implementation is very similar to get_id_value, which also
involves distributing a list of nodes to agents and aggregating the responses.
2022-06-22 23:26:11 -07:00
Christian Kreibich
bd39207772 Management framework: more consistent Supervisor interaction in the agent
This declares our helper functions for sending events to the Supervisor, and
makes them return the created request objects to enable the caller to modify
them. It also adds a helper for restart and status requests, uses the helpers
throughout the module, and makes all handlers more resilient in case Supervisor
events other than the agent's arrive.
2022-06-22 23:26:11 -07:00
Christian Kreibich
d994f33636 Management framework: log the controller's startup deployment attempt
The controller now logs its deployment attempt of a persisted configuration at
startup. This is generally helpful to see recorded, and also explains timeout of
the underlying request in case of failure (which triggers a timeout message).
2022-06-22 23:26:11 -07:00
Christian Kreibich
05447c413f Management framework: bugfix for a get_id_value corner case
For the case of a running cluster with no connected agents, use the
g_instances_known table instead of g_instances. The latter reflects the contents
of the last deployed config, not the live scenario of actually attached agents.
2022-06-22 23:26:06 -07:00
Christian Kreibich
1af9bba76e Management framework: minor timeout bugfix
The timeout result wasn't actually stored in requests timing out in the
agent. (So far that's for deployment requests.) Also log the timing out of any
request state, similar to the controller.
2022-06-22 23:25:15 -07:00
Christian Kreibich
b2f9e29bae Management framework: make "result" argument plural in multi-result response events
No functional change, just a consistency tweak. Since agent and controller send
response events via Broker::publish(), the arguments aren't named and so this
only affects the API definition.
2022-06-22 23:25:15 -07:00
Christian Kreibich
54f2f28047 Merge branch 'topic/christian/management-deploy'
* topic/christian/management-deploy: (21 commits)
  Management framework: bump external cluster testsuite
  Management framework: bump zeek-client
  Management framework: rename set_configuration events to stage_configuration
  Management framework: trigger deployment upon when instances are ready
  Management framework: more resilient node shutdown upon deployment
  Management framework: re-trigger deployment upon controller launch
  Management framework: move most deployment handling to internal function
  Management framework: distinguish internally and externally requested deployments
  Management framework: track instances by their Broker IDs
  Management framework: tweak Supervisor event logging
  Management framework: make helper function a local
  Management framework: rename "log_level" to "level"
  Management framework: add "finish" callback to requests
  Management framework: add a helper for rendering result vectors to a string
  Management framework: agents now skip re-deployment of current config
  Management framework: suppress notify_agent_hello upon Supervisor peering
  Management framework: introduce state machine for configs and persist them
  Management framework: introduce deployment API in controller
  Management framework: rename agent "set_configuration" to "deploy"
  Management framework: consistency fixes to the Result record
  ...
2022-06-22 22:59:53 -07:00
zeek-bot
a7552b6e84 Update doc submodule [nomail] [skip ci] 2022-06-23 00:38:34 +00:00