zeek/scripts/base/frameworks
Arne Welzel 7eb849ddf4 intel: Add indicator_inserted and indicator_removed hooks
This change adds two new hooks to the Intel framework that can be used
to intercept added and removed indicators and their type.

These hooks are fairly low-level. One immediate use-case is to count the
number of indicators loaded per Intel::Type and enable and disable the
corresponding event groups of the intel/seen scripts.

I attempted to gauge the overhead and while it's definitely there, loading
a file with ~500k DOMAIN entries takes somewhere around ~0.5 seconds hooks
when populated via the min_data_store store mechanism. While that
doesn't sound great, it actually takes the manager on my system 2.5
seconds to serialize and Cluster::publish() the min_data_store alone
and its doing that serially for every active worker. Mostly to say that
the bigger overhead in that area on the manager doing redundant work
per worker.

Co-authored-by: Mohan Dhawan <mohan@corelight.com>
2025-06-02 09:50:48 +02:00
..
analyzer Remove violating analyzer from services field again 2025-03-04 15:10:49 +00:00
broker Lower listen/connect retry intervals in Broker and the cluster framework to 1sec 2025-04-25 10:22:35 -07:00
cluster cluster/websocket: Deprecate $listen_host, introduce $listen_addr 2025-05-30 11:02:41 +02:00
config config: Move to Cluster::publish() 2024-12-12 17:54:42 +01:00
control annotate base scripts with &is_used as needed 2022-05-26 17:39:17 -07:00
files Move python signatures to a separate file 2024-12-09 11:08:30 -07:00
input Fix errors from rst linting on the generated docs 2025-01-24 11:41:36 -07:00
intel intel: Add indicator_inserted and indicator_removed hooks 2025-06-02 09:50:48 +02:00
logging Fix errors from rst linting on the generated docs 2025-01-24 11:41:36 -07:00
netcontrol netcontrol: Move to Cluster::publish() 2024-12-12 17:54:42 +01:00
notice Fix errors from rst linting on the generated docs 2025-01-24 11:41:36 -07:00
openflow openflow: Move to Cluster::publish() 2024-12-12 17:54:42 +01:00
packet-filter Add PacketFilter::remove_exclude function 2024-04-17 21:25:35 +00:00
reporter Support for log filter policy hooks 2020-09-30 12:32:45 -07:00
signatures allow signature actions to be dynamically updated 2023-07-13 17:25:32 -07:00
software frameworks/software: Fix stale value used for stripping 2023-11-17 14:37:28 +01:00
spicy Fix errors from rst linting on the generated docs 2025-01-24 11:41:36 -07:00
storage Add STORAGE_ prefixes for backends and serializers 2025-04-14 10:11:13 -07:00
sumstats sumstats: Move to Cluster::publish() 2024-12-12 17:54:42 +01:00
supervisor Fix errors from rst linting on the generated docs 2025-01-24 11:41:36 -07:00
telemetry Fix errors from rst linting on the generated docs 2025-01-24 11:41:36 -07:00
tunnels Add GTPv1 packet analyzer, disable old analyzer 2021-11-23 19:36:50 -07:00