zeek/testing/btest/scripts/base/frameworks/intel
Arne Welzel 7eb849ddf4 intel: Add indicator_inserted and indicator_removed hooks
This change adds two new hooks to the Intel framework that can be used
to intercept added and removed indicators and their type.

These hooks are fairly low-level. One immediate use-case is to count the
number of indicators loaded per Intel::Type and enable and disable the
corresponding event groups of the intel/seen scripts.

I attempted to gauge the overhead and while it's definitely there, loading
a file with ~500k DOMAIN entries takes somewhere around ~0.5 seconds hooks
when populated via the min_data_store store mechanism. While that
doesn't sound great, it actually takes the manager on my system 2.5
seconds to serialize and Cluster::publish() the min_data_store alone
and its doing that serially for every active worker. Mostly to say that
the bigger overhead in that area on the manager doing redundant work
per worker.

Co-authored-by: Mohan Dhawan <mohan@corelight.com>
2025-06-02 09:50:48 +02:00
..
path-prefix testing/btest/*zeek: Comment all @TEST lines 2025-04-17 16:30:23 +02:00
cluster-indicator-inserted-new-min-store.zeek intel: Add indicator_inserted and indicator_removed hooks 2025-06-02 09:50:48 +02:00
cluster-indicator-inserted.zeek intel: Add indicator_inserted and indicator_removed hooks 2025-06-02 09:50:48 +02:00
cluster-transparency-with-proxy.zeek btest/frameworks/intel: Use generic cluster-layout.zeek 2025-05-20 20:30:01 +02:00
cluster-transparency.zeek btest/frameworks/intel: Use generic cluster-layout.zeek 2025-05-20 20:30:01 +02:00
expire-item.zeek General btest cleanup 2020-08-11 11:26:22 -07:00
filter-item.zeek testing/btest/*zeek: Comment all @TEST lines 2025-04-17 16:30:23 +02:00
input-and-match.zeek testing/btest/*zeek: Comment all @TEST lines 2025-04-17 16:30:23 +02:00
match-subnet.zeek General btest cleanup 2020-08-11 11:26:22 -07:00
read-file-dist-cluster.zeek btest/frameworks/intel: Use generic cluster-layout.zeek 2025-05-20 20:30:01 +02:00
remove-item-cluster.zeek btest/frameworks/intel: Use generic cluster-layout.zeek 2025-05-20 20:30:01 +02:00
remove-non-existing.zeek Intel: Introduce Intel::seen_policy() hook 2024-01-25 12:22:47 +01:00
seen-policy.zeek Intel: Introduce Intel::seen_policy() hook 2024-01-25 12:22:47 +01:00
updated-match.zeek Improve an Intel framework btest 2020-08-25 14:36:52 -07:00