Reworked cluster intelligence data distribution mechanism and fixed tests.

- Intel data distribution on clusters is now pushed in whole
  by the manager when a worker connects.  Additions after that point
  are managed by the normal single-item distribution mechanism already
  built into the intelligence framework.

- The manager maintains the complete "minimal" data store that the
  workers use to do their matching so that full "minimal" data
  distribution is very easy.

- Tests are cleaned up and work.
This commit is contained in:
Seth Hall 2012-10-03 16:25:02 -04:00
parent 38468f9daa
commit bf9651b323
16 changed files with 84 additions and 177 deletions

View file

@ -1,2 +0,0 @@
cluster_new_item: 123.123.123.123 from source worker-1 (from peer: worker-1)
cluster_new_item: 4.3.2.1 from source worker-2 (from peer: worker-2)

View file

@ -1,10 +0,0 @@
#separator \x09
#set_separator ,
#empty_field (empty)
#unset_field -
#path intel
#open 2012-09-28-18-50-43
#fields ts uid id.orig_h id.orig_p id.resp_h id.resp_p seen.host seen.str seen.str_type seen.where
#types time string addr port addr port addr string enum enum
1348858243.346443 - - - - - 123.123.123.123 - - Intel::IN_ANYWHERE
#close 2012-09-28-18-50-53

View file

@ -1,3 +0,0 @@
cluster_new_item: 1.2.3.4 from source manager (from peer: manager-1)
cluster_new_item: 123.123.123.123 from source worker-1 (from peer: manager-1)
cluster_new_item: 4.3.2.1 from source worker-2 (from peer: manager-1)

View file

@ -1,4 +0,0 @@
cluster_new_item: 1.2.3.4 from source manager (from peer: manager-1)
cluster_new_item: 123.123.123.123 from source worker-1 (from peer: manager-1)
cluster_new_item: 4.3.2.1 from source worker-2 (from peer: manager-1)
Doing a lookup