Commit graph

369 commits

Author SHA1 Message Date
Seth Hall
60a305c111 Intelligence framwork updates.
- Split Item into Item and QueryItem as suggested by Robin.
- QueryItem now has $and_tags and $or_tags.  Each
  acts as AND or OR for the given tags against
  each relevant metadata value.
- 'insert' turned into a function and new insert_event created.
- First use of intelligence framework in HTTP analysis.
2011-06-17 23:30:16 -04:00
Seth Hall
e17193ff3e Renamed HTTP::build_url function to HTTP::build_url_http
- HTTP::build_url no longer prepends http:// to the url.
2011-06-17 23:26:54 -04:00
Seth Hall
291920b013 Some minor updates and comment tweaking. 2011-06-17 21:53:07 -04:00
Seth Hall
9f22a882cd Updates to mime scripts based on comments from Robin.
- Removed reverse dependency of mime loading smtp.
- Extracting filename correctly now.
- Now copes with mime_end_entity dual firing bug.
- File hashing interface more similar to other file
  hashing interfaces.
- New notice for when a hash is calculated.
2011-06-17 21:49:23 -04:00
Seth Hall
3d34993849 Added the initial Barnyard2 integration scripts. 2011-06-17 10:45:21 -04:00
Seth Hall
d4e1f38009 Removing a stray print statement. 2011-06-17 09:03:45 -04:00
Seth Hall
c60015af22 Changed netstats (packet loss) handling to script-land.
- Removed the net_stats_update event.
- Created a net_stats function for building and retrieving the
  current network statistics.
- Removed the internal timer for firing the net_stats_update event
  along with the global heartbeat_interval variable.
- Updated the netstats script to use the new BiF.
- Updated the stats script to use the new BiF.
2011-06-17 09:02:50 -04:00
Seth Hall
57297eeca4 Removed webapp detection from default load. 2011-06-16 13:22:19 -04:00
Seth Hall
50f378a335 Small cleanup to netstats script. 2011-06-16 11:15:19 -04:00
Seth Hall
51b926f16a Fixed problem with HTTP file hashing
- HTTP file hashing now won't generate MD5 sums if
  a content gap happened during the file transfer.
2011-06-16 10:48:55 -04:00
Seth Hall
bc7b7eb235 More rework to the notice framework to simplify it.
- The action-filters don't work now because of a
  meta-programming limitation so the notice policy
  tuning is more manual by fully defining a PolicyItem.
- There are two default action cheats defined.  ignore_types
  and email_types are sets which will ignore or email
  notices of those types.
2011-06-15 15:41:40 -04:00
Seth Hall
a8f760c570 Loading the http/file-extract by default with the http/ scripts.
- Nothing is extracted by default.
2011-06-15 13:27:49 -04:00
Seth Hall
e792faab04 File identification and hashing now working and improved.
- File type identification falls back to libmagic
  if nothing is detected by the sigs.
- File extraction broken and waiting upon a fix for
  ticket #474
2011-06-15 13:11:11 -04:00
Seth Hall
dbbf73214c KnownServices only doing TCP based services now. 2011-06-15 13:09:22 -04:00
Seth Hall
ad66c9c4d9 Script cleanup.
- Defaults for all built-in asset tracking changed to LOCAL_HOSTS
- Added a tuning script for changing asset tracking
  to ALL_HOSTS in all of the core scripts that do
  asset tracking.
- Default Notice::policy files notices instead of alarming on them.
- Moved KnownHosts::Info back to export section because
  the log_known_hosts event can't be defined in the
  export section without it.
- Moved the Malware Hash Registry detection out of
  the core HTTP protocol scripts and added it to the
  all.bro script.
2011-06-15 11:27:39 -04:00
Seth Hall
5be7caa4d8 Updates to misc scripts based on comments from Robin and Jon. 2011-06-14 15:55:30 -04:00
Seth Hall
9ee7d02554 Renaming direction and host functions for clarity. 2011-06-14 14:28:34 -04:00
Seth Hall
c10b9b4608 Updates to directions and hosts enum naming from Jon. 2011-06-14 14:24:32 -04:00
Seth Hall
4d35c0b8ca Reworked the directions and hosts functionality again.
- Split enum values into two separate enums.
- Renamed to fit the enum naming convention.
- New global variable named default_asset_tracking
  that changes default behavior of any script that
  tracks assets, usually by storing some amount
  of information about the network in memory.
2011-06-14 14:23:02 -04:00
Seth Hall
dc7229f15a Updates for directions-and-hosts 2011-06-14 13:53:50 -04:00
Seth Hall
f13cf830ea Updates to several things that are loosely linked together.
- Changed enum values to determine hosts and directions.
- Fixed a bug in detecting mail clients.
- Fixed a couple of problems with vulnerable software detection.
- New variable "Software::asset_tracking" for
  determining which software to track.
2011-06-14 13:39:50 -04:00
Seth Hall
9253157302 Updates for the metrics framework.
- Partially responding to Robin's comments on it.
2011-06-14 13:37:03 -04:00
Seth Hall
00f4751ada Merge remote branch 'origin/master' into topic/policy-scripts-new 2011-06-14 13:02:19 -04:00
Seth Hall
e0e0c99889 Cleaned up the webmail detection.
- Moved webmail detection into the smtp/software script.
- Added an option to detect mail clients based on
  the actual TCP connection the mail was seen being
  transferred over.
2011-06-14 12:47:25 -04:00
Seth Hall
c327144ac0 Extract application server software based on X-Powered-By header. 2011-06-13 21:56:18 -04:00
Robin Sommer
5bd8caa7a0 Merge remote branch 'origin/topic/gregor/rpc'
Note, I haven't gone through the script-level code as that will change
soon anyway.
2011-06-13 17:56:28 -07:00
Seth Hall
08dca169f6 Fixed a problem with accessing the method attribute on an HTTP::Info record.
- Found by Jim Barlow.
2011-06-13 14:30:16 -04:00
Seth Hall
c6bf94f276 First commit of intelligence framework.
- Data insertion and querying works.
- A few tests are implemented to show usage scenarios.
2011-06-10 16:52:46 -04:00
Seth Hall
999b48e801 Tuning fragment storage down to 5 minutes in the default tuning. 2011-06-10 14:09:58 -04:00
Seth Hall
d29ffc759d Added Zimbra to the webmail detection over SMTP. 2011-06-10 14:09:26 -04:00
Seth Hall
64c296311c Add a field to the packet-filter log to indicate if it's the initial filter. 2011-06-10 13:48:31 -04:00
Seth Hall
887f5fcb79 Updates to the packet-filter framework.
- Notices are generated in the cases of being unable
  to compile or install a new filter.
- A PacketFilter::install() function is now exported
  so that external scripts can update the packet
  filter.
2011-06-10 13:41:27 -04:00
Seth Hall
cbe3dc811e HTTP script updates
- Fixed bug with new sessions accidently being created
  just after logging which caused a lot of empty records
  to be logged.
- Readded the HTTP::MD5 notice for when an MD5 sum is
  calculated for HTTP response bodies.
- Fixed bug with extracting value from content-length
  headers.
- Flushing values from md5 sum generation more reliably
  to avoid leaking memory.
2011-06-10 09:25:42 -04:00
Seth Hall
55f4950ebd Removed the dns-passive-replication script. 2011-06-10 08:36:53 -04:00
Seth Hall
e33e047de5 Added the communication framework (remote.bro). 2011-06-10 08:31:42 -04:00
Seth Hall
bc00ce51cb Modifications to packet-filter framework.
- default_pcap_filter now named PacketFilter::default_filter
- default_filter variable exported.
- moved over netstats script for logging packet loss.
2011-06-10 08:31:13 -04:00
Seth Hall
2488088901 Fixing a bug with DCC SEND file extraction (found by Jon) 2011-06-09 23:25:20 -04:00
Seth Hall
cbe761c0ed Fixed the name for the PacketFilter module. 2011-06-09 14:11:32 -04:00
Seth Hall
6516087404 Fixed problem with files not being extracted from DCC SEND commands in IRC. 2011-06-09 13:58:55 -04:00
Seth Hall
ad41c575ef Syslog script level support.
- Only does logging for now.
2011-06-09 13:14:43 -04:00
Seth Hall
8c71e68c05 Fixed a bug where notices and the conn log.
- Notices that weren't logged were still tagging
  the conn log which was confusing.  Only logged
  notices are now tagged in the conn log.
2011-06-09 12:50:00 -04:00
Seth Hall
31b63295a1 Fixed a bug with SSH analysis.
- SSH connections that appear successful weren't stopped
  from being analyzed for success after the detection.
2011-06-09 12:45:59 -04:00
Seth Hall
31cc124578 Small updates to DPD scripts. 2011-06-09 12:29:26 -04:00
Seth Hall
2a01f1686e New policy directory: policy/tuning
- The all.bro script loads tuning/defaults which is
  commonly applied tuning.
- Other less common tuning can be placed in the tuning/
  directory directly.
2011-06-09 12:28:32 -04:00
Seth Hall
7285bf890e Merge branch 'topic/policy-scripts-new' of ssh://git.bro-ids.org/bro into topic/policy-scripts-new 2011-06-09 12:22:50 -04:00
Seth Hall
0be9f7aa3e Moved and renamed the pcap.bro script to be the packet-filter framework. 2011-06-09 12:22:33 -04:00
Seth Hall
d3d9fedd2c Reshuffling notice declarations to make them exported.
- Notices were not available outside of their namespaces.
2011-06-09 11:59:06 -04:00
Jon Siwek
49c026fc1e Comment tweak: autodoc can't be inside function bodies 2011-06-09 09:46:54 -05:00
Seth Hall
590e6d0360 Fixing some runtime errors in the software framework. 2011-06-08 00:55:42 -04:00
Seth Hall
5058fcc791 Reoganized the Weird file to make values available globally. 2011-06-08 00:42:27 -04:00