mirror of
https://github.com/zeek/zeek.git
synced 2025-10-08 09:38:19 +00:00
Copy docs into Zeek repo directly
This is based on commit 2731def9159247e6da8a3191783c89683363689c from the zeek-docs repo.
This commit is contained in:
parent
83f1e74643
commit
ded98cd373
1074 changed files with 169319 additions and 0 deletions
14
doc/scripts/base/frameworks/input/__load__.zeek.rst
Normal file
14
doc/scripts/base/frameworks/input/__load__.zeek.rst
Normal file
|
@ -0,0 +1,14 @@
|
|||
:tocdepth: 3
|
||||
|
||||
base/frameworks/input/__load__.zeek
|
||||
===================================
|
||||
|
||||
|
||||
:Imports: :doc:`base/frameworks/input/main.zeek </scripts/base/frameworks/input/main.zeek>`, :doc:`base/frameworks/input/readers/ascii.zeek </scripts/base/frameworks/input/readers/ascii.zeek>`, :doc:`base/frameworks/input/readers/benchmark.zeek </scripts/base/frameworks/input/readers/benchmark.zeek>`, :doc:`base/frameworks/input/readers/binary.zeek </scripts/base/frameworks/input/readers/binary.zeek>`, :doc:`base/frameworks/input/readers/config.zeek </scripts/base/frameworks/input/readers/config.zeek>`, :doc:`base/frameworks/input/readers/raw.zeek </scripts/base/frameworks/input/readers/raw.zeek>`, :doc:`base/frameworks/input/readers/sqlite.zeek </scripts/base/frameworks/input/readers/sqlite.zeek>`
|
||||
|
||||
Summary
|
||||
~~~~~~~
|
||||
|
||||
Detailed Interface
|
||||
~~~~~~~~~~~~~~~~~~
|
||||
|
50
doc/scripts/base/frameworks/input/index.rst
Normal file
50
doc/scripts/base/frameworks/input/index.rst
Normal file
|
@ -0,0 +1,50 @@
|
|||
:orphan:
|
||||
|
||||
Package: base/frameworks/input
|
||||
==============================
|
||||
|
||||
The input framework provides a way to read previously stored data either as
|
||||
an event stream or into a Zeek table.
|
||||
|
||||
:doc:`/scripts/base/frameworks/input/__load__.zeek`
|
||||
|
||||
|
||||
:doc:`/scripts/base/frameworks/input/main.zeek`
|
||||
|
||||
The input framework provides a way to read previously stored data either
|
||||
as an event stream or into a Zeek table.
|
||||
|
||||
:doc:`/scripts/base/frameworks/input/readers/ascii.zeek`
|
||||
|
||||
Interface for the ascii input reader.
|
||||
|
||||
The defaults are set to match Zeek's ASCII output.
|
||||
|
||||
:doc:`/scripts/base/frameworks/input/readers/raw.zeek`
|
||||
|
||||
Interface for the raw input reader.
|
||||
|
||||
:doc:`/scripts/base/frameworks/input/readers/benchmark.zeek`
|
||||
|
||||
Interface for the benchmark input reader.
|
||||
|
||||
:doc:`/scripts/base/frameworks/input/readers/binary.zeek`
|
||||
|
||||
Interface for the binary input reader.
|
||||
|
||||
:doc:`/scripts/base/frameworks/input/readers/config.zeek`
|
||||
|
||||
Interface for the config input reader.
|
||||
|
||||
:doc:`/scripts/base/frameworks/input/readers/sqlite.zeek`
|
||||
|
||||
Interface for the SQLite input reader. Redefinable options are available
|
||||
to tweak the input format of the SQLite reader.
|
||||
|
||||
See :doc:`/frameworks/logging-input-sqlite` for an introduction on how to
|
||||
use the SQLite reader.
|
||||
|
||||
When using the SQLite reader, you have to specify the SQL query that returns
|
||||
the desired data by setting ``query`` in the ``config`` table. See the
|
||||
introduction mentioned above for an example.
|
||||
|
492
doc/scripts/base/frameworks/input/main.zeek.rst
Normal file
492
doc/scripts/base/frameworks/input/main.zeek.rst
Normal file
|
@ -0,0 +1,492 @@
|
|||
:tocdepth: 3
|
||||
|
||||
base/frameworks/input/main.zeek
|
||||
===============================
|
||||
.. zeek:namespace:: Input
|
||||
|
||||
The input framework provides a way to read previously stored data either
|
||||
as an event stream or into a Zeek table.
|
||||
|
||||
:Namespace: Input
|
||||
:Imports: :doc:`base/bif/input.bif.zeek </scripts/base/bif/input.bif.zeek>`
|
||||
|
||||
Summary
|
||||
~~~~~~~
|
||||
Runtime Options
|
||||
###############
|
||||
================================================================================ ==============================
|
||||
:zeek:id:`Input::default_mode`: :zeek:type:`Input::Mode` :zeek:attr:`&redef` The default reader mode used.
|
||||
:zeek:id:`Input::default_reader`: :zeek:type:`Input::Reader` :zeek:attr:`&redef` The default input reader used.
|
||||
================================================================================ ==============================
|
||||
|
||||
Redefinable Options
|
||||
###################
|
||||
================================================================================= =========================================================
|
||||
:zeek:id:`Input::accept_unsupported_types`: :zeek:type:`bool` :zeek:attr:`&redef` Flag that controls if the input framework accepts records
|
||||
that contain types that are not supported (at the moment
|
||||
file and function).
|
||||
:zeek:id:`Input::empty_field`: :zeek:type:`string` :zeek:attr:`&redef` String to use for empty fields.
|
||||
:zeek:id:`Input::separator`: :zeek:type:`string` :zeek:attr:`&redef` Separator between fields.
|
||||
:zeek:id:`Input::set_separator`: :zeek:type:`string` :zeek:attr:`&redef` Separator between set elements.
|
||||
:zeek:id:`Input::unset_field`: :zeek:type:`string` :zeek:attr:`&redef` String to use for an unset &optional field.
|
||||
================================================================================= =========================================================
|
||||
|
||||
Types
|
||||
#####
|
||||
============================================================ ===================================================================
|
||||
:zeek:type:`Input::AnalysisDescription`: :zeek:type:`record` A file analysis input stream type used to forward input data to the
|
||||
file analysis framework.
|
||||
:zeek:type:`Input::Event`: :zeek:type:`enum` Type that describes what kind of change occurred.
|
||||
:zeek:type:`Input::EventDescription`: :zeek:type:`record` An event input stream type used to send input data to a Zeek event.
|
||||
:zeek:type:`Input::Mode`: :zeek:type:`enum` Type that defines the input stream read mode.
|
||||
:zeek:type:`Input::TableDescription`: :zeek:type:`record` A table input stream type used to send data to a Zeek table.
|
||||
:zeek:type:`Input::Reader`: :zeek:type:`enum`
|
||||
============================================================ ===================================================================
|
||||
|
||||
Events
|
||||
######
|
||||
================================================= ====================================================================
|
||||
:zeek:id:`Input::end_of_data`: :zeek:type:`event` Event that is called when the end of a data source has been reached,
|
||||
including after an update.
|
||||
================================================= ====================================================================
|
||||
|
||||
Functions
|
||||
#########
|
||||
===================================================== ============================================================
|
||||
:zeek:id:`Input::add_analysis`: :zeek:type:`function` Create a new file analysis input stream from a given source.
|
||||
:zeek:id:`Input::add_event`: :zeek:type:`function` Create a new event input stream from a given source.
|
||||
:zeek:id:`Input::add_table`: :zeek:type:`function` Create a new table input stream from a given source.
|
||||
:zeek:id:`Input::force_update`: :zeek:type:`function` Forces the current input to be checked for changes.
|
||||
:zeek:id:`Input::remove`: :zeek:type:`function` Remove an input stream.
|
||||
===================================================== ============================================================
|
||||
|
||||
|
||||
Detailed Interface
|
||||
~~~~~~~~~~~~~~~~~~
|
||||
Runtime Options
|
||||
###############
|
||||
.. zeek:id:: Input::default_mode
|
||||
:source-code: base/frameworks/input/main.zeek 31 31
|
||||
|
||||
:Type: :zeek:type:`Input::Mode`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``Input::MANUAL``
|
||||
|
||||
The default reader mode used. Defaults to :zeek:see:`Input::MANUAL`.
|
||||
|
||||
.. zeek:id:: Input::default_reader
|
||||
:source-code: base/frameworks/input/main.zeek 28 28
|
||||
|
||||
:Type: :zeek:type:`Input::Reader`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``Input::READER_ASCII``
|
||||
|
||||
The default input reader used. Defaults to :zeek:see:`Input::READER_ASCII`.
|
||||
|
||||
Redefinable Options
|
||||
###################
|
||||
.. zeek:id:: Input::accept_unsupported_types
|
||||
:source-code: base/frameworks/input/main.zeek 56 56
|
||||
|
||||
:Type: :zeek:type:`bool`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``F``
|
||||
|
||||
Flag that controls if the input framework accepts records
|
||||
that contain types that are not supported (at the moment
|
||||
file and function). If true, the input framework will
|
||||
warn in these cases, but continue. If false, it will
|
||||
abort. Defaults to false (abort).
|
||||
|
||||
.. zeek:id:: Input::empty_field
|
||||
:source-code: base/frameworks/input/main.zeek 45 45
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"(empty)"``
|
||||
|
||||
String to use for empty fields.
|
||||
Individual readers can use a different value.
|
||||
|
||||
.. zeek:id:: Input::separator
|
||||
:source-code: base/frameworks/input/main.zeek 36 36
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"\x09"``
|
||||
|
||||
Separator between fields.
|
||||
Please note that the separator has to be exactly one character long.
|
||||
Individual readers can use a different value.
|
||||
|
||||
.. zeek:id:: Input::set_separator
|
||||
:source-code: base/frameworks/input/main.zeek 41 41
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``","``
|
||||
|
||||
Separator between set elements.
|
||||
Please note that the separator has to be exactly one character long.
|
||||
Individual readers can use a different value.
|
||||
|
||||
.. zeek:id:: Input::unset_field
|
||||
:source-code: base/frameworks/input/main.zeek 49 49
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"-"``
|
||||
|
||||
String to use for an unset &optional field.
|
||||
Individual readers can use a different value.
|
||||
|
||||
Types
|
||||
#####
|
||||
.. zeek:type:: Input::AnalysisDescription
|
||||
:source-code: base/frameworks/input/main.zeek 180 204
|
||||
|
||||
:Type: :zeek:type:`record`
|
||||
|
||||
|
||||
.. zeek:field:: source :zeek:type:`string`
|
||||
|
||||
String that allows the reader to find the source.
|
||||
For :zeek:see:`Input::READER_ASCII`, this is the filename.
|
||||
|
||||
|
||||
.. zeek:field:: reader :zeek:type:`Input::Reader` :zeek:attr:`&default` = ``Input::READER_BINARY`` :zeek:attr:`&optional`
|
||||
|
||||
Reader to use for this stream. Compatible readers must be
|
||||
able to accept a filter of a single string type (i.e.
|
||||
they read a byte stream).
|
||||
|
||||
|
||||
.. zeek:field:: mode :zeek:type:`Input::Mode` :zeek:attr:`&default` = :zeek:see:`Input::default_mode` :zeek:attr:`&optional`
|
||||
|
||||
Read mode to use for this stream.
|
||||
|
||||
|
||||
.. zeek:field:: name :zeek:type:`string`
|
||||
|
||||
Descriptive name that uniquely identifies the input source.
|
||||
Can be used to remove a stream at a later time.
|
||||
This will also be used for the unique *source* field of
|
||||
:zeek:see:`fa_file`. Most of the time, the best choice for this
|
||||
field will be the same value as the *source* field.
|
||||
|
||||
|
||||
.. zeek:field:: config :zeek:type:`table` [:zeek:type:`string`] of :zeek:type:`string` :zeek:attr:`&default` = ``{ }`` :zeek:attr:`&optional`
|
||||
|
||||
A key/value table that will be passed to the reader.
|
||||
Interpretation of the values is left to the reader, but
|
||||
usually they will be used for configuration purposes.
|
||||
|
||||
|
||||
A file analysis input stream type used to forward input data to the
|
||||
file analysis framework.
|
||||
|
||||
.. zeek:type:: Input::Event
|
||||
:source-code: base/frameworks/input/main.zeek 8 8
|
||||
|
||||
:Type: :zeek:type:`enum`
|
||||
|
||||
.. zeek:enum:: Input::EVENT_NEW Input::Event
|
||||
|
||||
New data has been imported.
|
||||
|
||||
.. zeek:enum:: Input::EVENT_CHANGED Input::Event
|
||||
|
||||
Existing data has been changed.
|
||||
|
||||
.. zeek:enum:: Input::EVENT_REMOVED Input::Event
|
||||
|
||||
Previously existing data has been removed.
|
||||
|
||||
Type that describes what kind of change occurred.
|
||||
|
||||
.. zeek:type:: Input::EventDescription
|
||||
:source-code: base/frameworks/input/main.zeek 125 176
|
||||
|
||||
:Type: :zeek:type:`record`
|
||||
|
||||
|
||||
.. zeek:field:: source :zeek:type:`string`
|
||||
|
||||
String that allows the reader to find the source.
|
||||
For :zeek:see:`Input::READER_ASCII`, this is the filename.
|
||||
|
||||
|
||||
.. zeek:field:: reader :zeek:type:`Input::Reader` :zeek:attr:`&default` = :zeek:see:`Input::default_reader` :zeek:attr:`&optional`
|
||||
|
||||
Reader to use for this stream.
|
||||
|
||||
|
||||
.. zeek:field:: mode :zeek:type:`Input::Mode` :zeek:attr:`&default` = :zeek:see:`Input::default_mode` :zeek:attr:`&optional`
|
||||
|
||||
Read mode to use for this stream.
|
||||
|
||||
|
||||
.. zeek:field:: name :zeek:type:`string`
|
||||
|
||||
Descriptive name. Used to remove a stream at a later time.
|
||||
|
||||
|
||||
.. zeek:field:: fields :zeek:type:`any`
|
||||
|
||||
Record type describing the fields to be retrieved from the input
|
||||
source.
|
||||
|
||||
|
||||
.. zeek:field:: want_record :zeek:type:`bool` :zeek:attr:`&default` = ``T`` :zeek:attr:`&optional`
|
||||
|
||||
If this is false, the event receives each value in *fields* as a
|
||||
separate argument.
|
||||
If this is set to true (default), the event receives all fields in
|
||||
a single record value.
|
||||
|
||||
|
||||
.. zeek:field:: ev :zeek:type:`any`
|
||||
|
||||
The event that is raised each time a new line is received from the
|
||||
reader. The event will receive an :zeek:see:`Input::EventDescription` record
|
||||
as the first argument, an :zeek:see:`Input::Event` enum as the second
|
||||
argument, and the fields (as specified in *fields*) as the following
|
||||
arguments (this will either be a single record value containing
|
||||
all fields, or each field value as a separate argument).
|
||||
|
||||
|
||||
.. zeek:field:: error_ev :zeek:type:`any` :zeek:attr:`&optional`
|
||||
|
||||
Error event that is raised when an information, warning or error
|
||||
is raised by the input stream. If the level is error, the stream will automatically
|
||||
be closed.
|
||||
The event receives the :zeek:see:`Input::EventDescription` as the first argument, the
|
||||
message as the second argument and the :zeek:see:`Reporter::Level` as the third argument.
|
||||
|
||||
The event is raised like it had been declared as follows:
|
||||
error_ev: function(desc: EventDescription, message: string, level: Reporter::Level) &optional;
|
||||
The actual declaration uses the :zeek:type:`any` type because of deficiencies of the Zeek type system.
|
||||
|
||||
|
||||
.. zeek:field:: config :zeek:type:`table` [:zeek:type:`string`] of :zeek:type:`string` :zeek:attr:`&default` = ``{ }`` :zeek:attr:`&optional`
|
||||
|
||||
A key/value table that will be passed to the reader.
|
||||
Interpretation of the values is left to the reader, but
|
||||
usually they will be used for configuration purposes.
|
||||
|
||||
|
||||
An event input stream type used to send input data to a Zeek event.
|
||||
|
||||
.. zeek:type:: Input::Mode
|
||||
:source-code: base/frameworks/input/main.zeek 18 26
|
||||
|
||||
:Type: :zeek:type:`enum`
|
||||
|
||||
.. zeek:enum:: Input::MANUAL Input::Mode
|
||||
|
||||
Do not automatically reread the file after it has been read.
|
||||
|
||||
.. zeek:enum:: Input::REREAD Input::Mode
|
||||
|
||||
Reread the entire file each time a change is found.
|
||||
|
||||
.. zeek:enum:: Input::STREAM Input::Mode
|
||||
|
||||
Read data from end of file each time new data is appended.
|
||||
|
||||
Type that defines the input stream read mode.
|
||||
|
||||
.. zeek:type:: Input::TableDescription
|
||||
:source-code: base/frameworks/input/main.zeek 59 122
|
||||
|
||||
:Type: :zeek:type:`record`
|
||||
|
||||
|
||||
.. zeek:field:: source :zeek:type:`string`
|
||||
|
||||
String that allows the reader to find the source of the data.
|
||||
For :zeek:see:`Input::READER_ASCII`, this is the filename.
|
||||
|
||||
|
||||
.. zeek:field:: reader :zeek:type:`Input::Reader` :zeek:attr:`&default` = :zeek:see:`Input::default_reader` :zeek:attr:`&optional`
|
||||
|
||||
Reader to use for this stream.
|
||||
|
||||
|
||||
.. zeek:field:: mode :zeek:type:`Input::Mode` :zeek:attr:`&default` = :zeek:see:`Input::default_mode` :zeek:attr:`&optional`
|
||||
|
||||
Read mode to use for this stream.
|
||||
|
||||
|
||||
.. zeek:field:: name :zeek:type:`string`
|
||||
|
||||
Name of the input stream. This is used by some functions to
|
||||
manipulate the stream.
|
||||
|
||||
|
||||
.. zeek:field:: destination :zeek:type:`any`
|
||||
|
||||
Table which will receive the data read by the input framework.
|
||||
|
||||
|
||||
.. zeek:field:: idx :zeek:type:`any`
|
||||
|
||||
Record that defines the values used as the index of the table.
|
||||
|
||||
|
||||
.. zeek:field:: val :zeek:type:`any` :zeek:attr:`&optional`
|
||||
|
||||
Record that defines the values used as the elements of the table.
|
||||
If this is undefined, then *destination* must be a set.
|
||||
|
||||
|
||||
.. zeek:field:: want_record :zeek:type:`bool` :zeek:attr:`&default` = ``T`` :zeek:attr:`&optional`
|
||||
|
||||
Defines if the value of the table is a record (default), or a single
|
||||
value. When this is set to false, then *val* can only contain one
|
||||
element.
|
||||
|
||||
|
||||
.. zeek:field:: ev :zeek:type:`any` :zeek:attr:`&optional`
|
||||
|
||||
The event that is raised each time a value is added to, changed in,
|
||||
or removed from the table. The event will receive an
|
||||
Input::TableDescription as the first argument, an Input::Event
|
||||
enum as the second argument, the *idx* record as the third argument
|
||||
and the value (record) as the fourth argument.
|
||||
|
||||
|
||||
.. zeek:field:: pred :zeek:type:`function` (typ: :zeek:type:`Input::Event`, left: :zeek:type:`any`, right: :zeek:type:`any`) : :zeek:type:`bool` :zeek:attr:`&optional`
|
||||
|
||||
Predicate function that can decide if an insertion, update or removal
|
||||
should really be executed. Parameters have same meaning as for the
|
||||
event.
|
||||
If true is returned, the update is performed. If false is returned,
|
||||
it is skipped.
|
||||
|
||||
|
||||
.. zeek:field:: error_ev :zeek:type:`any` :zeek:attr:`&optional`
|
||||
|
||||
Error event that is raised when an information, warning or error
|
||||
is raised by the input stream. If the level is error, the stream will automatically
|
||||
be closed.
|
||||
The event receives the Input::TableDescription as the first argument, the
|
||||
message as the second argument and the Reporter::Level as the third argument.
|
||||
|
||||
The event is raised like if it had been declared as follows:
|
||||
error_ev: function(desc: TableDescription, message: string, level: Reporter::Level) &optional;
|
||||
The actual declaration uses the :zeek:type:`any` type because of deficiencies of the Zeek type system.
|
||||
|
||||
|
||||
.. zeek:field:: config :zeek:type:`table` [:zeek:type:`string`] of :zeek:type:`string` :zeek:attr:`&default` = ``{ }`` :zeek:attr:`&optional`
|
||||
|
||||
A key/value table that will be passed to the reader.
|
||||
Interpretation of the values is left to the reader, but
|
||||
usually they will be used for configuration purposes.
|
||||
|
||||
|
||||
A table input stream type used to send data to a Zeek table.
|
||||
|
||||
.. zeek:type:: Input::Reader
|
||||
|
||||
:Type: :zeek:type:`enum`
|
||||
|
||||
.. zeek:enum:: Input::READER_ASCII Input::Reader
|
||||
|
||||
.. zeek:enum:: Input::READER_BENCHMARK Input::Reader
|
||||
|
||||
.. zeek:enum:: Input::READER_BINARY Input::Reader
|
||||
|
||||
.. zeek:enum:: Input::READER_CONFIG Input::Reader
|
||||
|
||||
.. zeek:enum:: Input::READER_RAW Input::Reader
|
||||
|
||||
.. zeek:enum:: Input::READER_SQLITE Input::Reader
|
||||
|
||||
|
||||
Events
|
||||
######
|
||||
.. zeek:id:: Input::end_of_data
|
||||
:source-code: base/utils/exec.zeek 96 127
|
||||
|
||||
:Type: :zeek:type:`event` (name: :zeek:type:`string`, source: :zeek:type:`string`)
|
||||
|
||||
Event that is called when the end of a data source has been reached,
|
||||
including after an update.
|
||||
|
||||
|
||||
:param name: Name of the input stream.
|
||||
|
||||
|
||||
:param source: String that identifies the data source (such as the filename).
|
||||
|
||||
Functions
|
||||
#########
|
||||
.. zeek:id:: Input::add_analysis
|
||||
:source-code: base/frameworks/input/main.zeek 267 270
|
||||
|
||||
:Type: :zeek:type:`function` (description: :zeek:type:`Input::AnalysisDescription`) : :zeek:type:`bool`
|
||||
|
||||
Create a new file analysis input stream from a given source. Data read
|
||||
from the source is automatically forwarded to the file analysis
|
||||
framework.
|
||||
|
||||
|
||||
:param description: A record describing the source.
|
||||
|
||||
|
||||
:returns: true on success.
|
||||
|
||||
.. zeek:id:: Input::add_event
|
||||
:source-code: base/frameworks/input/main.zeek 262 265
|
||||
|
||||
:Type: :zeek:type:`function` (description: :zeek:type:`Input::EventDescription`) : :zeek:type:`bool`
|
||||
|
||||
Create a new event input stream from a given source.
|
||||
|
||||
|
||||
:param description: :zeek:see:`Input::EventDescription` record describing the source.
|
||||
|
||||
|
||||
:returns: true on success.
|
||||
|
||||
.. zeek:id:: Input::add_table
|
||||
:source-code: base/frameworks/input/main.zeek 257 260
|
||||
|
||||
:Type: :zeek:type:`function` (description: :zeek:type:`Input::TableDescription`) : :zeek:type:`bool`
|
||||
|
||||
Create a new table input stream from a given source.
|
||||
|
||||
|
||||
:param description: :zeek:see:`Input::TableDescription` record describing the source.
|
||||
|
||||
|
||||
:returns: true on success.
|
||||
|
||||
.. zeek:id:: Input::force_update
|
||||
:source-code: base/frameworks/input/main.zeek 277 280
|
||||
|
||||
:Type: :zeek:type:`function` (id: :zeek:type:`string`) : :zeek:type:`bool`
|
||||
|
||||
Forces the current input to be checked for changes.
|
||||
|
||||
|
||||
:param id: string value identifying the stream.
|
||||
|
||||
|
||||
:returns: true on success and false if the named stream was not found.
|
||||
|
||||
.. zeek:id:: Input::remove
|
||||
:source-code: base/frameworks/input/main.zeek 272 275
|
||||
|
||||
:Type: :zeek:type:`function` (id: :zeek:type:`string`) : :zeek:type:`bool`
|
||||
|
||||
Remove an input stream.
|
||||
|
||||
|
||||
:param id: string value identifying the stream to be removed.
|
||||
|
||||
|
||||
:returns: true on success and false if the named stream was not found.
|
||||
|
||||
|
124
doc/scripts/base/frameworks/input/readers/ascii.zeek.rst
Normal file
124
doc/scripts/base/frameworks/input/readers/ascii.zeek.rst
Normal file
|
@ -0,0 +1,124 @@
|
|||
:tocdepth: 3
|
||||
|
||||
base/frameworks/input/readers/ascii.zeek
|
||||
========================================
|
||||
.. zeek:namespace:: InputAscii
|
||||
|
||||
Interface for the ascii input reader.
|
||||
|
||||
The defaults are set to match Zeek's ASCII output.
|
||||
|
||||
:Namespace: InputAscii
|
||||
|
||||
Summary
|
||||
~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
=================================================================================== ==================================================================
|
||||
:zeek:id:`InputAscii::empty_field`: :zeek:type:`string` :zeek:attr:`&redef` String to use for empty fields.
|
||||
:zeek:id:`InputAscii::fail_on_file_problem`: :zeek:type:`bool` :zeek:attr:`&redef` Fail on file read problems.
|
||||
:zeek:id:`InputAscii::fail_on_invalid_lines`: :zeek:type:`bool` :zeek:attr:`&redef` Fail on invalid lines.
|
||||
:zeek:id:`InputAscii::path_prefix`: :zeek:type:`string` :zeek:attr:`&redef` On input streams with a pathless or relative-path source filename,
|
||||
prefix the following path.
|
||||
:zeek:id:`InputAscii::separator`: :zeek:type:`string` :zeek:attr:`&redef` Separator between fields.
|
||||
:zeek:id:`InputAscii::set_separator`: :zeek:type:`string` :zeek:attr:`&redef` Separator between set and vector elements.
|
||||
:zeek:id:`InputAscii::unset_field`: :zeek:type:`string` :zeek:attr:`&redef` String to use for an unset &optional field.
|
||||
=================================================================================== ==================================================================
|
||||
|
||||
|
||||
Detailed Interface
|
||||
~~~~~~~~~~~~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
.. zeek:id:: InputAscii::empty_field
|
||||
:source-code: base/frameworks/input/readers/ascii.zeek 17 17
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"(empty)"``
|
||||
|
||||
String to use for empty fields.
|
||||
|
||||
.. zeek:id:: InputAscii::fail_on_file_problem
|
||||
:source-code: base/frameworks/input/readers/ascii.zeek 49 49
|
||||
|
||||
:Type: :zeek:type:`bool`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``F``
|
||||
|
||||
Fail on file read problems. If set to true, the ascii
|
||||
input reader will fail when encountering any problems
|
||||
while reading a file different from invalid lines.
|
||||
Examples of such problems are permission problems, or
|
||||
missing files.
|
||||
When set to false, these problems will be ignored. This
|
||||
has an especially big effect for the REREAD mode, which will
|
||||
seamlessly recover from read errors when a file is
|
||||
only temporarily inaccessible. For MANUAL or STREAM files,
|
||||
errors will most likely still be fatal since no automatic
|
||||
re-reading of the file is attempted.
|
||||
Individual readers can use a different value using
|
||||
the $config table.
|
||||
fail_on_file_problem = T was the default behavior
|
||||
until Bro 2.6.
|
||||
|
||||
.. zeek:id:: InputAscii::fail_on_invalid_lines
|
||||
:source-code: base/frameworks/input/readers/ascii.zeek 32 32
|
||||
|
||||
:Type: :zeek:type:`bool`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``F``
|
||||
|
||||
Fail on invalid lines. If set to false, the ascii
|
||||
input reader will jump over invalid lines, reporting
|
||||
warnings in reporter.log. If set to true, errors in
|
||||
input lines will be handled as fatal errors for the
|
||||
reader thread; reading will abort immediately and
|
||||
an error will be logged to reporter.log.
|
||||
Individual readers can use a different value using
|
||||
the $config table.
|
||||
fail_on_invalid_lines = T was the default behavior
|
||||
until Bro 2.6.
|
||||
|
||||
.. zeek:id:: InputAscii::path_prefix
|
||||
:source-code: base/frameworks/input/readers/ascii.zeek 55 55
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``""``
|
||||
|
||||
On input streams with a pathless or relative-path source filename,
|
||||
prefix the following path. This prefix can, but need not be, absolute.
|
||||
The default is to leave any filenames unchanged. This prefix has no
|
||||
effect if the source already is an absolute path.
|
||||
|
||||
.. zeek:id:: InputAscii::separator
|
||||
:source-code: base/frameworks/input/readers/ascii.zeek 10 10
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"\x09"``
|
||||
|
||||
Separator between fields.
|
||||
Please note that the separator has to be exactly one character long.
|
||||
|
||||
.. zeek:id:: InputAscii::set_separator
|
||||
:source-code: base/frameworks/input/readers/ascii.zeek 14 14
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``","``
|
||||
|
||||
Separator between set and vector elements.
|
||||
Please note that the separator has to be exactly one character long.
|
||||
|
||||
.. zeek:id:: InputAscii::unset_field
|
||||
:source-code: base/frameworks/input/readers/ascii.zeek 20 20
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"-"``
|
||||
|
||||
String to use for an unset &optional field.
|
||||
|
||||
|
83
doc/scripts/base/frameworks/input/readers/benchmark.zeek.rst
Normal file
83
doc/scripts/base/frameworks/input/readers/benchmark.zeek.rst
Normal file
|
@ -0,0 +1,83 @@
|
|||
:tocdepth: 3
|
||||
|
||||
base/frameworks/input/readers/benchmark.zeek
|
||||
============================================
|
||||
.. zeek:namespace:: InputBenchmark
|
||||
|
||||
Interface for the benchmark input reader.
|
||||
|
||||
:Namespace: InputBenchmark
|
||||
|
||||
Summary
|
||||
~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
=============================================================================== =========================================================
|
||||
:zeek:id:`InputBenchmark::addfactor`: :zeek:type:`count` :zeek:attr:`&redef` Addition factor for each heartbeat.
|
||||
:zeek:id:`InputBenchmark::autospread`: :zeek:type:`double` :zeek:attr:`&redef` Spreading where usleep = 1000000 / autospread * num_lines
|
||||
:zeek:id:`InputBenchmark::factor`: :zeek:type:`double` :zeek:attr:`&redef` Multiplication factor for each second.
|
||||
:zeek:id:`InputBenchmark::spread`: :zeek:type:`count` :zeek:attr:`&redef` Spread factor between lines.
|
||||
:zeek:id:`InputBenchmark::stopspreadat`: :zeek:type:`count` :zeek:attr:`&redef` Stop spreading at x lines per heartbeat.
|
||||
:zeek:id:`InputBenchmark::timedspread`: :zeek:type:`double` :zeek:attr:`&redef` 1 -> enable timed spreading.
|
||||
=============================================================================== =========================================================
|
||||
|
||||
|
||||
Detailed Interface
|
||||
~~~~~~~~~~~~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
.. zeek:id:: InputBenchmark::addfactor
|
||||
:source-code: base/frameworks/input/readers/benchmark.zeek 16 16
|
||||
|
||||
:Type: :zeek:type:`count`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``0``
|
||||
|
||||
Addition factor for each heartbeat.
|
||||
|
||||
.. zeek:id:: InputBenchmark::autospread
|
||||
:source-code: base/frameworks/input/readers/benchmark.zeek 13 13
|
||||
|
||||
:Type: :zeek:type:`double`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``0.0``
|
||||
|
||||
Spreading where usleep = 1000000 / autospread * num_lines
|
||||
|
||||
.. zeek:id:: InputBenchmark::factor
|
||||
:source-code: base/frameworks/input/readers/benchmark.zeek 7 7
|
||||
|
||||
:Type: :zeek:type:`double`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``1.0``
|
||||
|
||||
Multiplication factor for each second.
|
||||
|
||||
.. zeek:id:: InputBenchmark::spread
|
||||
:source-code: base/frameworks/input/readers/benchmark.zeek 10 10
|
||||
|
||||
:Type: :zeek:type:`count`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``0``
|
||||
|
||||
Spread factor between lines.
|
||||
|
||||
.. zeek:id:: InputBenchmark::stopspreadat
|
||||
:source-code: base/frameworks/input/readers/benchmark.zeek 19 19
|
||||
|
||||
:Type: :zeek:type:`count`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``0``
|
||||
|
||||
Stop spreading at x lines per heartbeat.
|
||||
|
||||
.. zeek:id:: InputBenchmark::timedspread
|
||||
:source-code: base/frameworks/input/readers/benchmark.zeek 22 22
|
||||
|
||||
:Type: :zeek:type:`double`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``0.0``
|
||||
|
||||
1 -> enable timed spreading.
|
||||
|
||||
|
47
doc/scripts/base/frameworks/input/readers/binary.zeek.rst
Normal file
47
doc/scripts/base/frameworks/input/readers/binary.zeek.rst
Normal file
|
@ -0,0 +1,47 @@
|
|||
:tocdepth: 3
|
||||
|
||||
base/frameworks/input/readers/binary.zeek
|
||||
=========================================
|
||||
.. zeek:namespace:: InputBinary
|
||||
|
||||
Interface for the binary input reader.
|
||||
|
||||
:Namespace: InputBinary
|
||||
|
||||
Summary
|
||||
~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
============================================================================ ==================================================================
|
||||
:zeek:id:`InputBinary::chunk_size`: :zeek:type:`count` :zeek:attr:`&redef` Size of data chunks to read from the input file at a time.
|
||||
:zeek:id:`InputBinary::path_prefix`: :zeek:type:`string` :zeek:attr:`&redef` On input streams with a pathless or relative-path source filename,
|
||||
prefix the following path.
|
||||
============================================================================ ==================================================================
|
||||
|
||||
|
||||
Detailed Interface
|
||||
~~~~~~~~~~~~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
.. zeek:id:: InputBinary::chunk_size
|
||||
:source-code: base/frameworks/input/readers/binary.zeek 7 7
|
||||
|
||||
:Type: :zeek:type:`count`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``1024``
|
||||
|
||||
Size of data chunks to read from the input file at a time.
|
||||
|
||||
.. zeek:id:: InputBinary::path_prefix
|
||||
:source-code: base/frameworks/input/readers/binary.zeek 13 13
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``""``
|
||||
|
||||
On input streams with a pathless or relative-path source filename,
|
||||
prefix the following path. This prefix can, but need not be, absolute.
|
||||
The default is to leave any filenames unchanged. This prefix has no
|
||||
effect if the source already is an absolute path.
|
||||
|
||||
|
99
doc/scripts/base/frameworks/input/readers/config.zeek.rst
Normal file
99
doc/scripts/base/frameworks/input/readers/config.zeek.rst
Normal file
|
@ -0,0 +1,99 @@
|
|||
:tocdepth: 3
|
||||
|
||||
base/frameworks/input/readers/config.zeek
|
||||
=========================================
|
||||
.. zeek:namespace:: InputConfig
|
||||
|
||||
Interface for the config input reader.
|
||||
|
||||
:Namespace: InputConfig
|
||||
|
||||
Summary
|
||||
~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
=================================================================================== ==========================================
|
||||
:zeek:id:`InputConfig::empty_field`: :zeek:type:`string` :zeek:attr:`&redef` String to use for empty fields.
|
||||
:zeek:id:`InputConfig::fail_on_file_problem`: :zeek:type:`bool` :zeek:attr:`&redef` Fail on file read problems.
|
||||
:zeek:id:`InputConfig::set_separator`: :zeek:type:`string` :zeek:attr:`&redef` Separator between set and vector elements.
|
||||
=================================================================================== ==========================================
|
||||
|
||||
Events
|
||||
######
|
||||
===================================================== ==============================================================
|
||||
:zeek:id:`InputConfig::new_value`: :zeek:type:`event` Event that is called when a config option is added or changes.
|
||||
===================================================== ==============================================================
|
||||
|
||||
|
||||
Detailed Interface
|
||||
~~~~~~~~~~~~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
.. zeek:id:: InputConfig::empty_field
|
||||
:source-code: base/frameworks/input/readers/config.zeek 13 13
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``""``
|
||||
|
||||
String to use for empty fields.
|
||||
By default this is the empty string, meaning that an empty input field
|
||||
will result in an empty set.
|
||||
|
||||
.. zeek:id:: InputConfig::fail_on_file_problem
|
||||
:source-code: base/frameworks/input/readers/config.zeek 28 28
|
||||
|
||||
:Type: :zeek:type:`bool`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``F``
|
||||
|
||||
Fail on file read problems. If set to true, the config
|
||||
input reader will fail when encountering any problems
|
||||
while reading a file different from invalid lines.
|
||||
Examples of such problems are permission problems, or
|
||||
missing files.
|
||||
When set to false, these problems will be ignored. This
|
||||
has an especially big effect for the REREAD mode, which will
|
||||
seamlessly recover from read errors when a file is
|
||||
only temporarily inaccessible. For MANUAL or STREAM files,
|
||||
errors will most likely still be fatal since no automatic
|
||||
re-reading of the file is attempted.
|
||||
Individual readers can use a different value using
|
||||
the $config table.
|
||||
|
||||
.. zeek:id:: InputConfig::set_separator
|
||||
:source-code: base/frameworks/input/readers/config.zeek 8 8
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``","``
|
||||
|
||||
Separator between set and vector elements.
|
||||
Please note that the separator has to be exactly one character long.
|
||||
|
||||
Events
|
||||
######
|
||||
.. zeek:id:: InputConfig::new_value
|
||||
:source-code: base/frameworks/config/input.zeek 53 59
|
||||
|
||||
:Type: :zeek:type:`event` (name: :zeek:type:`string`, source: :zeek:type:`string`, id: :zeek:type:`string`, value: :zeek:type:`any`)
|
||||
|
||||
Event that is called when a config option is added or changes.
|
||||
|
||||
Note - this does not track the reason for a change (new, changed),
|
||||
and also does not track removals. If you need this, combine the event
|
||||
with a table reader.
|
||||
|
||||
|
||||
:param name: Name of the input stream.
|
||||
|
||||
|
||||
:param source: Source of the input stream.
|
||||
|
||||
|
||||
:param id: ID of the configuration option being set.
|
||||
|
||||
|
||||
:param value: New value of the configuration option being set.
|
||||
|
||||
|
60
doc/scripts/base/frameworks/input/readers/raw.zeek.rst
Normal file
60
doc/scripts/base/frameworks/input/readers/raw.zeek.rst
Normal file
|
@ -0,0 +1,60 @@
|
|||
:tocdepth: 3
|
||||
|
||||
base/frameworks/input/readers/raw.zeek
|
||||
======================================
|
||||
.. zeek:namespace:: InputRaw
|
||||
|
||||
Interface for the raw input reader.
|
||||
|
||||
:Namespace: InputRaw
|
||||
|
||||
Summary
|
||||
~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
============================================================================== ================================
|
||||
:zeek:id:`InputRaw::record_separator`: :zeek:type:`string` :zeek:attr:`&redef` Separator between input records.
|
||||
============================================================================== ================================
|
||||
|
||||
Events
|
||||
######
|
||||
========================================================= ====================================================================
|
||||
:zeek:id:`InputRaw::process_finished`: :zeek:type:`event` Event that is called when a process created by the raw reader exits.
|
||||
========================================================= ====================================================================
|
||||
|
||||
|
||||
Detailed Interface
|
||||
~~~~~~~~~~~~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
.. zeek:id:: InputRaw::record_separator
|
||||
:source-code: base/frameworks/input/readers/raw.zeek 8 8
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"\x0a"``
|
||||
|
||||
Separator between input records.
|
||||
Please note that the separator has to be exactly one character long.
|
||||
|
||||
Events
|
||||
######
|
||||
.. zeek:id:: InputRaw::process_finished
|
||||
:source-code: base/utils/exec.zeek 129 151
|
||||
|
||||
:Type: :zeek:type:`event` (name: :zeek:type:`string`, source: :zeek:type:`string`, exit_code: :zeek:type:`count`, signal_exit: :zeek:type:`bool`)
|
||||
|
||||
Event that is called when a process created by the raw reader exits.
|
||||
|
||||
|
||||
:param name: name of the input stream.
|
||||
|
||||
:param source: source of the input stream.
|
||||
|
||||
:param exit_code: exit code of the program, or number of the signal that forced
|
||||
the program to exit.
|
||||
|
||||
:param signal_exit: false when program exited normally, true when program was
|
||||
forced to exit by a signal.
|
||||
|
||||
|
62
doc/scripts/base/frameworks/input/readers/sqlite.zeek.rst
Normal file
62
doc/scripts/base/frameworks/input/readers/sqlite.zeek.rst
Normal file
|
@ -0,0 +1,62 @@
|
|||
:tocdepth: 3
|
||||
|
||||
base/frameworks/input/readers/sqlite.zeek
|
||||
=========================================
|
||||
.. zeek:namespace:: InputSQLite
|
||||
|
||||
Interface for the SQLite input reader. Redefinable options are available
|
||||
to tweak the input format of the SQLite reader.
|
||||
|
||||
See :doc:`/frameworks/logging-input-sqlite` for an introduction on how to
|
||||
use the SQLite reader.
|
||||
|
||||
When using the SQLite reader, you have to specify the SQL query that returns
|
||||
the desired data by setting ``query`` in the ``config`` table. See the
|
||||
introduction mentioned above for an example.
|
||||
|
||||
:Namespace: InputSQLite
|
||||
|
||||
Summary
|
||||
~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
============================================================================== ===========================================
|
||||
:zeek:id:`InputSQLite::empty_field`: :zeek:type:`string` :zeek:attr:`&redef` String to use for empty fields.
|
||||
:zeek:id:`InputSQLite::set_separator`: :zeek:type:`string` :zeek:attr:`&redef` Separator between set elements.
|
||||
:zeek:id:`InputSQLite::unset_field`: :zeek:type:`string` :zeek:attr:`&redef` String to use for an unset &optional field.
|
||||
============================================================================== ===========================================
|
||||
|
||||
|
||||
Detailed Interface
|
||||
~~~~~~~~~~~~~~~~~~
|
||||
Redefinable Options
|
||||
###################
|
||||
.. zeek:id:: InputSQLite::empty_field
|
||||
:source-code: base/frameworks/input/readers/sqlite.zeek 22 22
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"(empty)"``
|
||||
|
||||
String to use for empty fields.
|
||||
|
||||
.. zeek:id:: InputSQLite::set_separator
|
||||
:source-code: base/frameworks/input/readers/sqlite.zeek 16 16
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``","``
|
||||
|
||||
Separator between set elements.
|
||||
Please note that the separator has to be exactly one character long.
|
||||
|
||||
.. zeek:id:: InputSQLite::unset_field
|
||||
:source-code: base/frameworks/input/readers/sqlite.zeek 19 19
|
||||
|
||||
:Type: :zeek:type:`string`
|
||||
:Attributes: :zeek:attr:`&redef`
|
||||
:Default: ``"-"``
|
||||
|
||||
String to use for an unset &optional field.
|
||||
|
||||
|
Loading…
Add table
Add a link
Reference in a new issue