GitLab

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

The goclidote library now correctly handles communication errors with
AntidoteDB and avoids continuing a transaction if an error has
occurred.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

A monitor may deregister from the system another monitor that has not
updated its timestamp after monitorTimeout seconds. This commit
allows configuring monitorTimeout to any value in seconds, as long as
it is bigger than globalAssignCheckInterval and reassignInterval.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

It was set to 15 s in the assign-view demo, which made the monitors
keep unassigning each other after the previous commit.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

The devices are to be monitored twice every 5 min. Checking
everything every 5 or 30 seconds is overkill for AntidoteDB (it was
inherited from the assign-view demo): loops interval to 150 s are OK.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Barcelonès:	~1900 devices
Osona:		~8500 devices
Catalunya:	~28000 devices
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

The AddDevicesToAntidote89 function gracefully adds to AntidoteDB a
[]cnml.DeviceIpv4sGraphserver list of devices reusing a single
connection, hence reducing the operation time.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Removing a large array of devices, with thousands of updates inside a
single client.StartTransaction() terribly slow down the request.
Instead, do a transaction commit after processing each item in the
array, still inside a single connection to AntidoteDB.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Forked from monitor-fetch, monitor-fetch-and-upload is able to remove
outdated devices from AntidoteDB with just a single AntidoteDB
connection (using goclidote's RemoveDevicesFromAntidote() function),
a significant improvement compared to the the 4 x len(oldDevices)
connections that were used up to now.

For example, removing the 1131 devices in the Barcelona CNML from
AntidoteDB took this time before:

real	0m25,709s
user	0m2,985s
sys	0m3,473s

and now takes:

real	0m16,664s
user	0m1,951s
sys	0m1,995s
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

The RemoveDevicesFromAntidote() function gracefully removes from
AntidoteDB a []cnml.DeviceIpv4sGraphserver list of devices reusing a
single connection.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Clean debris.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Adjust the graph size to the window size and other automations.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Include SNMP raw data details.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

For devices not reachable, or not reporting data, nothing is saved.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

RxBytes was being saved twice, instead of TxBytes.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

The loopback ("lo") interface is of no interest; don't collect it.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Non-reachable or non-replying devices are now gracefully managed.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Interfaces' numbers are not always consecutive. Iterate untill all
interfaces are found, or up to a maximum of 2048.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

This proof-of-concept monitor-snmp.go program, based on the
ping one, queries a router via SNMP for the interface names
and their traffic.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Pings are stored in sets in maps in a map in buckets using the
AntidoteAddArrayToSetInMapInMapInBucket. Also, the monitor ID is
appended to the key name.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

This function allows saving an array to a map which is inside a map
inside a bucket.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Ping measurements are stored in AntidoteDB as key:values like
"current_date_time"=>[value0, value1, value2, ..., valueN].
Measurements are performed once every 5 minutes but they won't match
o'clock + n*5min exactly, so truncate the time in the measurement to
5 minutes multiples.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

This commit adds the monitor-fetch application with the functionality
to manage the SNMP interface names available in the CNML files, write
them to AntidoteDB and retrieve them back.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>