Commits · 075a3235a8f35d23da60fc3af70c6123a7889ee8 · LightKone / uc-monitor-go-test

29 Oct, 2019 6 commits

[goclidote] Use a transaction per device in RemoveDevicesFromAntidote() · 075a3235

Roger Pueyo Centelles authored Oct 29, 2019

Removing a large array of devices, with thousands of updates inside a
single client.StartTransaction() terribly slow down the request.
Instead, do a transaction commit after processing each item in the
array, still inside a single connection to AntidoteDB.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

075a3235

[goclidote] Fix function description · 6a87410a
Roger Pueyo Centelles authored Oct 29, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
6a87410a

[monitor-fetch-and-upload] An improved monitor-fetch · 7650fc66

Roger Pueyo Centelles authored Oct 29, 2019



Forked from monitor-fetch, monitor-fetch-and-upload is able to remove
outdated devices from AntidoteDB with just a single AntidoteDB
connection (using goclidote's RemoveDevicesFromAntidote() function),
a significant improvement compared to the the 4 x len(oldDevices)
connections that were used up to now.

For example, removing the 1131 devices in the Barcelona CNML from
AntidoteDB took this time before:

real	0m25,709s
user	0m2,985s
sys	0m3,473s

and now takes:

real	0m16,664s
user	0m1,951s
sys	0m1,995s
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

7650fc66

[monitor-fetch] Remove debris · dc3372ae
Roger Pueyo Centelles authored Oct 29, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
dc3372ae

[goclidote] Add RemoveDevicesFromAntidote() function · f74bf9e8

Roger Pueyo Centelles authored Oct 29, 2019



The RemoveDevicesFromAntidote() function gracefully removes from
AntidoteDB a []cnml.DeviceIpv4sGraphserver list of devices reusing a
single connection.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

f74bf9e8

[goclidote] Rename variable according to data type · 0da948dc
Roger Pueyo Centelles authored Oct 29, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
0da948dc

28 Oct, 2019 1 commit
- [monitor-snmp] Use unique error messages in getSNMPData() · 0c436957
  Roger Pueyo Centelles authored Oct 28, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  0c436957
07 Oct, 2019 2 commits
- [monitor-assign] Set an assignation filling time through a variable · 0a052624
  Roger Pueyo Centelles authored Oct 07, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  0a052624
- [assign-view] Get rid of hardcoded values · 6c350832
  Roger Pueyo Centelles authored Oct 07, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  6c350832
03 Oct, 2019 2 commits

[assign-view] Distribute monitors evenly · 7c81ec6a
Roger Pueyo Centelles authored Oct 03, 2019
```
Clean debris.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
7c81ec6a

[assign-view] De-hardcode variables · c0905f79

Roger Pueyo Centelles authored Oct 03, 2019



Adjust the graph size to the window size and other automations.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

c0905f79

02 Oct, 2019 1 commit
- [assign-view] Use local svg.js · 36f68768
  Roger Pueyo Centelles authored Oct 02, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  36f68768
01 Oct, 2019 8 commits
- [assign-view] A dummy JS web plotting assignations · b6613f9d
  Roger Pueyo Centelles authored Oct 01, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  b6613f9d
- [dump-monitor-assign] A dummy tool to dump assignations · 1ab69a53
  Roger Pueyo Centelles authored Oct 01, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  1ab69a53
- Update README.md · 35b4083f
  Roger Pueyo Centelles authored Oct 01, 2019
```
Include SNMP raw data details.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  35b4083f
- [monitor-snmp] Save monitoring data to AntidoteDB · fbc9b728
  Roger Pueyo Centelles authored Oct 01, 2019
```
For devices not reachable, or not reporting data, nothing is saved.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  fbc9b728
- [goclidote] Fix spacing · 5fe97abd
  Roger Pueyo Centelles authored Oct 01, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  5fe97abd
- [monitor-snmp] Fix saving TxBytes · 4f3a1d91
  Roger Pueyo Centelles authored Oct 01, 2019
```
RxBytes was being saved twice, instead of TxBytes.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  4f3a1d91
- [monitor-snmp] Discard readings from "lo" interface · 03735960
  Roger Pueyo Centelles authored Oct 01, 2019
```
The loopback ("lo") interface is of no interest; don't collect it.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  03735960
- [monitor-snmp] Manage faulty devices. Code clean-up · ad41ec5f
  Roger Pueyo Centelles authored Oct 01, 2019
```
Non-reachable or non-replying devices are now gracefully managed.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  ad41ec5f
30 Sep, 2019 1 commit

[monitor-snmp] Query for interfaces' info sequentially · e3c9ba11

Roger Pueyo Centelles authored Sep 30, 2019



Interfaces' numbers are not always consecutive. Iterate untill all
interfaces are found, or up to a maximum of 2048.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

e3c9ba11

27 Sep, 2019 5 commits

[monitor-snmp] Query interface names and traffic · c779a07c

Roger Pueyo Centelles authored Sep 27, 2019



This proof-of-concept monitor-snmp.go program, based on the
ping one, queries a router via SNMP for the interface names
and their traffic.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

c779a07c

Update README · e6e94a56
Roger Pueyo Centelles authored Sep 27, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
e6e94a56

[monitor-ping] Use AntidoteAddArrayToSetInMapInMapInBucket · 87cd582f

Roger Pueyo Centelles authored Sep 27, 2019



Pings are stored in sets in maps in a map in buckets using the
AntidoteAddArrayToSetInMapInMapInBucket. Also, the monitor ID is
appended to the key name.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

87cd582f

[goclidote] Add function AntidoteAddArrayToSetInMapInMapInBucket · fd650331

Roger Pueyo Centelles authored Sep 27, 2019



This function allows saving an array to a map which is inside a map
inside a bucket.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

fd650331

[goclidote-demo] Add newline to improve visualisation · 7431530f
Roger Pueyo Centelles authored Sep 27, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
7431530f

25 Sep, 2019 9 commits

[monitor-ping] Truncate to 5 min time in measurement keys · fe2f71d3

Roger Pueyo Centelles authored Sep 26, 2019



Ping measurements are stored in AntidoteDB as key:values like
"current_date_time"=>[value0, value1, value2, ..., valueN].
Measurements are performed once every 5 minutes but they won't match
o'clock + n*5min exactly, so truncate the time in the measurement to
5 minutes multiples.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

fe2f71d3

[monitor-ping] Remove sample main file · 1965856b
Roger Pueyo Centelles authored Sep 25, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
1965856b

[monitor-fetch] Manage SNMP names · 77040159

Roger Pueyo Centelles authored Sep 25, 2019



This commit adds the monitor-fetch application with the functionality
to manage the SNMP interface names available in the CNML files, write
them to AntidoteDB and retrieve them back.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

77040159

[monitor-fetch] Remove unnecessary brackets · 014dabbf
Roger Pueyo Centelles authored Sep 25, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
014dabbf
[cnml] Add SNMP names to DeviceIpv4sGraphserver structs · 38e57f49
Roger Pueyo Centelles authored Sep 25, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
38e57f49
[goclidote] Include the SNMP names when reading a device · d7fc5652
Roger Pueyo Centelles authored Sep 25, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
d7fc5652
[monitor-fetch] Remove ineffectual assignment · 4c8cb122
Roger Pueyo Centelles authored Sep 25, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
4c8cb122
[monitor-fetch] Fix style · 88222d9b
Roger Pueyo Centelles authored Sep 25, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
88222d9b
[cnml] The "Radios" field in a Device is a []Radio array · 2a7d11c3
Roger Pueyo Centelles authored Sep 25, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
2a7d11c3

14 Jun, 2019 1 commit
- Update README · 8f7edbb6
  Roger Pueyo Centelles authored Jun 14, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  8f7edbb6
12 Jun, 2019 2 commits

[goclidote] Add 1 ms waits in certain repetitive calls · 3e11e4be

Roger Pueyo Centelles authored Jun 12, 2019



Adding this wait time makes the AntidoteDB go client not crash.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

3e11e4be

[monitor-assign] Update the globalAssign list less often · 3356bfed

Roger Pueyo Centelles authored Jun 12, 2019



Since such an update rate is not really need it, do it less often
to try to avoid crashes in AntidoteDB's go client.

Also add some more verbosity.
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>

3356bfed

11 Jun, 2019 2 commits
- [monitor-assign] Fix variable calling (v.ID) · ee6b662f
  Roger Pueyo Centelles authored Jun 11, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  ee6b662f
- [goclidote] Add verbosity to error messages · a1040d34
  Roger Pueyo Centelles authored Jun 11, 2019
```
Signed-off-by: Roger Pueyo Centelles <rpueyo@ac.upc.edu>
```
  a1040d34