Commit Graph

5761 Commits

Author SHA1 Message Date
Bryan Boreham
2549d5e1e1 WIP part-way through trying to rewrite detailed renderers 2020-06-21 15:00:47 +00:00
Bryan Boreham
e0bb1cd385 Improve NodeIDType() 2020-06-21 15:00:06 +00:00
Bryan Boreham
349a823ea2 update test for Go 1.13 2020-06-21 14:59:37 +00:00
Bryan Boreham
f77131c1a6 optimization: turn propagatePodHost from a Map to a Renderer 2020-06-08 16:44:41 +00:00
Bryan Boreham
6a6ef51ef5 optimization: generate children counts on demand
Accumulating counts in the Node data structure takes a lot of effort,
and it turns out we only use this information in a few places where
it's easy to compute.
2020-06-08 16:42:24 +00:00
Bryan Boreham
d76da767d8 optimization: store just IDs of child nodes
IDs are a lot smaller, hence quicker to manage.
Any time we want to refer back to the full node we look it up in its topology.

(This relies on nobody trying to store a rendered node as a child).
2020-06-08 16:39:53 +00:00
Bryan Boreham
b4a73b7f87 Go 1.14 fix for modules.txt 2020-06-07 12:31:03 +00:00
Bryan Boreham
7c54093bf7 Change process-to-container from Map to Renderer
This allows us to be more efficient when collating the data.
2020-06-07 11:12:02 +00:00
Bryan Boreham
7163f42170 Merge pull request #3785 from weaveworks/go-1-14-2
Update tools: Go 1.4.2 and JS kind-of 6.0.3
2020-05-20 11:17:44 +01:00
Bryan Boreham
7f48d7ebc8 Merge pull request #3790 from knrt10/exampleFix
Fixed example for PodSecurityPolicy inside examples/k8s/psp.yaml
2020-05-20 11:16:50 +01:00
knrt10
73cb10ab64 expamples: Fixed examples/k8s/psp.yaml file
PodSecurityPolicy (in the extensions/v1beta1 API group)
Migrated to use the policy/v1beta1 API, available since v1.10. Existing persisted data can be retrieved/updated via the policy/v1beta1 API.

Signed-off-by: knrt10 <tripathi.kautilya@gmail.com>
2020-05-20 15:15:02 +05:30
Bryan Boreham
b308f0cf51 Merge pull request #3789 from weaveworks/billing-use-container-info
multitenant: scan container command-lines as well as process
2020-05-19 12:17:08 +01:00
Bryan Boreham
b117b1a5ef cosmetic: move misplaced import 2020-05-19 10:09:52 +00:00
Bryan Boreham
ad82fafde8 multitenant: scan container command-lines as well as process 2020-05-19 10:09:28 +00:00
Bryan Boreham
f83ad517d8 multitenant: extract command-line parsing function and add test 2020-05-19 10:07:23 +00:00
Bryan Boreham
5262f0c320 Ran 'go mod tidy' 2020-05-19 09:24:12 +00:00
Bryan Boreham
ef608ef257 Merge pull request #3788 from weaveworks/release-1.13
Release 1.13.1
2020-05-18 16:37:53 +01:00
Bryan Boreham
2f9ccdc8be Release 1.13.1 v1.13.1 2020-05-18 12:57:01 +00:00
Bryan Boreham
e907a51c36 Merge pull request #3787 from weaveworks/release-args-unquoted
Don't quote RELEASE_ARGS which may contain two arguments
2020-05-18 13:38:01 +01:00
Bryan Boreham
01804cb69d Merge pull request #3754 from CiMaol/dev/removeKubeletPort
Removed kubelet port flag. Node name now always need from env/flag
2020-05-18 12:27:06 +01:00
Bryan Boreham
1ad83e85de Warn user if probe is now reporting pods from every node. 2020-05-10 15:34:17 +00:00
Bryan Boreham
f0e43aa020 fix(probe): wait for ebpf tracker to stop on exit
We should have done this anyway, but I haven't noticed the error
previously. Possibly Go 1.14 is more aggressive about exiting when
some goroutines are still active.
2020-05-10 15:30:28 +00:00
Bryan Boreham
1a8dc90633 ui: update kind-of module to 6.0.3
We got a warning about a vulnerability in 6.0.2
2020-05-07 15:14:08 +00:00
Bryan Boreham
22aa742b58 build: upgrade Go to 1.14.2 2020-05-07 11:46:52 +00:00
Bryan Boreham
47519e41df Merge pull request #3784 from weaveworks/pipe-errors
Stop pipe operations after EOF
2020-05-07 12:28:51 +01:00
Bryan Boreham
24197bc71e fix (pipes): silence EOF error
This comes back when an operation like Kubernetes Describe finishes;
hide it so we don't print as an error.
2020-05-06 10:04:44 +00:00
Bryan Boreham
323aa46d1c fix (pipes): check websocket errors inside CopyToWebsocket()
Previously we were treating EOF on the reader as no-error, meaning
that operations like Kubernetes Describe would retry endlessly when
finished.
2020-05-06 10:04:40 +00:00
Bryan Boreham
7f0f13b083 Merge pull request #3782 from weaveworks/limit-topologies-on-collection
Upgrade reports before merging in multitenant collector
2020-04-17 11:24:14 +01:00
Bryan Boreham
fa4d1c4c2b Upgrade reports before merging
In case they came from an older or an overload probe.
2020-04-16 19:27:40 +00:00
Bryan Boreham
b772fa83b3 Add a metric for topologies dropped because they are over limit
Need to modify DropTopologiesOver() to report what it dropped, and
plumb through the userid so the metric can show who has a problem.
2020-04-16 19:27:28 +00:00
Bryan Boreham
24847e81c5 Merge pull request #3780 from weaveworks/merge-in-collector
Multitenant: merge incoming reports in collector
2020-04-15 19:08:39 +01:00
Bryan Boreham
b1fc59819a comment: clarify memcached error cases 2020-04-15 16:49:02 +00:00
Bryan Boreham
9a739fda46 Parallelise sending merged reports to store
Writes to DynamoDB and S3 can be done in parallel, which will reduce
the overall flush time.
2020-04-13 19:11:34 +00:00
Bryan Boreham
2629d13780 Add a histogram for flush times 2020-04-13 19:11:34 +00:00
Bryan Boreham
ccf031b8a9 enhancement(multitenant): merge incoming reports in a time window
This means we store fewer, bigger, reports, which reduces cost of
storage and time to render when data is viewed.
2020-04-13 19:11:34 +00:00
Bryan Boreham
104b9cba50 refactor: Call Close() on collector
Doesn't do anything at present, but will be used later.

Change the signature on BillingEmitter.Close() to match. Note we didn't use the error returned.
2020-04-13 19:11:34 +00:00
Bryan Boreham
777ff07e19 refactor(multitenant): break report storage code out into sub-functions
So the main Add() function isn't so long.
2020-04-13 19:11:34 +00:00
Bryan Boreham
0405a5983b Merge pull request #3781 from weaveworks/lock-rounding-map
fix(multitenant): move use of rounding map inside lock
2020-04-13 17:34:47 +01:00
Bryan Boreham
8c46367808 fix(multitenant): move use of rounding map inside lock 2020-04-13 16:16:20 +00:00
Bryan Boreham
5553e6ec80 Merge pull request #3779 from weaveworks/rounding
enhancement(multitenant): Track rounding error in billing calculation
2020-04-11 08:23:29 +01:00
Bryan Boreham
3f11352435 enhancement(multitenant): Track rounding error in billing calculation
Billing takes an integer number of seconds, so keep track of the
amount lost to rounding when the publish interval is not an integer.
2020-04-10 19:04:50 +00:00
Bryan Boreham
7a9c5142f5 Don't quote RELEASE_ARGS which may contain two arguments
If it is "--draft --pre-release" then we need to pass that unquoted so
it is seen as two arguments.
2020-04-10 17:39:47 +00:00
Bryan Boreham
6f05b09081 Merge pull request #3774 from weaveworks/probe-skip-empty-reports
fix (probe): skip publishing empty reports
2020-04-02 11:15:24 +01:00
Filip Barl
103b615084 Merge pull request #3777 from weaveworks/fbarl/change-contact-info
Change Filip's contact info
2020-03-31 17:14:50 +02:00
Filip Barl
1532ad2056 Change Filip's contact filip@weave.works -> filip.barl@gmail.com 2020-03-31 16:50:25 +02:00
Daniel Holbach
c3d5861970 Merge pull request #3776 from weaveworks/security-update
security(js-dependency) update html-webpack-plugin to most recent stable
2020-03-30 17:20:00 +02:00
Daniel Holbach
8e51bbaba7 security(js-dependency) update html-webpack-plugin to most recent stable 2020-03-30 12:32:09 +02:00
Bryan Boreham
8368c5ae2c Merge pull request #3775 from weaveworks/revert-6b72246f
Revert #3773 - change to use report timestamp
2020-03-28 14:52:16 +00:00
Bryan Boreham
c784acc20d Revert change to use report timestamp
This reverts commit 6b72246fe6.

The app merges reports within a 15-second window of its own time, so
if one or more probes have a time that is several seconds different
they will get excluded from the window.
2020-03-28 13:58:34 +00:00
Bryan Boreham
d227b2528d Merge pull request #3773 from weaveworks/consistent-app-timestamps
fix (multitenant collector): Use consistent report timestamp
2020-03-27 10:09:23 +00:00