Commit Graph

5930 Commits

Author SHA1 Message Date
Bryan Boreham
b1fc59819a comment: clarify memcached error cases 2020-04-15 16:49:02 +00:00
Bryan Boreham
9a739fda46 Parallelise sending merged reports to store
Writes to DynamoDB and S3 can be done in parallel, which will reduce
the overall flush time.
2020-04-13 19:11:34 +00:00
Bryan Boreham
2629d13780 Add a histogram for flush times 2020-04-13 19:11:34 +00:00
Bryan Boreham
ccf031b8a9 enhancement(multitenant): merge incoming reports in a time window
This means we store fewer, bigger, reports, which reduces cost of
storage and time to render when data is viewed.
2020-04-13 19:11:34 +00:00
Bryan Boreham
104b9cba50 refactor: Call Close() on collector
Doesn't do anything at present, but will be used later.

Change the signature on BillingEmitter.Close() to match. Note we didn't use the error returned.
2020-04-13 19:11:34 +00:00
Bryan Boreham
777ff07e19 refactor(multitenant): break report storage code out into sub-functions
So the main Add() function isn't so long.
2020-04-13 19:11:34 +00:00
Bryan Boreham
0405a5983b Merge pull request #3781 from weaveworks/lock-rounding-map
fix(multitenant): move use of rounding map inside lock
2020-04-13 17:34:47 +01:00
Bryan Boreham
8c46367808 fix(multitenant): move use of rounding map inside lock 2020-04-13 16:16:20 +00:00
Bryan Boreham
5553e6ec80 Merge pull request #3779 from weaveworks/rounding
enhancement(multitenant): Track rounding error in billing calculation
2020-04-11 08:23:29 +01:00
Bryan Boreham
3f11352435 enhancement(multitenant): Track rounding error in billing calculation
Billing takes an integer number of seconds, so keep track of the
amount lost to rounding when the publish interval is not an integer.
2020-04-10 19:04:50 +00:00
Bryan Boreham
7a9c5142f5 Don't quote RELEASE_ARGS which may contain two arguments
If it is "--draft --pre-release" then we need to pass that unquoted so
it is seen as two arguments.
2020-04-10 17:39:47 +00:00
Bryan Boreham
6f05b09081 Merge pull request #3774 from weaveworks/probe-skip-empty-reports
fix (probe): skip publishing empty reports
2020-04-02 11:15:24 +01:00
Filip Barl
103b615084 Merge pull request #3777 from weaveworks/fbarl/change-contact-info
Change Filip's contact info
2020-03-31 17:14:50 +02:00
Filip Barl
1532ad2056 Change Filip's contact filip@weave.works -> filip.barl@gmail.com 2020-03-31 16:50:25 +02:00
Daniel Holbach
c3d5861970 Merge pull request #3776 from weaveworks/security-update
security(js-dependency) update html-webpack-plugin to most recent stable
2020-03-30 17:20:00 +02:00
Daniel Holbach
8e51bbaba7 security(js-dependency) update html-webpack-plugin to most recent stable 2020-03-30 12:32:09 +02:00
Bryan Boreham
8368c5ae2c Merge pull request #3775 from weaveworks/revert-6b72246f
Revert #3773 - change to use report timestamp
2020-03-28 14:52:16 +00:00
Bryan Boreham
c784acc20d Revert change to use report timestamp
This reverts commit 6b72246fe6.

The app merges reports within a 15-second window of its own time, so
if one or more probes have a time that is several seconds different
they will get excluded from the window.
2020-03-28 13:58:34 +00:00
Bryan Boreham
d227b2528d Merge pull request #3773 from weaveworks/consistent-app-timestamps
fix (multitenant collector): Use consistent report timestamp
2020-03-27 10:09:23 +00:00
Bryan Boreham
951d7a1412 fix (probe): skip publishing empty reports
If the probe is configured with `spy.interval` greater than
`publish.interval`, the report to be published can be completely
blank.  In that case, skip publishing it so the next time we do have
some data the time-window is correct.
2020-03-27 09:59:09 +00:00
Bryan Boreham
6b72246fe6 fix (multitenant collector): Use consistent report timestamp
Previously the code called `time.Now()` in two different places so the
timestamps didn't match. Now we use the timestamp of the report itself.

Add the collector's local time to the report if it didn't have one.
2020-03-26 19:15:34 +00:00
Bryan Boreham
54267b769c Merge pull request #3772 from weaveworks/downgrade-fluent-lib
dependencies: downgrade fluent-logger-golang library used in multitenant mode
2020-03-26 19:04:08 +00:00
Bryan Boreham
697116cb0d Downgrade fluent-logger-golang library.
The later version silently drops all data if it cannot connect.
https://github.com/fluent/fluent-logger-golang/issues/80
2020-03-26 17:57:25 +00:00
Daniel Holbach
b3f212755b Merge pull request #3770 from dholbach/fix-broken-links
fix two broken links
2020-03-25 11:42:20 +01:00
Daniel Holbach
5942b7a89c fix two broken links 2020-03-24 16:11:45 +01:00
Bryan Boreham
7c838affaa Release 1.13.0 1.13.0 2020-03-23 15:04:50 +00:00
Bryan Boreham
b2d98dc1f7 Add doc files so 'go clean' can run
If the directories are empty then go modules tries to download them.
2020-03-23 15:04:50 +00:00
Bryan Boreham
3327ca06df Merge pull request #3768 from weaveworks/alpine-3-11-3
Update alpine base image to 3.11.3
2020-03-23 15:02:15 +00:00
Bryan Boreham
d81ccf7466 Update alpine base image to 3.11.3
Note I'm pinning the minor version here, otherwise it can vary
depending on what's on your machine when you build.
2020-03-23 12:56:43 +00:00
Bryan Boreham
1c0ea8cbc6 Merge pull request #3766 from weaveworks/go-1-13-9
Update Go to 1.13.9
2020-03-20 14:29:02 +00:00
Filip Barl
a9a0cdcd57 Merge pull request #3765 from weaveworks/3763-remove-unused-js-deps
Remove unused JS deps from package.json
2020-03-20 15:15:52 +01:00
Bryan Boreham
265e262a65 Update Go to 1.13.9 2020-03-20 14:04:30 +00:00
Filip Barl
3fbc1a9ec5 Remove unused JS deps from package.json 2020-03-20 14:53:13 +01:00
Bryan Boreham
49db8f66cd Merge pull request #3763 from weaveworks/yarn-update
security: update JS dependencies which have notified vulnerabilities
2020-03-20 12:22:49 +00:00
Bryan Boreham
c37e21ed14 security(js-dependency): update minimist to 1.2.2 2020-03-19 12:25:39 +00:00
Bryan Boreham
20227f2cd0 security(js-dependency): update acorn to 7.1.1 2020-03-19 12:25:39 +00:00
Bryan Boreham
c6ec844711 security(js-dependency): update set-value to 2.0.1 2020-03-19 12:25:16 +00:00
Bryan Boreham
ef165af823 security(js-dependency): update mixin-deep to 1.3.2 2020-03-19 12:20:06 +00:00
Bryan Boreham
487769fd11 security(js-dependency): update sshpk to 1.13.2 2020-03-19 12:19:27 +00:00
Bryan Boreham
9d5b395bf4 UI build: removed unused older versions from yarn.lock 2020-03-19 12:05:29 +00:00
Bryan Boreham
6c9c8c88e3 UI-build: deduplicate yarn.lock 2020-03-19 11:54:53 +00:00
Bryan Boreham
8861e524cc Merge pull request #3758 from weaveworks/slow-dns-poll
Slow down DNS poll interval
2020-03-14 10:29:05 +00:00
Bryan Boreham
f8b8a5001e Merge pull request #3760 from sarataha/issues/3741-open-files-format
Remove trailing zeros in large numbers in UI
2020-03-14 10:28:43 +00:00
Sara Taha
7ef0008b4f fix linting issue for trailing spaces 2020-03-13 05:19:20 +02:00
Sara Taha
70a818bff8 remove trailing space 2020-03-13 05:15:08 +02:00
Sara Taha
112fd5616b remove trailing zeros in large numbers in UI
Added ~ option to d3Format which trims trailing zeros across format types.

Fixes #3741
2020-03-13 04:51:44 +02:00
Bryan Boreham
6947cf19da Slow down DNS poll interval
There's no reason to expect anyone is changing their DNS that fast,
and the probe queries all endpoints every time it polls so slowing
down will reduce effort.
2020-03-12 16:54:44 +00:00
Bryan Boreham
12d6ae4da0 Merge pull request #3756 from weaveworks/update-deps
Update billing-client, weaveworks/common, prometheus, protobuf
2020-03-12 10:37:42 +00:00
Daniel Holbach
0649c81998 Merge pull request #3757 from weaveworks/switch-to-master
Switch UI build container back to master, and update more JS deps
2020-03-12 08:11:52 +01:00
Bryan Boreham
f66e91e37f Merge pull request #3748 from weaveworks/move-counters-to-latest
Move Counters into Latest
2020-03-11 21:14:01 +00:00