Skip to content

Commit

Permalink
Metrics improvements and docs (#40)
Browse files Browse the repository at this point in the history
* a few more metrics

* hash clock tables

* label with correct table name

* try to use the actual site_id bytes instead of ordinal

* ... and I guess use better ordering w/o db version which can change a lot

* revert target dir change for escargot build, it didn't help

* typo and support for NULL site id

* set a counter absolutely with the hash u64 directly, won't create as many series

* possibly insane query? let's see

* add a build info metrics for convenience

* use seahash to see if it makes a difference

* possibly use a thing that'll hash consistently?

* specifically disable rng

* this is not nearly consistent enough

* trying to make the hashing more consistent

* counter is garbage if it decreases

* pick a single hashing function, don't need ahash is seahash works fine

* upgrade cr-sqlite w/ fixes

* allow passing params to query

* actually use params in /v1/queries

* trying to modify the changes chunker to see if that's the issue

* try to bring back sending buffered changes

* reannounce to the cluster a lot more on boot

* better hold to lock with the right data

* announce right off the bat too

* better query for buffered changes metric

* don't hex the actor_id

* log a lot more to try and find out why a version disappears

* a little bit more info

* a lot more logging to figure out this one...

* remove extraneous logging, upgrade crsqlite w/ hard-earned fix

* record a few more metrics concerning changes committed and bidirectional sync

* make bidirectional more sequential for initial messages (state -> clock)

* committed counts per table

* list metrics

* upgrade crsqlite, better implementation of crsql_next_db_version
  • Loading branch information
jeromegn authored Sep 7, 2023
1 parent dc7b8eb commit 241c807
Show file tree
Hide file tree
Showing 26 changed files with 977 additions and 367 deletions.
161 changes: 159 additions & 2 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,8 @@ async-trait = "0.1.68"
axum = { version = "0.6.15", features = ["http2", "ws", "tracing", "headers"] }
bb8 = "0.8.0"
bincode = "1.3.3"
build-info = "0.0.31"
build-info-build = { version = "0.0.31", default-features = false }
bytes = "1.4.0"
camino = {version = "1.1.4", features = ["serde1"] }
clap = { version = "4.2.4", features = ["derive"] }
Expand Down
3 changes: 3 additions & 0 deletions crates/corro-agent/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,9 @@ corro-types = { path = "../corro-types" }
eyre = { workspace = true }
foca = { workspace = true }
futures = { workspace = true }
hex = { workspace = true }
hyper = { workspace = true }
itertools = { workspace = true }
metrics = { workspace = true }
parking_lot = { workspace = true }
quinn = { workspace = true }
Expand All @@ -27,6 +29,7 @@ rangemap = { workspace = true }
rusqlite = { workspace = true }
rustls = { workspace = true }
rustls-pemfile = "*"
seahash = { workspace = true }
serde = { workspace = true }
serde_json = { workspace = true }
spawn = { path = "../spawn" }
Expand Down
Loading

0 comments on commit 241c807

Please sign in to comment.