test: add integration test for logstore scale-in / out #21781
Conversation
github-actions
bot
added
the
component/test
|
|
||
| [meta] | ||
| meta_leader_lease_secs = 10 | ||
| max_heartbeat_interval_secs = 5 |
There was a problem hiding this comment.
Copied from ci-sim, but with this additional configuration, to force worker node to be evicted.
There was a problem hiding this comment.
If this heartbeat value was too large previously, should we set this value directly in the origin ci-sim and reuse the same config file so that more corner case can be tested in the integration tests and recovery tests?
There was a problem hiding this comment.
Okay, we can change it in a subsequent PR to avoid scope creep
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
license-eye has checked 5711 files.
| Valid | Invalid | Ignored | Fixed |
|---|---|---|---|
| 2397 | 1 | 3313 | 0 |
Click to see the invalid file list
- src/tests/simulation/tests/integration_tests/log_store/utils.rs
Use this command to fix any missing license headers
```bash
docker run -it --rm -v $(pwd):/github/workspace apache/skywalking-eyes header fix
</details>
| @@ -27,27 +27,7 @@ use risingwave_simulation::cluster::{Cluster, ConfigPath, Configuration, KillOpt | |||
| use risingwave_simulation::ctl_ext::predicate::identity_contains; | |||
| use tokio::time::sleep; | |||
|
|
|||
There was a problem hiding this comment.
Refactored utilies from this file to utils.rs
kwannoel
changed the title
|
|
||
| [meta] | ||
| meta_leader_lease_secs = 10 | ||
| max_heartbeat_interval_secs = 5 |
There was a problem hiding this comment.
If this heartbeat value was too large previously, should we set this value directly in the origin ci-sim and reuse the same config file so that more corner case can be tested in the integration tests and recovery tests?
kwannoel
force-pushed
the
kwannoel/synced-log-store-scale-in
branch
4 times, most recently
from
9d778c0 to
47485a5
Compare
|
Mark as draft, so we can just test the scale-in test. |
kwannoel
force-pushed
the
kwannoel/synced-log-store-scale-in
branch
from
e2505a8 to
d7ec856
Compare
kwannoel
force-pushed
the
graphite-base/21781
branch
from
024e422 to
76056fd
Compare
kwannoel
force-pushed
the
kwannoel/synced-log-store-scale-in
branch
from
f79c380 to
fce6930
Compare
kwannoel
changed the base branch from
graphite-base/21781
to
yiming/fix-committed-table-watermark-update
kwannoel
force-pushed
the
kwannoel/synced-log-store-scale-in
branch
from
fce6930 to
c078236
Compare
kwannoel
changed the base branch from
yiming/fix-committed-table-watermark-update
to
main
kwannoel
changed the base branch from
main
to
yiming/fix-committed-table-watermark-update
kwannoel
changed the base branch from
yiming/fix-committed-table-watermark-update
to
graphite-base/21781
kwannoel
force-pushed
the
graphite-base/21781
branch
from
76056fd to
7863c52
Compare
kwannoel
force-pushed
the
kwannoel/synced-log-store-scale-in
branch
from
c078236 to
fce6930
Compare
kwannoel
force-pushed
the
kwannoel/synced-log-store-scale-in
branch
2 times, most recently
from
25cc76d to
1c870ed
Compare
kwannoel
force-pushed
the
kwannoel/synced-log-store-scale-in
branch
from
1c870ed to
69c7538
Compare
I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?
Last part of unaligned join #20408.
Kill some nodes, wait for worker to be expired, which triggers scale-in. Restart the worker nodes after scale-in, to trigger scale-out again.
Finally, check that the data in the logstore is correct.
Checklist
Documentation
Release note