# Commits · PR \#106 · flambo/atlantis

[View on GitCafe](https://git.cafe/flambo/atlantis/pull/106/commits)

Repository: [flambo/atlantis](https://git.cafe/flambo/atlantis)

Visibility: public

[feat\(netflow-db\): add merge-shards and a cluster launcher for day-sharded reprocessing](https://git.cafe/flambo/atlantis/pull/106.md)

Version: 0

Head commit: fd760d7d2c3ca9173f56bb1c25dc8a4ac7e84b28

Base commit: 08c62c11f76e3a1c9ea8033f108b7209bbe786f5

Comparison base: 08c62c11f76e3a1c9ea8033f108b7209bbe786f5

Showing up to 20 entries from this revision. If the pull request changes, reopen the first page before continuing.

- [fix\(netflow-db\): merge compact MAAD tables and require matching q grids](https://git.cafe/flambo/atlantis/commit/fd760d7d2c3ca9173f56bb1c25dc8a4ac7e84b28?format=markdown) — fd760d7d2c3ca9173f56bb1c25dc8a4ac7e84b28; flamboh

- [fix\(scripts\): spread launcher shards across every slot and host](https://git.cafe/flambo/atlantis/commit/0e76fc7e7c68e7ea89afaa7b59a5e0013dd13430?format=markdown) — 0e76fc7e7c68e7ea89afaa7b59a5e0013dd13430; flamboh

- [fix\(netflow-db\): track consumed shards and reconcile start dates during merges](https://git.cafe/flambo/atlantis/commit/3d8a26a28922ddfac6bdfef3a271dc028c8ab7bf?format=markdown) — 3d8a26a28922ddfac6bdfef3a271dc028c8ab7bf; flamboh

- [feat\(scripts\): consume local shard copies during the launcher merge](https://git.cafe/flambo/atlantis/commit/248b865adf989083798e87b694407c2010d78fda?format=markdown) — 248b865adf989083798e87b694407c2010d78fda; flamboh

- [feat\(netflow-db\): add a consuming merge mode that bounds peak disk](https://git.cafe/flambo/atlantis/commit/1bb81c5b31f7f5fe0d0e7f9ce25e0e8a41250747?format=markdown) — 1bb81c5b31f7f5fe0d0e7f9ce25e0e8a41250747; flamboh

- [fix\(scripts\): run cluster shards detached and name them by day range](https://git.cafe/flambo/atlantis/commit/9dc43a9466b76dfcfa32065b53ab4df9a57ad28d?format=markdown) — 9dc43a9466b76dfcfa32065b53ab4df9a57ad28d; flamboh

- [refactor\(netflow-db\): merge shards one attachment at a time and require full marker coverage](https://git.cafe/flambo/atlantis/commit/612b092361ea314acee08619153619a8b014c0dc?format=markdown) — 612b092361ea314acee08619153619a8b014c0dc; flamboh

- [fix\(scripts\): deploy cluster files atomically and cap launcher slots](https://git.cafe/flambo/atlantis/commit/e9db5e3a0a4b23df52bc201ca39abb09d6a4c05d?format=markdown) — e9db5e3a0a4b23df52bc201ca39abb09d6a4c05d; flamboh

- [fix\(netflow-db\): keep the merge error when temporary cleanup cannot resolve paths](https://git.cafe/flambo/atlantis/commit/4b2cf886098edcc2730ca19bfe399fd1b84ef856?format=markdown) — 4b2cf886098edcc2730ca19bfe399fd1b84ef856; flamboh

- [feat\(scripts\): add ssh launcher for day-sharded pipeline runs](https://git.cafe/flambo/atlantis/commit/f7e37d8048180595333a7cbf121e4df887f1eb22?format=markdown) — f7e37d8048180595333a7cbf121e4df887f1eb22; flamboh

- [feat\(netflow-db\): add merge-shards for day-sharded products](https://git.cafe/flambo/atlantis/commit/7d7a15127189b23777920b504b93faceafeac77b?format=markdown) — 7d7a15127189b23777920b504b93faceafeac77b; flamboh