For any newbies like me wondering how to get started

[tigawanna]

gist

[maxpert]

Awesome! I think this can become a good getting started page for Marmot site itself.

[maxpert]

@tigawanna Marmot now has support for S3 snapshots. I wonder if you can update the gist and send out a PR that will let me put this up in "Getting Started" page on site.

[tigawanna]

i think something is missing in the new build , the old error is gone

⋊> ~/c/marmot on master ⨯ goreman start                                                                          07:47:35
07:47:37 nats-1 | Starting nats-1 on port 5200
07:47:37   mm-1 | Starting mm-1 on port 5400
07:47:37    pb1 | Starting pb1 on port 5000
07:47:37   mm-2 | Starting mm-2 on port 5500
07:47:37    pb2 | Starting pb2 on port 5100
07:47:37 nats-2 | Starting nats-2 on port 5300
07:47:38    pb1 | > Server started at: http://127.0.0.1:8090
07:47:38    pb1 |   - REST API: http://127.0.0.1:8090/api/
07:47:38    pb1 |   - Admin UI: http://127.0.0.1:8090/_/
07:47:38    pb2 | > Server started at: http://127.0.0.1:8091
07:47:38    pb2 |   - REST API: http://127.0.0.1:8091/api/
07:47:38    pb2 |   - Admin UI: http://127.0.0.1:8091/_/
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017320 [INF] Starting nats-server
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017506 [INF]   Version:  2.9.6
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017516 [INF]   Git:      [not set]
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017521 [INF]   Cluster:  rack
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017526 [INF]   Name:     natt2
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017536 [INF]   Node:     swVU9fu0
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017541 [INF]   ID:       NAAV7RHTWAMFUS3AUNYZOVI723FKX4T54QYW63E2P7QCJRE3GKDBSYHP
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017553 [WRN] Plaintext passwords detected, use nkeys or bcrypt
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.017580 [INF] Using configuration file: ./nats/nats-2.conf
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.018671 [INF] Starting JetStream
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019744 [INF] Starting nats-server
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019859 [INF]   Version:  2.9.6
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019868 [INF]   Git:      [not set]
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019879 [INF]   Cluster:  rack
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019885 [INF]   Name:     natt1
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019892 [INF]   Node:     NZNa6E8j
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019895 [INF]   ID:       NB3B43JLKP2UVDH57D3F2T73CODAN7WAHWL5I2KT7PGOMMMDARPEMC5N
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019905 [WRN] Plaintext passwords detected, use nkeys or bcrypt
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.019919 [INF] Using configuration file: ./nats/nats-1.conf
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020650 [INF]     _ ___ _____ ___ _____ ___ ___   _   __  __
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020708 [INF]  _ | | __|_   _/ __|_   _| _ \ __| /_\ |  \/  |
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020720 [INF] | || | _|  | | \__ \ | | |   / _| / _ \| |\/| |
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020726 [INF]  \__/|___| |_| |___/ |_| |_|_\___/_/ \_\_|  |_|
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020730 [INF]
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020735 [INF]          https://docs.nats.io/jetstream
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020741 [INF]
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020750 [INF] ---------------- JETSTREAM ----------------
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020777 [INF]   Max Memory:      244.14 MB
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020787 [INF]   Max Storage:     953.67 MB
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020793 [INF]   Store Directory: "/tmp/nats2/jetstream"
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.020799 [INF] -------------------------------------------
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.021604 [INF] Starting JetStream
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.021796 [INF]   Starting restore for stream '$G > OBJ_marmot-changes-snapshot-store'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.022202 [INF]     _ ___ _____ ___ _____ ___ ___   _   __  __
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.022384 [INF]  _ | | __|_   _/ __|_   _| _ \ __| /_\ |  \/  |
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.022394 [INF] | || | _|  | | \__ \ | | |   / _| / _ \| |\/| |
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.022625 [INF]  \__/|___| |_| |___/ |_| |_|_\___/_/ \_\_|  |_|
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.022767 [INF]
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.023272 [INF]          https://docs.nats.io/jetstream
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.023280 [INF]
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.023285 [INF] ---------------- JETSTREAM ----------------
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.023444 [INF]   Max Memory:      244.14 MB
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.023505 [INF]   Max Storage:     953.67 MB
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.023513 [INF]   Store Directory: "/tmp/nats1/jetstream"
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.023519 [INF] -------------------------------------------
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.022998 [INF]   Restored 0 messages for stream '$G > OBJ_marmot-changes-snapshot-store'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.023492 [INF]   Starting restore for stream '$G > marmot-changes-c-1'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.023926 [INF]   Restored 0 messages for stream '$G > marmot-changes-c-1'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.024448 [INF]   Starting restore for stream '$G > marmot-changes-c-2'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.025228 [INF]   Starting restore for stream '$G > marmot-changes-c-3'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.025455 [INF]   Restored 5 messages for stream '$G > marmot-changes-c-2'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.025787 [INF]   Starting restore for stream '$G > marmot-changes-c-4'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.026854 [INF]   Restored 1 messages for stream '$G > marmot-changes-c-3'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.027619 [INF]   Restored 1 messages for stream '$G > marmot-changes-c-4'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.027756 [INF]   Recovering 2 consumers for stream - '$G > marmot-changes-c-1'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.027606 [INF]   Starting restore for stream '$G > marmot-changes-c-5'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.028122 [INF]   Restored 0 messages for stream '$G > marmot-changes-c-5'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.028710 [INF]   Starting restore for stream '$G > marmot-changes-c-6'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.031078 [INF] Starting JetStream cluster
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.031089 [INF] Creating JetStream metadata controller
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.031742 [INF] JetStream cluster recovering state
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.033162 [INF] Listening for client connections on 0.0.0.0:4223
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.033963 [INF] Server is ready
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.034688 [INF] JetStream cluster new stream leader for '$G > marmot-changes-c-1'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.034883 [INF] Cluster name is rack
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.034973 [INF] Listening for route connections on 0.0.0.0:4249
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.035326 [INF] JetStream cluster new consumer leader for '$G > marmot-changes-c-1 > 4gSvwyqu'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.036805 [INF] JetStream cluster new consumer leader for '$G > marmot-changes-c-1 > 1hUbZohE'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.038346 [INF] JetStream cluster new stream leader for '$G > marmot-changes-c-2'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.038857 [INF] JetStream cluster new stream leader for '$G > OBJ_marmot-changes-snapshot-store'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.039767 [INF] JetStream cluster new stream leader for '$G > marmot-changes-c-4'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.041213 [INF] 127.0.0.1:4248 - rid:22 - Route connection created
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.029887 [INF]   Restored 1 messages for stream '$G > marmot-changes-c-6'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.030075 [INF]   Starting restore for stream '$G > marmot-changes-c-7'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.031966 [INF]   Restored 0 messages for stream '$G > marmot-changes-c-7'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.032163 [INF]   Starting restore for stream '$G > marmot-changes-c-8'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.032653 [INF]   Restored 0 messages for stream '$G > marmot-changes-c-8'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.032854 [INF] Starting JetStream cluster
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.032865 [INF] Creating JetStream metadata controller
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.033296 [INF] JetStream cluster recovering state
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.036500 [INF] Listening for client connections on 0.0.0.0:4222
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.037969 [INF] Server is ready
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.038624 [INF] JetStream cluster new stream leader for '$G > marmot-changes-c-8'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.038963 [INF] Cluster name is rack
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.038999 [INF] JetStream cluster new stream leader for '$G > marmot-changes-c-6'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.039139 [INF] Listening for route connections on 0.0.0.0:4248
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.040619 [INF] JetStream cluster new stream leader for '$G > marmot-changes-c-3'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.040963 [INF] JetStream cluster new stream leader for '$G > marmot-changes-c-5'
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.041216 [INF] 127.0.0.1:40950 - rid:20 - Route connection created
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.041533 [INF] 127.0.0.1:4249 - rid:23 - Route connection created
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.041603 [INF] 127.0.0.1:59854 - rid:24 - Route connection created
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.041893 [INF] JetStream cluster new stream leader for '$G > marmot-changes-c-7'
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.041959 [INF] 127.0.0.1:4249 - rid:23 - Router connection closed: Duplicate Route
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.045767 [INF] 127.0.0.1:59854 - rid:24 - Router connection closed: Duplicate Route
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.046310 [INF] 127.0.0.1:4248 - rid:22 - Route connection created
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.046327 [INF] 127.0.0.1:40952 - rid:23 - Route connection created
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.046833 [INF] 127.0.0.1:4249 - rid:24 - Route connection created
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.047040 [INF] 127.0.0.1:4248 - rid:22 - Router connection closed: Duplicate Route
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.047150 [INF] 127.0.0.1:40952 - rid:23 - Router connection closed: Duplicate Route
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.047684 [INF] 127.0.0.1:59856 - rid:25 - Route connection created
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.048054 [INF] 127.0.0.1:4249 - rid:24 - Router connection closed: Duplicate Route
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.048052 [INF] 127.0.0.1:59856 - rid:25 - Router connection closed: Duplicate Route
07:47:38 nats-2 | [2494] 2022/12/24 07:47:38.135841 [WRN] Waiting for routing to be established...
07:47:38 nats-1 | [2493] 2022/12/24 07:47:38.136411 [WRN] Waiting for routing to be established...
07:47:42 nats-2 | [2494] 2022/12/24 07:47:42.671318 [INF] Self is new JetStream cluster metadata leader
07:47:42 nats-1 | [2493] 2022/12/24 07:47:42.673404 [INF] JetStream cluster new metadata leader: natt2/rack
07:47:47   mm-1 | 7:47AM DBG Opening database path=/home/dennis/code/marmot/pb_10a/pb_data/data.db
07:47:47   mm-1 | 7:47AM DBG Forcing WAL checkpoint
07:47:48   mm-1 | 7:47AM DBG Stream ready... leader=natt2 name=marmot-changes-c-1 replicas=1 shard=1
07:47:48   mm-1 | 7:47AM WRN No snapshot found, system will now continue without restoring snapshot
07:47:48   mm-1 | 7:47AM INF Downloaded snapshot, restoring... path=/tmp/marmot-snapshot-4201335014/snapshot.db
07:47:48   mm-2 | 7:47AM WRN No snapshot found, system will now continue without restoring snapshot
07:47:48   mm-2 | 7:47AM INF Downloaded snapshot, restoring... path=/tmp/marmot-snapshot-265538173/snapshot.db
07:47:48   mm-1 | 7:47AM DBG File copied... bytes=4096 from=/tmp/marmot-snapshot-4201335014/snapshot.db to=/home/dennis/code/marmot/pb_10a/pb_data/data.db
07:47:48   mm-1 | 7:47AM DBG File copied... bytes=32768 from=/tmp/marmot-snapshot-4201335014/snapshot.db-shm to=/home/dennis/code/marmot/pb_10a/pb_data/data.db-shm
07:47:48   mm-1 | 7:47AM DBG File copied... bytes=0 from=/tmp/marmot-snapshot-4201335014/snapshot.db-wal to=/home/dennis/code/marmot/pb_10a/pb_data/data.db-wal
07:47:48   mm-1 | 7:47AM DBG Forcing WAL checkpoint
07:47:48   mm-2 | 7:47AM INF Restore complete... path=/tmp/marmot-snapshot-265538173/snapshot.db
07:47:48   mm-2 | 7:47AM INF Listing tables to watch...
07:47:48   mm-1 | 7:47AM INF Restore complete... path=/tmp/marmot-snapshot-4201335014/snapshot.db
07:47:48   mm-1 | 7:47AM INF Listing tables to watch...
07:47:48   mm-2 | 7:47AM INF Starting change data capture pipeline...
07:47:48   mm-1 | 7:47AM INF Starting change data capture pipeline...
07:47:48   mm-2 | 7:47AM ERR Unable to scan global changes error="no such table: __marmot___change_log_global"
07:47:48   mm-1 | 7:47AM DBG duration=2.5376 name=scan_changes
07:47:48   mm-1 | 7:47AM ERR Unable to scan global changes error="no such table: __marmot___change_log_global"
07:47:48   mm-1 | 7:47AM DBG Listening stream shard=1
07:47:48 nats-2 | [2494] 2022/12/24 07:47:48.107694 [INF] JetStream cluster new consumer leader for '$G > marmot-changes-c-1 > Z3YK9abp'
07:47:48 nats-2 | [2494] 2022/12/24 07:47:48.112324 [INF] JetStream cluster new consumer leader for '$G > marmot-changes-c-1 > dzsuqlmj'
07:48:03   mm-2 | 7:48AM ERR Unable to scan global changes error="no such table: __marmot___change_log_global"
07:48:03   mm-2 | 7:48AM ERR Unable to scan global changes error="no such table: __marmot___change_log_global"

[maxpert]

You are right, I missed a complete push that I identified while testing my changes. I have retagged and re-released build. Please post me the Docker file as well. I am also planning to have a Docker image for marmot pushed to DockerHub that way we can have single docker-compose with various set of images being pulled and connected over network as if it was happening in real scenario. I am open to suggestions. Try out your image first may be that will be good enough as an example. But give new build a try.

[tigawanna]

Nice , fixes seem to be working my path to marmot-2 in the procfile was incorrect.

I've also tried to embed a 15s video of me running the commands in the order you specified first the pocketbase instances then nats the add data and bring up the marmots and sync the data and bring down one marmot syncs stop bring it back up and syncs resume

[maxpert]

Awesome!

[nickchomey]

I wonder if there should a basic docker-compose to bring PB + NATS + Marmot up? Would that make your tutorial much simple?

Yes, it would be extremely helpful if it was all available in a docker image that could be deployed with docker compose

[disarticulate]

this should be a quickstart page on the new site

[maxpert]

Agreed. Would welcome PR for that!

[tigawanna]

#40 i don't if i opened the PR right , it's missing the dockerfile though

[milimyname]

Hi everyone!
I wonder if there is a guideline how to deploy it e.g on fly io etc?

[maxpert]

I already have a demo with DenoJS on Fly.io that I have worked on. I don't wanna post the link here because I have not done the final polish yet (I will merge to main repo once ready), please ping me on Discord directly for now to get the link to repo.

[maxpert]

You know what, I think it's fine even if it's not polished. Here is a working demo of Marmot working on Fly.io. I wrote a quick and dirty commenting system.

[milimyname]

Hi Mr. @maxpert.
I thank you for it!