I talked with Vac DST (Distributed Systems Testing) team at the Logos All-hands to understand what they have for testing. The list above is what Alberto show me:
- Measuring changes in throughput and latency of gossipsub in the large Waku network, according to each version of Waku.
- They have their own framework written in Python to spawn multiple Docker containers and generate workloads.
- Currently, the workload is implemented only for broadcasting messages via Waku, but the workload for Nomos can be implemented for sure.
- The framework can call any metrics API of the node.
- Measuring network ingress/egress of each node and network connectivity in the large network (leveraging NetworkX)
The tests above are run by manual process because the running time of each test is usually very long.
Before starting collaboration, we must define what needs to be measured by this collaboration and the clear process how the collaboration can be done in long term.