
############################## Experiment details ##############################

dataset: speech_commands
dataset_dir: ../datasets/speech_commands/
output_dir: output/debug/signavg-speech_commands-2022-07-10_18:54:33/
model: mel
num_rounds: 100
eval_every: 10
ServerType: <class 'rayleaf.entities.server.Server'>
client_types: [(<class 'rayleaf.entities.client.Client'>, 200)]
clients_per_round: 40
client_lr: 0.05
batch_size: 64
seed: 0
use_val_set: False
num_epochs: 5
gpus_per_client_cluster: 0.1
num_client_clusters: 20
save_model: False

############################## Simulation ##############################

Spawning 20 ClientClusters using cuda device (this may take a while)
200 total clients: 200 Clients

>>> Training Accuracy: Round 0 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0313301 | 0.0310889 |         0.0102885 |         0.0515464 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 0 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0284684 | 0.0333704 |                 0 |         0.0769231 |
+-----------+-----------+-------------------+-------------------+
--- Round 1 of 100: Training 40 clients: 40 Clients ---
--- Round 2 of 100: Training 40 clients: 40 Clients ---
--- Round 3 of 100: Training 40 clients: 40 Clients ---
--- Round 4 of 100: Training 40 clients: 40 Clients ---
--- Round 5 of 100: Training 40 clients: 40 Clients ---
--- Round 6 of 100: Training 40 clients: 40 Clients ---
--- Round 7 of 100: Training 40 clients: 40 Clients ---
--- Round 8 of 100: Training 40 clients: 40 Clients ---
--- Round 9 of 100: Training 40 clients: 40 Clients ---
--- Round 10 of 100: Training 40 clients: 40 Clients ---
>>> Training Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0343761 |  0.03125 |         0.0106271 |         0.0520833 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0398558 |     0.04 |                 0 |         0.0833333 |
+-----------+----------+-------------------+-------------------+
--- Round 11 of 100: Training 40 clients: 40 Clients ---
--- Round 12 of 100: Training 40 clients: 40 Clients ---
--- Round 13 of 100: Training 40 clients: 40 Clients ---
--- Round 14 of 100: Training 40 clients: 40 Clients ---
--- Round 15 of 100: Training 40 clients: 40 Clients ---
--- Round 16 of 100: Training 40 clients: 40 Clients ---
--- Round 17 of 100: Training 40 clients: 40 Clients ---
--- Round 18 of 100: Training 40 clients: 40 Clients ---
--- Round 19 of 100: Training 40 clients: 40 Clients ---
--- Round 20 of 100: Training 40 clients: 40 Clients ---
>>> Training Accuracy: Round 20 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0383407 | 0.0416667 |          0.029381 |              0.05 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 20 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0345417 |     0.04 |                 0 |              0.08 |
+-----------+----------+-------------------+-------------------+
--- Round 21 of 100: Training 40 clients: 40 Clients ---
--- Round 22 of 100: Training 40 clients: 40 Clients ---
--- Round 23 of 100: Training 40 clients: 40 Clients ---
--- Round 24 of 100: Training 40 clients: 40 Clients ---
