
############################## Experiment details ##############################

dataset: speech_commands
dataset_dir: ../datasets/speech_commands/
output_dir: output/debug/signavg-speech_commands-2022-07-16_21:28:49/
model: m5
num_rounds: 10
eval_every: 1
ServerType: <class 'rayleaf.entities.server.Server'>
client_types: [(<class 'rayleaf.entities.client.Client'>, 10)]
clients_per_round: 5
client_lr: 0.06
batch_size: 64
seed: 0
use_val_set: False
num_epochs: 5
gpus_per_client_cluster: 0.75
num_client_clusters: 2
save_model: False

############################## Simulation ##############################

Spawning 2 ClientClusters using cuda device (this may take a while)
10 total clients: 10 Clients

>>> Training Accuracy: Round 0 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0353006 | 0.0371496 |          0.022366 |         0.0473295 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 0 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0479303 | 0.0364583 |          0.025571 |         0.0778537 |
+-----------+-----------+-------------------+-------------------+
--- Round 1 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 1 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0413679 | 0.0426181 |         0.0308313 |         0.0526223 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 1 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
|  0.043573 | 0.0397013 |         0.0269559 |         0.0738537 |
+-----------+-----------+-------------------+-------------------+
--- Round 2 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 2 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
|  0.046332 | 0.0449901 |         0.0387678 |         0.0589628 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 2 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0457516 | 0.0397013 |         0.0269559 |         0.0738537 |
+-----------+-----------+-------------------+-------------------+
--- Round 3 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 3 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0777716 | 0.0548363 |         0.0457422 |            0.1305 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 3 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0631808 | 0.0344929 |           0.01875 |             0.118 |
+-----------+-----------+-------------------+-------------------+
--- Round 4 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 4 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
|  0.139548 | 0.0823026 |         0.0316202 |          0.280911 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 4 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
|  0.108932 | 0.0771259 |         0.0302083 |           0.21027 |
+-----------+-----------+-------------------+-------------------+
--- Round 5 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 5 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.183673 | 0.145003 |         0.0500871 |          0.310143 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 5 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
|  0.126362 | 0.0839181 |         0.0264077 |          0.206522 |
+-----------+-----------+-------------------+-------------------+
--- Round 6 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 6 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.254826 | 0.202778 |         0.0415892 |          0.467286 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 6 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.169935 | 0.105511 |         0.0302083 |             0.356 |
+-----------+----------+-------------------+-------------------+
--- Round 7 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 7 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.306122 | 0.214411 |         0.0506969 |          0.585643 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 7 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.215686 |  0.16074 |         0.0470274 |          0.414541 |
+-----------+----------+-------------------+-------------------+
--- Round 8 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 8 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.355764 | 0.380446 |         0.0608014 |          0.609814 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 8 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.259259 | 0.244263 |          0.058689 |              0.44 |
+-----------+----------+-------------------+-------------------+
--- Round 9 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 9 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.384446 | 0.456968 |         0.0608014 |          0.597429 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 9 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.250545 | 0.279083 |          0.058689 |          0.380642 |
+-----------+----------+-------------------+-------------------+
--- Round 10 of 10: Training 5 clients: 5 Clients ---
>>> Training Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.420298 |  0.40458 |          0.190361 |          0.699857 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.309368 | 0.270059 |          0.144544 |          0.419623 |
+-----------+----------+-------------------+-------------------+

############################## Post-Simulation ##############################

Total Experiment time: 0:00:49.322728
