
############################## Experiment details ##############################

dataset: femnist
dataset_dir: ../data/femnist/
output_dir: output/fedavg_cnn-2022-07-16_20:39:17/
model: cnn
num_rounds: 10
eval_every: 1
ServerType: <class 'fedavg_cnn_exp.fedavg_cnn.<locals>.make_fedavg_server_client.<locals>.FedAvgServer'>
client_types: [(<class 'fedavg_cnn_exp.fedavg_cnn.<locals>.make_fedavg_server_client.<locals>.FedAvgClient'>, 10)]
clients_per_round: 5
client_lr: 0.06
batch_size: 64
seed: 0
use_val_set: False
num_epochs: 10
gpus_per_client_cluster: 1
num_client_clusters: 2
save_model: False

############################## Simulation ##############################

Spawning 2 ClientClusters using cuda device (this may take a while)
10 total clients: 10 FedAvgClients

>>> Training Accuracy: Round 0 <<<
+------------+------------+-------------------+-------------------+
|    average |     median |   10th percentile |   90th percentile |
|------------+------------+-------------------+-------------------|
| 0.00232897 | 0.00277027 |                 0 |        0.00299917 |
+------------+------------+-------------------+-------------------+
>>> Test Accuracy: Round 0 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|         0 |        0 |                 0 |                 0 |
+-----------+----------+-------------------+-------------------+
--- Round 1 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 1 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0538574 | 0.0555492 |         0.0477177 |         0.0585487 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 1 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0490956 | 0.0513158 |         0.0243322 |         0.0775641 |
+-----------+-----------+-------------------+-------------------+
--- Round 2 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 2 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0809316 | 0.0790545 |         0.0389009 |           0.11167 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 2 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0801034 | 0.0707237 |                 0 |          0.155535 |
+-----------+-----------+-------------------+-------------------+
--- Round 3 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 3 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0841339 | 0.0989672 |         0.0247111 |          0.131297 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 3 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0826873 | 0.078869 |         0.0262483 |          0.131944 |
+-----------+----------+-------------------+-------------------+
--- Round 4 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 4 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
|  0.069869 | 0.0777995 |         0.0345689 |          0.100464 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 4 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0620155 | 0.056891 |         0.0214286 |          0.119963 |
+-----------+----------+-------------------+-------------------+
--- Round 5 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 5 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0515284 | 0.0500663 |         0.0322299 |         0.0730482 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 5 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0516796 |  0.03663 |         0.0214286 |          0.128289 |
+-----------+----------+-------------------+-------------------+
--- Round 6 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 6 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0882096 | 0.0833447 |         0.0666716 |          0.121256 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 6 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0904393 | 0.0929487 |         0.0476316 |          0.124042 |
+-----------+-----------+-------------------+-------------------+
--- Round 7 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 7 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0471616 | 0.047177 |         0.0250171 |         0.0796532 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 7 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0723514 | 0.0750469 |         0.0476316 |         0.0982143 |
+-----------+-----------+-------------------+-------------------+
--- Round 8 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 8 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0669578 | 0.0726275 |           0.03058 |          0.093681 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 8 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0723514 | 0.0669643 |                 0 |          0.147092 |
+-----------+-----------+-------------------+-------------------+
--- Round 9 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 9 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0276565 | 0.0283251 |         0.0237654 |         0.0320144 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 9 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0310078 | 0.0259784 |                 0 |         0.0567434 |
+-----------+-----------+-------------------+-------------------+
--- Round 10 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 10 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0276565 | 0.0283251 |         0.0237654 |         0.0320144 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 10 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0310078 | 0.0259784 |                 0 |         0.0567434 |
+-----------+-----------+-------------------+-------------------+

############################## Post-Simulation ##############################

Total Experiment time: 0:02:43.148745
