Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Share some fine-tuned hyperparameter settings #136

Open
FryLcm opened this issue Oct 26, 2023 · 7 comments
Open

Share some fine-tuned hyperparameter settings #136

FryLcm opened this issue Oct 26, 2023 · 7 comments
Labels
share knowledge Share some insights on usage

Comments

@FryLcm
Copy link

FryLcm commented Oct 26, 2023

以下是我使用该仓库进行的一些方法复现所使用的超参数,走过路过的朋友们,如果发现哪里超参数的选择不合理或该使用的超参数未使用到,麻烦提醒下我,不胜感激。

@FryLcm
Copy link
Author

FryLcm commented Oct 26, 2023

fedavg:
python main.py -nb 10 -data Cifar10 -m cnn -algo FedAvg -gr 1000 -did 0 -lr 0.005 -go cnn > cifar10_fedavg_1.out 2>&1
python main.py -nb 100 -data Cifar100 -m cnn -algo FedAvg -gr 1000 -did 0 -lr 0.005 -go cnn > cifar100_fedavg_1.out 2>&1
python main.py -nb 200 -data Tiny-imagenet -m cnn -algo FedAvg -gr 1000 -did 0 -lr 0.005 -go cnn >tiny_fedavg_1.out 2>&1

@FryLcm
Copy link
Author

FryLcm commented Oct 26, 2023

per-fedavg
python main.py -nb 10 -data Cifar10 -m cnn -algo PerAvg -gr 1000 -did 0 -lr 0.005 -bt 0.001 -go cnn > cifar10_per-fedavg_1.out 2>&1

python main.py -nb 100 -data Cifar100 -m cnn -algo PerAvg -gr 1000 -did 0 -lr 0.005 -bt 0.001 -go cnn > cifar100_per-fedavg_1.out 2>&1

python main.py -nb 200 -data Tiny-imagenet -m cnn -algo PerAvg -gr 1000 -did 0 -lr 0.005 -bt 0.001 -go cnn > tiny_per-fedavg_1.out 2>&1

@FryLcm
Copy link
Author

FryLcm commented Oct 26, 2023

APFL:
python main.py -nb 10 -data Cifar10 -m cnn -algo APFL -gr 1000 -did 0 -lr 0.005 -al 1.0 -go cnn > cifar10_APFL_1.out 2>&1

python main.py -nb 100 -data Cifar100 -m cnn -algo APFL -gr 1000 -did 0 -lr 0.005 -al 1.0 -go cnn > cifar100_APFL_1.out 2>&1

python main.py -nb 200 -data Tiny-imagenet -m cnn -algo APFL -gr 1000 -did 0 -lr 0.005 -al 1.0 -go cnn > tiny_APFL_1.out 2>&1

@FryLcm
Copy link
Author

FryLcm commented Oct 26, 2023

pFedMe
python main.py -nb 10 -data Cifar10 -m cnn -algo pFedMe -gr 1000 -did 0 -lr 0.005 -lrp 0.01 -bt 1 -lam 15 -K 5 -go cnn > cifar10_pFedMe_1.out 2>&1

python main.py -nb 100 -data Cifar100 -m cnn -algo pFedMe -gr 1000 -did 0 -lr 0.005 -lrp 0.01 -bt 1 -lam 15 -K 5 -go cnn > cifar100_pFedMe_1.out 2>&1

python main.py -nb 200 -data Tiny-imagenet -m cnn -algo pFedMe -gr 1000 -did 0 -lr 0.005 -lrp 0.01 -bt 1 -lam 15 -K 5 -go cnn > tiny_pFedMe_1.out 2>&1

@xxdznl
Copy link

xxdznl commented Apr 1, 2024

-gr不是2000吗?

@FryLcm
Copy link
Author

FryLcm commented Apr 8, 2024

-gr不是2000吗?

1000轮内就完全可以收敛了

@TsingZ0
Copy link
Owner

TsingZ0 commented Apr 17, 2024

是的,-gr的设置没有严格要求,如果算法能在1000轮内收敛,那么-gr 1000-gr 2000最终结果是一样的

@TsingZ0 TsingZ0 changed the title 超参数选择 Share some fine-tuned hyperparameter settings Apr 18, 2024
@TsingZ0 TsingZ0 added enhancement New feature or request share knowledge Share some insights on usage and removed enhancement New feature or request labels Apr 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
share knowledge Share some insights on usage
Projects
None yet
Development

No branches or pull requests

3 participants