Resource
With modified architecture and initialization this ResNet50 version gives ~0.5% better accuracy than original.
Use the NGC CLI to download:
Copied!
Changelog
- December 2021
- Initial release
- Cosine LR schedule
- DALI support
- DALI-CPU dataloader
- Added A100 scripts
- Paddle AMP
- January 2022
- Added options Label Smoothing, fan-in initialization, skipping weight decay on batch norm gamma and bias.
- Updated README
- A100 convergence benchmark
Known issues
- Allreduce issues to top1 and top5 accuracy in evaluation. Workaround: use
build_strategy.fix_op_run_order = Truefor eval program. (refer to Paddle-issue-39567 for details)