ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer-XL PyTorch checkpoint (Base, AMP)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer-XL PyTorch checkpoint (Base, AMP)

Tranformer-XL Base PyTorch checkpoint trained with AMP

1 Version
19.11.0_ampSelected
09/22/2022 5:11 PM UTC2.15 GBAccuracy: 00 EpochsBatch Size: 256GPU: V100
architecture
KeyValue
typeBase
performance
KeyValue
perplexity23.19
training
KeyValue
batch_size256
learning rate0.01
gpus8x V100 16G
training_precisionAMP
steps40000
datasetWikiText-103