ContainersNVIDIADeepSeek-R1NVIDIALlama-3.1-Nemotron-70B-InstructNVIDIAPyTorch
CollectionsNVIDIAOmniverse Kit (FB)NVIDIADeepStream SDKNVIDIAOmniverse Kit App Streaming
ModelsNVIDIAStyleGAN3 pretrained modelsNVIDIAPeopleNetNVIDIATrafficCamNet
ResourcesNVIDIARiva Skills Quick Start
Helm ChartsNVIDIAGPU OperatorNVIDIANVIDIA NIM Operator
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer-XL PyTorch checkpoint (Large, AMP)
Model
NVIDIA Deep Learning Examples
NVIDIA Deep Learning Examples
Transformer-XL PyTorch checkpoint (Large, AMP)

Tranformer-XL Large PyTorch checkpoint trained with AMP

1 Version
19.11.0_ampSelected
09/22/2022 5:10 PM UTC3.2 GBAccuracy: 00 EpochsBatch Size: 128GPU: V100
architecture
KeyValue
typeBase
performance
KeyValue
perplexity18.24
training
KeyValue
batch_size128
learning rate0.01
gpus16x V100 32G
training_precisionAMP
steps100000
datasetWikiText-103