Model
A 7B SpeechLLM model trained on speech-to-text recognition (ASR), speech-to-text translation (AST) and audio/speech question answering (SpeechQA, AudioQA) data.
Use the NGC CLI to download:
Copied!
1 Version
1.23.1Selected04/23/2024 11:11 PM UTC25.81 GB Copied!
1.23.1Selected
04/23/2024 11:11 PM UTC25.81 GB
Copied!
Accuracy
| Key | Value |
|---|---|
| MCV-7.1 Test WER(%) | 8.53 |
| LibriSpeech-test-other WER(%) | 4.65 |
| FLEURS En->Es Test BLEU (%) | 16.97 |
| FLEURS En->De Test BLEU (%) | 27.41 |
| FLEURS En->Fr Test BLEU (%) | 25.79 |
Model
| Key | Value |
|---|---|
| Architecture | FastConformer-large-LLaMA2-7b |
| Outputs | Text response |
| Inputs | Audio context and text prompt |
| Number of Weights | 7B |