See the NanoVLM docs for more supported checkpoints.

After signing up and logging in to the NGC Catalog website, an API key must be generated from the “Setup” section. Then, run the command docker login nvcr.io in the terminal. In the login prompt, enter $oauthtoken as the username and the generated API key as the password. If the message “Login Succeeded” appears, the process has been successfully completed.

The tutorial only invokes riva_start.sh, which handles model repository setup internally. However, when running Riva manually using docker run, we encountered a "model-repo" error due to missing model repository configuration.

To resolve this, we explicitly defined the model path using both an environment variable and a bind mount:

By setting the RIVA_MODEL_REPO environment variable and bind-mounting the local models directory to the container path /data/models, the error was resolved successfully.

The default port (e.g., 8050) may already be occupied by another service, leading to a “port is already in use” error. To prevent this, specify custom ports when launching Riva by using flags like --web-port 8443 and --ws-port 9443. This ensures Riva runs without interfering with other applications.

When connecting via HTTPS through the browser, sometimes the browser may not automatically prompt for microphone or speaker access permissions. In such cases, the user manually bypasses the security warning by selecting “Advanced” > “Proceed.” After the page loads, microphone and speaker permissions are granted manually by clicking the padlock icon in the address bar.

If the Riva logs show an endless “waiting” loop, follow these steps:

• Wait until the status changes to READY before proceeding.

• If the loop persists, it may indicate insufficient VRAM. In that case, try selecting a smaller model to reduce memory requirements.

This approach helps resolve the “waiting” hang and ensures Riva initializes properly.

For more information about NanoLLM and advanced configurations, visit the NanoLLM GitHub repository.