Generate a resource recommendation report for a model.
- Log in to iQ Studio as an administrator, and then select Open Model Manager.
- From the Model Operations page, select Resource Recommendation.
- Enter the model details.
- Model name: Enter the model name. Use letters, numbers, hyphens, underscores, and slash. Maximum length: 100 characters.
- Model version or revision: Auto‑filled based on the selected model.
- Data type: Select the inference precision: Float32, Float16, or BFloat16.
- Tokens: Enter the number of tokens for the model. Default value is 3200.
- Review the recommended values for the following resources:
- CPU
- Memory (RAM)
- GPU memory