edit above file and below config to have num_nodes = 2 and devices = 8

python trlx/examples/nemo_ilql_inference.py trlx/configs/nemo_configs/megatron_65b.yaml "/path/to/checkpoints"

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.