Choose a GPU cloud for your workload
Use a repeatable benchmark and a clear acceptance rule.
Updated
Start with the result you need. For training, record the model, precision, batch size, data path and checkpoint size. For inference, record request sizes, concurrency and the latency you must meet. Do not use a vendor's peak throughput as your application benchmark.