[train] Add concurrency load tests to GPU CI

[SumanthRH]

Summary

#1320 added benchmarking scripts for concurrency load testing. Once the remote inference codepath is more feature complete, we should add the load test to GPU CI.