[wip][tritonbench] Test benchmarking without docker#118

xuzhao9 wants to merge 9 commits intomainpytorch/pytorch-integration-testing:mainfrom

xz9/disable-dindpytorch/pytorch-integration-testing:xz9/disable-dindCopy head branch name to clipboard