WIP sparse_attention

[TedThemistokleous]

No description provided.

[migraphx-bot]

Test	Batch	Rate new 6b5d10	Rate old 783289	Diff	Compare
torchvision-resnet50	64	3,237.03	3,235.51	0.05%	✅
torchvision-resnet50_fp16	64	6,878.93	6,875.02	0.06%	✅
torchvision-densenet121	32	2,437.41	2,439.43	-0.08%	✅
torchvision-densenet121_fp16	32	4,174.99	4,197.70	-0.54%	✅
torchvision-inceptionv3	32	1,614.34	1,614.98	-0.04%	✅
torchvision-inceptionv3_fp16	32	2,689.32	2,681.68	0.28%	✅
cadene-inceptionv4	16	749.83	749.95	-0.02%	✅
cadene-resnext64x4	16	809.04	809.39	-0.04%	✅
slim-mobilenet	64	6,662.82	6,663.59	-0.01%	✅
slim-nasnetalarge	64	199.03	199.05	-0.01%	✅
slim-resnet50v2	64	3,426.55	3,427.81	-0.04%	✅
bert-mrpc-onnx	8	1,144.39	1,144.91	-0.04%	✅
bert-mrpc-tf	1	485.15	483.80	0.28%	✅
pytorch-examples-wlang-gru	1	449.30	469.87	-4.38%	🔴
pytorch-examples-wlang-lstm	1	440.43	453.25	-2.83%	✅
torchvision-resnet50_1	1	806.22	806.52	-0.04%	✅
cadene-dpn92_1	1	434.80	431.78	0.70%	✅
cadene-resnext101_1	1	390.48	389.90	0.15%	✅
onnx-taau-downsample	1	373.11	372.16	0.25%	✅
dlrm-criteoterabyte	1	31.80	31.80	-0.00%	✅
dlrm-criteoterabyte_fp16	1	51.01	51.06	-0.10%	✅
agentmodel	1	8,617.42	8,610.45	0.08%	✅
unet_fp16	2	58.00	58.12	-0.20%	✅
resnet50v1_fp16	1	1,036.50	1,038.39	-0.18%	✅
resnet50v1_int8	1	791.49	832.25	-4.90%	🔴
bert_base_cased_fp16	64	1,172.25	1,172.37	-0.01%	✅
bert_large_uncased_fp16	32	362.48	362.51	-0.01%	✅
bert_large_fp16	1	201.11	200.14	0.48%	✅
distilgpt2_fp16	16	2,216.65	2,219.12	-0.11%	✅
yolov5s	1	520.77	545.73	-4.57%	🔴
tinyllama	1	43.62	43.63	-0.02%	✅
vicuna-fastchat	1	43.85	43.87	-0.05%	✅
whisper-tiny-encoder	1	411.80	412.24	-0.11%	✅
whisper-tiny-decoder	1	409.71	407.78	0.47%	✅

This build is not recommended to merge 🔴

[migraphx-bot]

     ✅ bert-mrpc-onnx: PASSED: MIGraphX meets tolerance

     ✅ bert-mrpc-tf: PASSED: MIGraphX meets tolerance

     ✅ pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance

     ✅ pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance

     ✅ torchvision-resnet50_1: PASSED: MIGraphX meets tolerance

     ✅ cadene-dpn92_1: PASSED: MIGraphX meets tolerance

     ✅ cadene-resnext101_1: PASSED: MIGraphX meets tolerance

     ✅ dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance

     ✅ agentmodel: PASSED: MIGraphX meets tolerance

     ✅ unet: PASSED: MIGraphX meets tolerance

     ✅ resnet50v1: PASSED: MIGraphX meets tolerance

     ✅ bert_base_cased_fp16: PASSED: MIGraphX meets tolerance

🔴bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     ✅ bert_large: PASSED: MIGraphX meets tolerance

     ✅ yolov5s: PASSED: MIGraphX meets tolerance

     ✅ tinyllama: PASSED: MIGraphX meets tolerance

     ✅ vicuna-fastchat: PASSED: MIGraphX meets tolerance

     ✅ whisper-tiny-encoder: PASSED: MIGraphX meets tolerance

     ✅ whisper-tiny-decoder: PASSED: MIGraphX meets tolerance

     ✅ distilgpt2_fp16: PASSED: MIGraphX meets tolerance