[misc] Building AICB from source

[galeselee]

1. create conda env

conda create -n aicb python=3.10 
conda install pytorch==2.5.1 torchvision==0.20.1 torchaudio==2.5.1 pytorch-cuda=12.1 -c pytorch -c nvidia

2. Install packages using pip (cuda-12.1)

pip install flash_attn
pip install git+https://github.com/fanshiqing/grouped_gemm@v1.0
pip3 install einops 
...

3. build apex

https://github.com/NVIDIA/apex
pip install -v --disable-pip-version-check --no-cache-dir --no-build-isolation --config-settings "--build-option=--cpp_ext" --config-settings "--build-option=--cuda_ext" --config-settings "--build-option=--fast_layer_norm" ./