python_packages_on_M1.md

Installing python packages on Mac M1

If you are here, you are already on python3, first set up a venv or a different python from the system python (which comes with the OS), this is so that you don't mess that in any case!

Now run,

pip install --upgrade pip

Numpy And Pandas

pip install cython

pip install --no-binary :all: --no-use-pep517 numpy

pip install pandas

Scipy

pip install cython pybind11
pip install pythran

brew install openblas gfortran
export OPENBLAS=/opt/homebrew/opt/openblas/lib/

pip install --no-binary :all: --no-use-pep517 scipy

Reference: (SO)Install SciPy on Apple Silicon (ARM / M1)

SkLearn

pip3 install -U --no-use-pep517 scikit-learn

PyTorch

pip install torch

PySpark

PYSPARK_HADOOP_VERSION=3 pip install pyspark

PyArrow

brew install apache-arrow
pip install pyarrow