Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

release: v2.3.1 #557

Merged
merged 5 commits into from
Feb 8, 2025
Merged

release: v2.3.1 #557

merged 5 commits into from
Feb 8, 2025

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Feb 3, 2025

This pull request was created by GitHub Actions/AWS CodeBuild! Before merging, please do the following:

  • Review changelog/staleness report.
  • (Only for Minor/Major version releases) Review python package dependency and size report.
  • Review build/test results by clicking Build Logs in CI Report (be patient, tests take ~4hr).
  • Review ECR Scan results.

@sagemaker-distribution-bot sagemaker-distribution-bot deleted the release-2.3.1 branch February 4, 2025 03:28
@TRNWWZ TRNWWZ restored the release-2.3.1 branch February 4, 2025 03:29
@TRNWWZ TRNWWZ reopened this Feb 4, 2025
Ruinong Tian and others added 2 commits February 4, 2025 23:40
Fixing sagemaker-python-sdk tests
b48ae1c 
  1. specify aws region in .sh file instead of Dockerfile
  2. upgrade pytest version specifically
chore: add post-build artifact files for 2.3.1 release
e27006c
@sagemaker-distribution-bot
Copy link
Collaborator

Staleness Report: 2.3.1(gpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.5 3.1.5
pytorch 2.4.1 2.4.1
pandas 2.2.3 2.2.3
altair 5.5.0 5.5.0
${\color{red}boto3}$ 1.36.3 1.36.15
ipython 8.31.0 8.31.0
jupyter-lsp 2.2.5 2.2.5
jupyterlab 4.2.7 4.2.7
amazon-q-developer-jupyterlab-ext 3.4.6 3.4.6
langchain 0.3.17 0.3.17
jupyter-ai 2.29.1 2.29.1
amazon-sagemaker-jupyter-ai-q-developer 1.0.16 1.0.16
jupyter-scheduler 2.10.0 2.10.0
amazon-sagemaker-jupyter-scheduler 3.1.9 3.1.9
amazon-sagemaker-sql-magic 0.1.3 0.1.3
jupyterlab-lsp 5.0.3 5.0.3
amazon_sagemaker_sql_editor 0.1.14 0.1.14
scipy 1.15.1 1.15.1
matplotlib-base 3.10.0 3.10.0
scikit-learn 1.5.2 1.5.2
${\color{red}evaluate}$ 0.4.1 0.4.3
sentencepiece 0.1.99 0.1.99
pip 24.3.1 24.3.1
torchvision 0.19.1 0.19.1
autogluon 1.2.0 1.2.0
ipywidgets 8.1.5 8.1.5
notebook 7.2.2 7.2.2
aws-glue-sessions 1.0.8 1.0.8
libmamba 1.5.12 1.5.12
conda 24.11.3 24.11.3
${\color{red}dash}$ 2.18.1 2.18.2
docker-cli 27.5.1 27.5.1
uvicorn 0.34.0 0.34.0
fastapi 0.115.8 0.115.8
git-remote-codecommit 1.16 1.16
jupyter-activity-monitor-extension 0.3.1 0.3.1
jupyter-collaboration 2.1.5 2.1.5
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.2 0.50.2
keras 3.8.0 3.8.0
${\color{red}langchain-aws}$ 0.2.10 0.2.12
mlflow 2.20.1 2.20.1
py-xgboost-gpu 2.1.4 2.1.4
pyhive 0.7.0 0.7.0
python-gssapi 1.9.0 1.9.0
python-lsp-server 1.12.1 1.12.1
s3fs 2024.10.0 2024.10.0
sagemaker-code-editor 1.4.2 1.4.2
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.7 0.3.7
sagemaker-jupyterlab-extension 0.3.3 0.3.3
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-mlflow 0.1.0 0.1.0
sagemaker-python-sdk 2.228.0 2.228.0
sagemaker-studio-analytics-extension 0.1.4 0.1.4
seaborn 0.13.2 0.13.2
supervisor 4.2.5 4.2.5
tensorflow 2.17.0 2.17.0
tf-keras 2.17.0 2.17.0

Staleness Report: 2.3.1(cpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.5 3.1.5
pytorch 2.4.1 2.4.1
pandas 2.2.3 2.2.3
altair 5.5.0 5.5.0
${\color{red}boto3}$ 1.36.3 1.36.15
ipython 8.31.0 8.31.0
jupyter-lsp 2.2.5 2.2.5
jupyterlab 4.2.7 4.2.7
amazon-q-developer-jupyterlab-ext 3.4.6 3.4.6
langchain 0.3.17 0.3.17
jupyter-ai 2.29.1 2.29.1
amazon-sagemaker-jupyter-ai-q-developer 1.0.16 1.0.16
jupyter-scheduler 2.10.0 2.10.0
amazon-sagemaker-jupyter-scheduler 3.1.9 3.1.9
amazon-sagemaker-sql-magic 0.1.3 0.1.3
jupyterlab-lsp 5.0.3 5.0.3
amazon_sagemaker_sql_editor 0.1.14 0.1.14
scipy 1.15.1 1.15.1
matplotlib-base 3.10.0 3.10.0
scikit-learn 1.5.2 1.5.2
${\color{red}evaluate}$ 0.4.1 0.4.3
sentencepiece 0.1.99 0.1.99
pip 24.3.1 24.3.1
torchvision 0.19.1 0.19.1
catboost 1.2.7 1.2.7
autogluon 1.2.0 1.2.0
ipywidgets 8.1.5 8.1.5
notebook 7.2.2 7.2.2
aws-glue-sessions 1.0.8 1.0.8
libmamba 1.5.12 1.5.12
conda 24.11.3 24.11.3
${\color{red}dash}$ 2.18.1 2.18.2
docker-cli 27.5.1 27.5.1
uvicorn 0.34.0 0.34.0
fastapi 0.115.8 0.115.8
git-remote-codecommit 1.16 1.16
jupyter-activity-monitor-extension 0.3.1 0.3.1
jupyter-collaboration 2.1.5 2.1.5
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.2 0.50.2
keras 3.8.0 3.8.0
${\color{red}langchain-aws}$ 0.2.10 0.2.12
mlflow 2.20.1 2.20.1
py-xgboost-cpu 2.1.4 2.1.4
pyhive 0.7.0 0.7.0
python-gssapi 1.9.0 1.9.0
python-lsp-server 1.12.1 1.12.1
s3fs 2024.10.0 2024.10.0
sagemaker-code-editor 1.4.2 1.4.2
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.7 0.3.7
sagemaker-jupyterlab-extension 0.3.3 0.3.3
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-mlflow 0.1.0 0.1.0
sagemaker-python-sdk 2.228.0 2.228.0
sagemaker-studio-analytics-extension 0.1.4 0.1.4
seaborn 0.13.2 0.13.2
supervisor 4.2.5 4.2.5
tensorflow 2.17.0 2.17.0
tf-keras 2.17.0 2.17.0

@sagemaker-distribution-bot sagemaker-distribution-bot requested a review from a team as a code owner February 7, 2025 20:11
@sagemaker-distribution-bot
Copy link
Collaborator

GPU Total Image Size Report

Target Image Size Base Image Size Size Difference Size Change (%)
2.3.1-gpu:6.55 GB 2.3.0-gpu:6.26 GB 0.29 GB Larger 4.56% Larger

CPU Total Image Size Report

Target Image Size Base Image Size Size Difference Size Change (%)
2.3.1-cpu:2.02 GB 2.3.0-cpu:2.08 GB -0.06 GB Smaller 3.06% Smaller

Python Package Size Report (GPU)

Target Image Version: 2.3.1 | Base Image Version: 2.3.0

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
3.77GB 3.57GB 203.10MB 5.55

Top-20 Largest Python Packages

Package Version in the Target Image Size
libtorch 2.4.1 491.54MB
cudnn 9.7.1.26 491.06MB
tensorflow-base 2.17.0 369.15MB
libcublas 12.5.3.2 240.05MB
libmagma 2.8.0 238.80MB
nccl 2.25.1.1 175.53MB
mkl 2023.2.0 156.82MB
libcufft 11.2.3.61 148.63MB
libxgboost 2.1.4 128.61MB
libcusparse 12.5.1.3 119.08MB
libnpp 12.3.0.159 94.79MB
libcusolver 11.6.3.83 79.26MB
gcc_impl_linux-64 13.3.0 64.34MB
cuda-nvdisasm 12.5.39 47.62MB
catboost 1.2.7 41.72MB
sagemaker-code-editor 1.4.2 41.59MB
pillow 11.1.0 40.08MB
libcurand 10.3.6.82 39.82MB
gds-tools 1.10.0.4 37.78MB
pytorch 2.4.1 34.25MB

Python Package Size Delta

The total size of newly introduced Python packages is 46.59MB, accounts for 1.21% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
cudnn 9.7.1.26 9.3.0.75 107.87MB 28.15
nccl 2.25.1.1 2.24.3.1 55.44MB 46.17
libxgboost 2.1.4 2.1.3 35.03MB 37.43
libllvm15 15.0.7 - 31.78MB -
gtk3 3.24.43 - 5.31MB -
libcups 2.3.3 - 4.31MB -
epoxy 1.5.10 - 1.37MB -
jupyterlab 4.2.7 4.2.6 1.08MB 15.97
at-spi2-core 2.40.3 - 642.96KB -
libxkbcommon 1.8.0 - 627.29KB -
dbus 1.13.6 - 604.10KB -
adwaita-icon-theme 47.0 - 553.69KB -
llvmlite 0.44.0 0.43.0 546.05KB 16.11
xkeyboard-config 2.43 - 380.35KB -
babel 2.17.0 2.16.0 378.12KB 5.91
at-spi2-atk 2.38.0 - 331.93KB -
wayland 1.23.1 - 314.02KB -
numba 0.61.0 0.60.0 143.17KB 2.53
expat 2.6.4 - 134.91KB -
glib-tools 2.82.2 - 112.75KB -
graphviz 12.2.1 12.0.0 107.41KB 4.78
jupyter_ydoc 2.1.5 2.1.3 53.36KB 148.25
xorg-libxi 1.8.2 - 46.07KB -
xorg-libxtst 1.2.5 - 32.04KB -
xorg-libxcursor 1.2.3 - 31.77KB -
xorg-libxrandr 1.5.4 - 28.91KB -
beautifulsoup4 4.13.3 4.12.3 26.80KB 23.25
xorg-libxfixes 6.0.1 - 19.12KB -
pycrdt 0.12.8 0.10.9 16.65KB 2.17
xorg-libxinerama 1.1.5 - 13.57KB -
hicolor-icon-theme 0.17 - 13.52KB -
xorg-libxcomposite 0.4.6 - 13.28KB -
xorg-libxdamage 1.1.6 - 12.91KB -
transformers 4.48.3 4.48.1 10.01KB 0.3
sqlalchemy 2.0.38 2.0.37 7.73KB 0.22
huggingface_hub 0.28.0 0.27.1 5.86KB 2.15
opentelemetry-semantic-conventions 0.51b0 0.50b0 5.68KB 6.76
databricks-sdk 0.43.0 0.41.0 5.38KB 1.4
snowflake-connector-python 3.13.2 3.12.4 3.53KB 0.31
pyzmq 26.2.1 26.2.0 3.39KB 0.89
langchain-community 0.3.16 0.3.15 3.01KB 0.25
nss 3.108 3.107 2.51KB 0.13
liblzma-devel 5.6.4 5.6.3 1.98KB 0.54
h2 4.2.0 4.1.0 1.84KB 3.63
jupyter_events 0.12.0 0.11.0 1.45KB 6.71
gunicorn 23.0.0 22.0.0 1.16KB 0.64
ca-certificates 2025.1.31 2024.12.14 1.03KB 0.67
amazon-sagemaker-jupyter-scheduler 3.1.9 3.1.8 876.00B 0.51
sleef 3.8 3.7 865.00B 0.05
imageio 2.37.0 2.36.1 760.00B 0.26
libtasn1 4.20.0 4.19.0 653.00B 0.56
amazon-q-developer-jupyterlab-ext 3.4.6 3.4.5 602.00B 0.25
google-api-core 2.24.1 2.24.0 488.00B 0.54
opentelemetry-api 1.30.0 1.29.0 483.00B 1.09
langchain 0.3.17 0.3.15 421.00B 0.1
paramiko 3.5.1 3.5.0 369.00B 0.23
py-xgboost 2.1.4 2.1.3 335.00B 0.25
liblzma 5.6.4 5.6.3 225.00B 0.2
langchain-core 0.3.34 0.3.31 217.00B 0.08
marshmallow 3.26.1 3.26.0 209.00B 0.22
opentelemetry-sdk 1.30.0 1.29.0 208.00B 0.27
lightning-utilities 0.12.0 0.11.9 208.00B 0.73
py-xgboost-gpu 2.1.4 2.1.3 181.00B 1.13
xgboost 2.1.4 2.1.3 174.00B 1.08
mistune 3.1.1 3.1.0 132.00B 0.19
mlflow 2.20.1 2.20.0 58.00B 0.36
fastapi 0.115.8 0.115.7 50.00B 0.06
python-lsp-server-base 1.12.1 1.12.0 34.00B 0.06
python-lsp-server 1.12.1 1.12.0 34.00B 0.47
libedit 3.1.20250104 3.1.20240808 19.00B 0.01
xz 5.6.4 5.6.3 0.00B -
xz-gpl-tools 5.6.4 5.6.3 -69.00B -0.21
jupyter-ai-magics 2.29.1 2.29.0 -125.00B -0.35
mako 1.3.9 1.3.8 -128.00B -0.19
xz-tools 5.6.4 5.6.3 -619.00B -0.69
narwhals 1.25.2 1.24.0 -639.00B -0.37
xorg-libx11 1.8.11 1.8.10 -2.31KB -0.28
fonttools 4.56.0 4.55.6 -41.15KB -1.43
mlflow-skinny 2.20.1 2.20.0 -123.83KB -2.0
jupyter-ai 2.29.1 2.29.0 -505.93KB -68.24
mlflow-ui 2.20.1 2.20.0 -933.22KB -17.86
plotly 6.0.0 5.24.1 -2.85MB -37.25

Python Package Size Report (CPU)

Target Image Version: 2.3.1 | Base Image Version: 2.3.0

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
1.06GB 1.09GB -28.13MB -2.53

Top-20 Largest Python Packages

Package Version in the Target Image Size
mkl 2023.2.0 156.82MB
tensorflow-base 2.17.0 149.59MB
libtorch 2.4.1 49.40MB
sagemaker-code-editor 1.4.2 41.59MB
pillow 11.1.0 40.08MB
pytorch 2.4.1 34.23MB
libllvm15 15.0.7 31.78MB
python 3.11.11 29.21MB
ray-core 2.37.0 28.26MB
pandoc 3.6.2 20.36MB
scipy 1.15.1 18.34MB
amazon_sagemaker_sql_editor 0.1.14 17.18MB
nodejs 20.18.1 16.36MB
pandas 2.2.3 14.97MB
statsmodels 0.14.4 11.72MB
icu 75.1 11.57MB
scikit-image 0.20.0 10.26MB
scikit-learn 1.5.2 10.11MB
torchvision 0.19.1 10.04MB
catboost 1.2.7 8.85MB

Python Package Size Delta

The total size of newly introduced Python packages is 46.59MB, accounts for 4.3% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
libllvm15 15.0.7 - 31.78MB -
gtk3 3.24.43 - 5.31MB -
libcups 2.3.3 - 4.31MB -
epoxy 1.5.10 - 1.37MB -
jupyterlab 4.2.7 4.2.6 1.08MB 15.97
at-spi2-core 2.40.3 - 642.96KB -
libxkbcommon 1.8.0 - 627.29KB -
dbus 1.13.6 - 604.10KB -
adwaita-icon-theme 47.0 - 553.69KB -
llvmlite 0.44.0 0.43.0 546.05KB 16.11
xkeyboard-config 2.43 - 380.35KB -
babel 2.17.0 2.16.0 378.12KB 5.91
at-spi2-atk 2.38.0 - 331.93KB -
wayland 1.23.1 - 314.02KB -
numba 0.61.0 0.60.0 143.17KB 2.53
expat 2.6.4 - 134.91KB -
glib-tools 2.82.2 - 112.75KB -
graphviz 12.2.1 12.0.0 107.41KB 4.78
jupyter_ydoc 2.1.5 2.1.3 53.36KB 148.25
xorg-libxi 1.8.2 - 46.07KB -
xorg-libxtst 1.2.5 - 32.04KB -
xorg-libxcursor 1.2.3 - 31.77KB -
xorg-libxrandr 1.5.4 - 28.91KB -
beautifulsoup4 4.13.3 4.12.3 26.80KB 23.25
xorg-libxfixes 6.0.1 - 19.12KB -
pycrdt 0.12.8 0.10.9 16.65KB 2.17
xorg-libxinerama 1.1.5 - 13.57KB -
hicolor-icon-theme 0.17 - 13.52KB -
xorg-libxcomposite 0.4.6 - 13.28KB -
xorg-libxdamage 1.1.6 - 12.91KB -
transformers 4.48.3 4.48.1 10.01KB 0.3
sqlalchemy 2.0.38 2.0.37 7.73KB 0.22
huggingface_hub 0.28.0 0.27.1 5.86KB 2.15
opentelemetry-semantic-conventions 0.51b0 0.50b0 5.68KB 6.76
databricks-sdk 0.43.0 0.41.0 5.38KB 1.4
snowflake-connector-python 3.13.2 3.12.4 3.53KB 0.31
pyzmq 26.2.1 26.2.0 3.39KB 0.89
langchain-community 0.3.16 0.3.15 3.01KB 0.25
nss 3.108 3.107 2.51KB 0.13
liblzma-devel 5.6.4 5.6.3 1.98KB 0.54
h2 4.2.0 4.1.0 1.84KB 3.63
jupyter_events 0.12.0 0.11.0 1.45KB 6.71
gunicorn 23.0.0 22.0.0 1.16KB 0.64
py-xgboost 2.1.4 2.1.3 1.04KB 0.79
ca-certificates 2025.1.31 2024.12.14 1.03KB 0.67
amazon-sagemaker-jupyter-scheduler 3.1.9 3.1.8 876.00B 0.51
sleef 3.8 3.7 865.00B 0.05
imageio 2.37.0 2.36.1 760.00B 0.26
libtasn1 4.20.0 4.19.0 653.00B 0.56
amazon-q-developer-jupyterlab-ext 3.4.6 3.4.5 602.00B 0.25
opentelemetry-api 1.30.0 1.29.0 483.00B 1.09
langchain 0.3.17 0.3.15 421.00B 0.1
paramiko 3.5.1 3.5.0 369.00B 0.23
py-xgboost-cpu 2.1.4 2.1.3 229.00B 1.47
xgboost 2.1.4 2.1.3 226.00B 1.45
liblzma 5.6.4 5.6.3 225.00B 0.2
langchain-core 0.3.34 0.3.31 217.00B 0.08
marshmallow 3.26.1 3.26.0 209.00B 0.22
opentelemetry-sdk 1.30.0 1.29.0 208.00B 0.27
lightning-utilities 0.12.0 0.11.9 208.00B 0.73
mistune 3.1.1 3.1.0 132.00B 0.19
mlflow 2.20.1 2.20.0 58.00B 0.36
fastapi 0.115.8 0.115.7 50.00B 0.06
python-lsp-server-base 1.12.1 1.12.0 34.00B 0.06
python-lsp-server 1.12.1 1.12.0 34.00B 0.47
libedit 3.1.20250104 3.1.20240808 19.00B 0.01
xz 5.6.4 5.6.3 0.00B -
xz-gpl-tools 5.6.4 5.6.3 -69.00B -0.21
jupyter-ai-magics 2.29.1 2.29.0 -125.00B -0.35
mako 1.3.9 1.3.8 -128.00B -0.19
xz-tools 5.6.4 5.6.3 -619.00B -0.69
narwhals 1.25.2 1.24.0 -639.00B -0.37
xorg-libx11 1.8.11 1.8.10 -2.31KB -0.28
libxgboost 2.1.4 2.1.3 -14.52KB -0.46
fonttools 4.56.0 4.55.6 -41.15KB -1.43
mlflow-skinny 2.20.1 2.20.0 -123.83KB -2.0
jupyter-ai 2.29.1 2.29.0 -505.93KB -68.24
mlflow-ui 2.20.1 2.20.0 -933.22KB -17.86
plotly 6.0.0 5.24.1 -2.85MB -37.25

@sagemaker-distribution-bot
Copy link
Collaborator

Python Package Dependency Report

Target Image Version: 2.3.1 | Base Image Version: 2.3.0

Image Type: (GPU)

Package Version in the Target Image Dependencies

Image Type: (CPU)

Package Version in the Target Image Dependencies

Image Type: (GPU)

Package Version in the Target Image Dependencies

Image Type: (CPU)

Package Version in the Target Image Dependencies

Image Type: (GPU)

Package Version in the Target Image Dependencies

Image Type: (CPU)

Package Version in the Target Image Dependencies

Image Type: (GPU)

Package Version in the Target Image Dependencies

Image Type: (CPU)

Package Version in the Target Image Dependencies

@sagemaker-distribution-bot sagemaker-distribution-bot deleted the release-2.3.1 branch February 7, 2025 20:18
@sagemaker-distribution-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: CosmosImageBuildersagemaker-U5omrjiHQCoa
  • Commit ID: b48ae1c
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@TRNWWZ TRNWWZ restored the release-2.3.1 branch February 7, 2025 20:21
@TRNWWZ TRNWWZ reopened this Feb 7, 2025
@aws aws deleted a comment from sagemaker-distribution-bot Feb 7, 2025
@aws aws deleted a comment from sagemaker-distribution-bot Feb 7, 2025
@aws aws deleted a comment from sagemaker-distribution-bot Feb 7, 2025
@aws aws deleted a comment from sagemaker-distribution-bot Feb 7, 2025
@TRNWWZ
Copy link
Contributor

TRNWWZ commented Feb 7, 2025 •
edited
Loading 

FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pandas.test.Dockerfile-required_packages8]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sm-python-sdk.test.Dockerfile-required_packages9]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sagemaker-studio-analytics-extension.test.Dockerfile-required_packages21]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[mlflow.test.Dockerfile-required_packages28]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[gpu-dependencies.test.Dockerfile-required_packages31]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[s3fs.test.Dockerfile-required_packages33]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[s3fs.test.Dockerfile-required_packages36]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[seaborn.test.Dockerfile-required_packages34]

panda -

========================================================================== short test summary info ===========================================================================
FAILED pandas/tests/plotting/frame/test_frame.py::TestDataFramePlots::test_boxplot_vertical - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/frame/test_frame.py::TestDataFramePlots::test_boxplot_vertical_subplots - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/frame/test_frame.py::TestDataFramePlots::test_boxplot_vertical_positions - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_plot_xlabel_ylabel[True] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_plot_xlabel_ylabel[False] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_plot_box[True] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_plot_box[False] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_boxplot_xlabel_ylabel[True] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_boxplot_xlabel_ylabel[False] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_boxplot_group_xlabel_ylabel[True] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_boxplot_group_xlabel_ylabel[False] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_boxplot_group_no_xlabel_ylabel[True] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
FAILED pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::test_boxplot_group_no_xlabel_ylabel[False] - PendingDeprecationWarning: vert: bool will be deprecated in a future version. Use orientation: {'vertical', 'horizontal'} instead.
=========================== 13 failed, 200958 passed, 21744 skipped, 7381 deselected, 1983 xfailed, 76 xpassed, 26 warnings in 1289.55s (0:21:29) ============================

All failures are caused by warning, not actual failure.

sm-python-sdk - Tests failing due to old pytest version specified in https://github.com/aws/sagemaker-python-sdk/blob/master/requirements/extras/test_requirements.txt#L5. Fix is included in this PR, tested unit tests with fix locally for both CPU and GPU images with most test cases succeeded, but

========================================================================== short test summary info ===========================================================================
FAILED tests/unit/sagemaker/serve/builder/test_tei_builder.py::TestTEIBuilder::test_tei_builder_image_uri_override_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_tei_builder.py::TestTEIBuilder::test_tei_builder_optimized_sagemaker_endpoint_mode_no_s3_upload_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_tei_builder.py::TestTEIBuilder::test_tei_builder_overwritten_deploy_from_local_container_to_sagemaker_endpoint_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_tei_builder.py::TestTEIBuilder::test_tei_builder_sagemaker_endpoint_mode_no_s3_upload_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_tgi_builder.py::TestTGIBuilder::test_tgi_builder_optimized_sagemaker_endpoint_mode_no_s3_upload_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_tgi_builder.py::TestTGIBuilder::test_tgi_builder_overwritten_deploy_from_local_container_to_sagemaker_endpoint_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_tgi_builder.py::TestTGIBuilder::test_tgi_builder_sagemaker_endpoint_mode_no_s3_upload_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_transformers_builder.py::TestTransformersBuilder::test_transformers_builder_empty_hf_md_defaults_to_transformers_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_transformers_builder.py::TestTransformersBuilder::test_transformers_builder_image_uri_override_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_transformers_builder.py::TestTransformersBuilder::test_transformers_builder_optimized_sagemaker_endpoint_mode_no_s3_upload_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_transformers_builder.py::TestTransformersBuilder::test_transformers_builder_overwritten_deploy_from_local_container_to_sagemaker_endpoint_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/builder/test_transformers_builder.py::TestTransformersBuilder::test_transformers_builder_sagemaker_endpoint_mode_no_s3_upload_success - botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
FAILED tests/unit/sagemaker/serve/utils/test_hardware_detector.py::test_total_inference_model_size_mib - AttributeError: module 'triton' has no attribute 'language'
==================================== 13 failed, 8034 passed, 3778 skipped, 22 deselected, 3 xpassed, 3352 warnings in 1914.81s (0:31:54) =====================================

Failures are because test cases try interacting with actual S3 client, or dependency issue.

sagemaker-studio-analytics-extension - No credential exception, tests passed locally

mlflow - RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx, environment issue, tests passed locally

gpu-dependencies - same as above

s3fs - Failure:

s3 = <s3fs.core.S3FileSystem object at 0x7fa76ea4f190>

    def test_info(s3):
        s3.touch(a)
        s3.touch(b)
        info = s3.info(a)
        linfo = s3.ls(a, detail=True)[0]
        assert abs(info.pop("LastModified") - linfo.pop("LastModified")).seconds < 1
        info.pop("VersionId")
        info.pop("ContentType")
        linfo.pop("Key")
        linfo.pop("Size")
>       assert info == linfo
E       assert {'ETag': '"d4...size': 0, ...} == {'ChecksumAlg.../test/a', ...}
E         
E         Omitting 5 identical items, use -vv to show
E         Right contains 1 more item:
E         {'ChecksumAlgorithm': ['CRC32']}
E         Use -v to get more diff

test_s3fs.py:271: AssertionError

It's due to a recent change in their backend, commit tagged by 2025.2.0 has the fix https://github.com/fsspec/s3fs/pull/936/files, but all previous commits would be impacted. We are using 2024.10.0, which cannot be upgraded until we do major version bump. Record in a issue: #559

seaborn - test passed locally, flaky issue

@TRNWWZ TRNWWZ merged commit 9837726 into main Feb 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@TRNWWZ TRNWWZ TRNWWZ approved these changes

@aws-tianquaw aws-tianquaw aws-tianquaw approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@sagemaker-distribution-bot @TRNWWZ @aws-tianquaw