Skip to content

Conversation

antonis
Copy link
Contributor

@antonis antonis commented Sep 4, 2025

📢 Type of change

  • Bugfix
  • New feature
  • Enhancement
  • Refactoring

Based on: #5038

📜 Description

I've noticed that metrics ios check has started to fail consistently (though marginally) due to small changes in the size of the app (example job run) after the Cocoa bump to 8.55.0

BinarySizeTest > app size() FAILED
    java.lang.AssertionError: 1341888 should be < 1331200
        at BinarySizeTest.app size(BinarySizeTest.kt:37)

Notes:

💡 Motivation and Context

Ci failure

💚 How did you test it?

CI

📝 Checklist

  • I added tests to verify changes
  • No new PII added or SDK only sends newly added PII if sendDefaultPII is enabled
  • I updated the docs if needed.
  • I updated the wizard if needed.
  • All tests passing
  • No breaking changes

🔮 Next steps

#skip-changelog

web-flow and others added 30 commits July 31, 2025 13:59
This reverts commit c59bb69.
This reverts commit 8f067d0.
@antonis antonis marked this pull request as ready for review September 4, 2025 17:15
Copy link
Contributor

github-actions bot commented Sep 4, 2025

Android (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 466.42 ms 472.39 ms 5.97 ms
Size 17.75 MiB 19.68 MiB 1.94 MiB

Baseline results on branch: deps/scripts/update-cocoa.sh

Startup times

Revision Plain With Sentry Diff
f9bd7d3 403.74 ms 385.54 ms -18.20 ms
f139dae 415.36 ms 400.73 ms -14.63 ms
6c67a16 442.07 ms 454.91 ms 12.84 ms
ba483fc 407.51 ms 398.52 ms -8.99 ms

App size

Revision Plain With Sentry Diff
f9bd7d3 17.75 MiB 20.15 MiB 2.41 MiB
f139dae 17.75 MiB 20.15 MiB 2.40 MiB
6c67a16 17.75 MiB 20.15 MiB 2.40 MiB
ba483fc 17.75 MiB 20.15 MiB 2.40 MiB

Previous results on branch: antonis/increase-ios-binary-size

Startup times

Revision Plain With Sentry Diff
f2f84e2 396.86 ms 400.18 ms 3.32 ms
268fd4c 431.55 ms 443.88 ms 12.33 ms

App size

Revision Plain With Sentry Diff
f2f84e2 17.75 MiB 19.68 MiB 1.93 MiB
268fd4c 17.75 MiB 19.68 MiB 1.94 MiB

Copy link
Contributor

github-actions bot commented Sep 4, 2025

Android (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 398.62 ms 470.27 ms 71.65 ms
Size 7.15 MiB 8.41 MiB 1.26 MiB

Baseline results on branch: deps/scripts/update-cocoa.sh

Startup times

Revision Plain With Sentry Diff
f139dae+dirty 383.66 ms 389.28 ms 5.62 ms
f9bd7d3+dirty 403.83 ms 442.76 ms 38.92 ms
ba483fc+dirty 432.91 ms 454.14 ms 21.23 ms
6c67a16+dirty 408.86 ms 440.96 ms 32.10 ms

App size

Revision Plain With Sentry Diff
f139dae+dirty 7.15 MiB 8.42 MiB 1.26 MiB
f9bd7d3+dirty 7.15 MiB 8.42 MiB 1.27 MiB
ba483fc+dirty 7.15 MiB 8.42 MiB 1.26 MiB
6c67a16+dirty 7.15 MiB 8.42 MiB 1.26 MiB

Previous results on branch: antonis/increase-ios-binary-size

Startup times

Revision Plain With Sentry Diff
f2f84e2+dirty 375.33 ms 431.26 ms 55.93 ms
268fd4c+dirty 366.98 ms 408.04 ms 41.07 ms

App size

Revision Plain With Sentry Diff
f2f84e2+dirty 7.15 MiB 8.41 MiB 1.26 MiB
268fd4c+dirty 7.15 MiB 8.41 MiB 1.26 MiB

Copy link
Contributor

github-actions bot commented Sep 4, 2025

iOS (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1215.27 ms 1225.83 ms 10.57 ms
Size 3.19 MiB 4.48 MiB 1.29 MiB

Baseline results on branch: deps/scripts/update-cocoa.sh

Startup times

Revision Plain With Sentry Diff
f139dae+dirty 1213.82 ms 1215.87 ms 2.05 ms
ba483fc+dirty 1203.07 ms 1213.62 ms 10.55 ms
6c67a16+dirty 1220.52 ms 1223.47 ms 2.95 ms
f9bd7d3+dirty 1224.46 ms 1237.04 ms 12.58 ms
8b9ad38+dirty 1218.50 ms 1213.23 ms -5.27 ms

App size

Revision Plain With Sentry Diff
f139dae+dirty 3.19 MiB 4.36 MiB 1.17 MiB
ba483fc+dirty 3.19 MiB 4.35 MiB 1.17 MiB
6c67a16+dirty 3.19 MiB 4.35 MiB 1.16 MiB
f9bd7d3+dirty 3.19 MiB 4.38 MiB 1.19 MiB
8b9ad38+dirty 3.19 MiB 4.48 MiB 1.29 MiB

Previous results on branch: antonis/increase-ios-binary-size

Startup times

Revision Plain With Sentry Diff
f2f84e2+dirty 1230.43 ms 1223.81 ms -6.62 ms
268fd4c+dirty 1211.45 ms 1210.80 ms -0.65 ms

App size

Revision Plain With Sentry Diff
f2f84e2+dirty 3.19 MiB 4.48 MiB 1.29 MiB
268fd4c+dirty 3.19 MiB 4.48 MiB 1.29 MiB

Copy link
Contributor

github-actions bot commented Sep 4, 2025

iOS (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1227.42 ms 1221.18 ms -6.23 ms
Size 2.63 MiB 3.91 MiB 1.28 MiB

Baseline results on branch: deps/scripts/update-cocoa.sh

Startup times

Revision Plain With Sentry Diff
6c67a16+dirty 1218.27 ms 1224.22 ms 5.96 ms
f9bd7d3+dirty 1207.15 ms 1216.72 ms 9.57 ms
ba483fc+dirty 1211.24 ms 1220.49 ms 9.24 ms
f139dae+dirty 1220.86 ms 1233.21 ms 12.35 ms

App size

Revision Plain With Sentry Diff
6c67a16+dirty 2.63 MiB 3.78 MiB 1.15 MiB
f9bd7d3+dirty 2.63 MiB 3.81 MiB 1.18 MiB
ba483fc+dirty 2.63 MiB 3.78 MiB 1.15 MiB
f139dae+dirty 2.63 MiB 3.80 MiB 1.17 MiB

Previous results on branch: antonis/increase-ios-binary-size

Startup times

Revision Plain With Sentry Diff
f2f84e2+dirty 1229.94 ms 1230.94 ms 1.00 ms
268fd4c+dirty 1227.55 ms 1220.45 ms -7.10 ms

App size

Revision Plain With Sentry Diff
f2f84e2+dirty 2.63 MiB 3.91 MiB 1.28 MiB
268fd4c+dirty 2.63 MiB 3.91 MiB 1.28 MiB

Copy link
Collaborator

@lucas-zimerman lucas-zimerman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Base automatically changed from antonis/remove_cocoa_flags to deps/scripts/update-cocoa.sh September 5, 2025 09:44
@antonis antonis merged commit 933d0fb into deps/scripts/update-cocoa.sh Sep 5, 2025
15 checks passed
@antonis antonis deleted the antonis/increase-ios-binary-size branch September 5, 2025 09:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants