Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report app dependency addition/removal to DataDog #35455

Merged
merged 12 commits into from
Dec 10, 2024
Merged

Report app dependency addition/removal to DataDog #35455

Changes from 5 commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
2056cc2
Report app dependency removal
Charl1996 Nov 28, 2024
7179077
Patch up method
Charl1996 Nov 28, 2024
a94b241
Consider that build can be Application instance
Charl1996 Nov 29, 2024
c2ef0d0
Rename var
Charl1996 Dec 4, 2024
af3a6a1
Send metric for app dependecies feature added to build
Charl1996 Dec 4, 2024
08b1425
Update docstring
Charl1996 Dec 5, 2024
1823cbd
Wrap unwrapped last_build app doc
Charl1996 Dec 5, 2024
319593f
Use calling class's own wrap method
Charl1996 Dec 9, 2024
293fcaa
Merge branch 'master' into cs/SC-4053-add-metric-to-datadog
mkangia Dec 9, 2024
1c71a7b
Add some tests
Charl1996 Dec 10, 2024
cbd65ab
Merge branch 'cs/SC-4053-add-metric-to-datadog' of github.com:dimagi/…
Charl1996 Dec 10, 2024
aee1a9a
Merge branch 'master' into cs/SC-4053-add-metric-to-datadog
Charl1996 Dec 10, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 28 additions & 0 deletions corehq/apps/app_manager/models.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -181,6 +181,7 @@
from corehq.blobs.mixin import CODES, BlobMixin
from corehq.const import USER_DATE_FORMAT, USER_TIME_FORMAT
from corehq.util import bitly, view_utils
from corehq.util.metrics import metrics_counter
from corehq.util.quickcache import quickcache
from corehq.util.timer import TimingContext, time_method
from corehq.util.timezones.conversions import ServerTime
Expand Down Expand Up @@ -4467,8 +4468,35 @@ def make_build(self, comment=None, user_id=None):
assert copy._id
prune_auto_generated_builds.delay(self.domain, self._id)

self.check_build_dependencies(new_build=copy)

return copy

def check_build_dependencies(self, new_build):
"""
Reports whether the app dependencies have been removed.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks like the documentation needs to be updated.
And possibly the function name as well.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

08b1425

"""

def has_dependencies(build):
if isinstance(build, Application):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wont it always be Application object since we wrapped it?
Its unclear why we are checking this here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new_build is wrapped and will be an instance of Application, but the last_build is not (see here). I suppose I have two options:

  1. Also make sure to wrap the last_build results and remove the instance checking
  2. Leave as is and handle different instance types.

Any preference from your side?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, no, I'm going to wrap it as well, because I think the fact that you had to ask this question makes the code less obvious as it is now.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1823cbd

profile = build.profile
else:
profile = build.get('profile', {})

return bool(
profile.get('features', {}).get('dependencies')
)

new_build_has_dependencies = has_dependencies(new_build)

last_build = get_latest_build_doc(self.domain, self.id)
last_build_has_dependencies = has_dependencies(last_build) if last_build else False

if not last_build_has_dependencies and new_build_has_dependencies:
metrics_counter('commcare.app_build.dependencies_added')
elif last_build_has_dependencies and not new_build_has_dependencies:
metrics_counter('commcare.app_build.dependencies_removed')
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like that we have simplified the approach here.

Wanted to check if this metric in itself would be useful? Don't we need the uptake as well?
I believe on datadog you can have a counter with both positive and negative values, so you get a graph with both additions and removals at once.
example here

Or we could report uptake separately, which seems easy enough to add now.

if (not latest_build or not has_dependencies(latest_build)) and has_dependencies(new_build):
    metrics_counter('commcare.app_build.dependencies_added')

I would vote for the single counter with both +/-

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe on datadog you can have a counter with both positive and negative values, so you get a graph with both additions and removals at once.

I'll check this out. Thanks for the suggestion.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

af3a6a1

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So, these will show as two separate metrics right? not as one? or they can be combined if needed on the datadog UI?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mkangia They can be combined as needed on Data Dog.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great 👍


def convert_app_to_build(self, copy_of, user_id, comment=None):
self.copy_of = copy_of
built_on = datetime.datetime.utcnow()
Expand Down
Loading