From addbe9477c6c4e55125824a0410f3894d46f3964 Mon Sep 17 00:00:00 2001 From: Steve Willoughby Date: Tue, 26 Mar 2024 17:08:05 -0700 Subject: [PATCH 1/5] changelog, bump version --- CHANGELOG.md | 31 +++++++++++++++++++++++++++++++ v3/newrelic/version.go | 2 +- 2 files changed, 32 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index a9b75e1f1..619b051cc 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,34 @@ +## 3.31.0 +### Added + * Integration packages to instrument AI model invocations (see below). + * New package nrawsbedrock v1.0.0 introduced to instrument calls to Amazon Bedrock Runtime Client API `InvokeModel` and `InvokeModelWithResponseStream` calls. + * New package nropenai v1.0.0 introduced to instrument OpenAI model invocations. + +### AI Monitoring Configuration +New configuration options are available specific to [AI monitoring](). These settings include: + * `AIMonitoring.Enabled`, configured via `ConfigAIMonitoring.Enabled(`_bool_`)` [default `false`] + * `AIMonitoring.Streaming.Enabled`, configured via `ConfigAIMonitoringStreamingEnabled(`_bool_`)` [default `true`] + * `AIMonitoring.Content.Enabled`, configured via `ConfigAIMonitoringContentEnabled(`_bool_`)` [default `true`] + +### AI Monitoring Public API Methods +Two new AI monitoring related public API methods have been added, as methods of the `newrelic.Application` value returned by `newrelic.NewApplication`: + * [app.RecordLLMFeedbackEvent](https://pkg.go.dev/github.com/newrelic/go-agent/v3/newrelic#Application.RecordLLMFeedbackEvent) + * [app.SetLLMTokenCountCallback](https://pkg.go.dev/github.com/newrelic/go-agent/v3/newrelic#Application.SetLLMTokenCountCallback) + +### AI Monitoring +New Relic AI monitoring is the industry’s first APM solution that provides end-to-end visibility for AI Large Language Model (LLM) applications. It enables end-to-end visibility into the key components of an AI LLM application. With AI monitoring, users can monitor, alert, and debug AI-powered applications for reliability, latency, performance, security and cost. AI monitoring also enables AI/LLM specific insights (metrics, events, logs and traces) which can easily integrate to build advanced guardrails for enterprise security, privacy and compliance. + +AI monitoring offers custom-built insights and tracing for the complete lifecycle of an LLM’s prompts and responses, from raw user input to repaired/polished responses. AI monitoring provides built-in integrations with popular LLMs and components of the AI development stack. This release provides instrumentation for [OpenAI](https://pkg.go.dev/github.com/newrelic/go-agent/v3/integrations/nropenai) +and [Bedrock](https://pkg.go.dev/github.com/newrelic/go-agent/v3/integrations/nrawsbedrock). + +When AI monitoring is enabled with `ConfigAIMonitoringEnabled(true)`, the agent will now capture AI LLM related data. This data will be visible under a new APM tab called AI Responses. See our [AI Monitoring documentation](https://docs.newrelic.com/docs/ai-monitoring/intro-to-ai-monitoring/) for more details. + +### Support statement +We use the latest version of the Go language. At minimum, you should be using no version of Go older than what is supported by the Go team themselves. +See the [Go agent EOL Policy](https://docs.newrelic.com/docs/apm/agents/go-agent/get-started/go-agent-eol-policy/) for details about supported versions of the Go agent and third-party components. + + + ## 3.30.0 ### Added * Updated the depencency on nrsecurityagent to 1.0.0. diff --git a/v3/newrelic/version.go b/v3/newrelic/version.go index 5e1658b1c..4a34de8eb 100644 --- a/v3/newrelic/version.go +++ b/v3/newrelic/version.go @@ -11,7 +11,7 @@ import ( const ( // Version is the full string version of this Go Agent. - Version = "3.30.0" + Version = "3.31.0" ) var ( From 171a65bc8dd060801e6a98986d37ed8809bfb588 Mon Sep 17 00:00:00 2001 From: Steve Willoughby Date: Wed, 27 Mar 2024 10:44:37 -0700 Subject: [PATCH 2/5] updated release notes --- CHANGELOG.md | 10 ++++++++-- 1 file changed, 8 insertions(+), 2 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 619b051cc..472b040db 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,8 +1,14 @@ ## 3.31.0 ### Added * Integration packages to instrument AI model invocations (see below). - * New package nrawsbedrock v1.0.0 introduced to instrument calls to Amazon Bedrock Runtime Client API `InvokeModel` and `InvokeModelWithResponseStream` calls. - * New package nropenai v1.0.0 introduced to instrument OpenAI model invocations. + * New package nrawsbedrock v1.0.0 introduced to instrument calls to Amazon Bedrock Runtime Client API `InvokeModel` and `InvokeModelWithResponseStream` calls. Also provides a simple one-step method which invokes stream invocations and harvests the response stream data for you. + * New package nropenai v1.0.0 introduced to instrument calls to OpenAI using `NRCreateChatCompletion`, `NRCreateChatCompletionStream`, and `NRCreateEmbedding` calls. + +### Fixed + * `.Ignore` was not ignoring transaction. Fixes [Issue #845](https://github.com/newrelic/go-agent/issues/845). + * Added nil error check in wrap function. Fixes [Issue #862](https://github.com/newrelic/go-agent/issues/862). + * `WrapBackgroundCore` background logger was not sending logs to New Relic. Fixes [Issue #859](https://github.com/newrelic/go-agent/issues/859). + * Corrected pgx5 integration example which caused a race condition. Thanks to @WillAbides! Fixes [Issue #855](https://github.com/newrelic/go-agent/issues/855). ### AI Monitoring Configuration New configuration options are available specific to [AI monitoring](). These settings include: From cde46de104c77ed91194c7852b13a3d52b94f357 Mon Sep 17 00:00:00 2001 From: Steve Willoughby Date: Wed, 27 Mar 2024 10:46:32 -0700 Subject: [PATCH 3/5] updated release notes --- CHANGELOG.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 472b040db..8253bde68 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -11,7 +11,7 @@ * Corrected pgx5 integration example which caused a race condition. Thanks to @WillAbides! Fixes [Issue #855](https://github.com/newrelic/go-agent/issues/855). ### AI Monitoring Configuration -New configuration options are available specific to [AI monitoring](). These settings include: +New configuration options are available specific to AI monitoring. These settings include: * `AIMonitoring.Enabled`, configured via `ConfigAIMonitoring.Enabled(`_bool_`)` [default `false`] * `AIMonitoring.Streaming.Enabled`, configured via `ConfigAIMonitoringStreamingEnabled(`_bool_`)` [default `true`] * `AIMonitoring.Content.Enabled`, configured via `ConfigAIMonitoringContentEnabled(`_bool_`)` [default `true`] From 2fc1cc8c64c14cb79e4ac1c590767281759bf797 Mon Sep 17 00:00:00 2001 From: Steve Willoughby Date: Wed, 27 Mar 2024 10:52:07 -0700 Subject: [PATCH 4/5] updated release notes --- CHANGELOG.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index 8253bde68..434c3e13d 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -9,6 +9,10 @@ * Added nil error check in wrap function. Fixes [Issue #862](https://github.com/newrelic/go-agent/issues/862). * `WrapBackgroundCore` background logger was not sending logs to New Relic. Fixes [Issue #859](https://github.com/newrelic/go-agent/issues/859). * Corrected pgx5 integration example which caused a race condition. Thanks to @WillAbides! Fixes [Issue #855](https://github.com/newrelic/go-agent/issues/855). + * Updated third-party library versions due to reported security or other supportability issues: + * `github.com/jackc/pgx/v5` to 5.5.4 in `nrpgx5` integration + * `google.gopang.org/protobuf` to 1.33.0 in `nrmicro` and `nrgrpc` integrations + * `github.com/jackc/pgx/v4` to 4.18.2 in `nrpgx` integration ### AI Monitoring Configuration New configuration options are available specific to AI monitoring. These settings include: From 471c1f3546766ba7607e98e58195ebb0d1afc4ae Mon Sep 17 00:00:00 2001 From: Steve Willoughby Date: Wed, 27 Mar 2024 12:15:28 -0700 Subject: [PATCH 5/5] updated release notes --- CHANGELOG.md | 1 + 1 file changed, 1 insertion(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index 434c3e13d..90083c249 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -3,6 +3,7 @@ * Integration packages to instrument AI model invocations (see below). * New package nrawsbedrock v1.0.0 introduced to instrument calls to Amazon Bedrock Runtime Client API `InvokeModel` and `InvokeModelWithResponseStream` calls. Also provides a simple one-step method which invokes stream invocations and harvests the response stream data for you. * New package nropenai v1.0.0 introduced to instrument calls to OpenAI using `NRCreateChatCompletion`, `NRCreateChatCompletionStream`, and `NRCreateEmbedding` calls. + * Dockerfile in the `examples/server` sample app which facilitates the easy creation of a containerized ready-to-run sample app for situations where that makes testing easier. ### Fixed * `.Ignore` was not ignoring transaction. Fixes [Issue #845](https://github.com/newrelic/go-agent/issues/845).