Actu
New Relic Announces the Launch of Industry’s First OpenAI GPT Observability Integration
March 2023 by Marc Jacob
New Relic, the all-in-one observability platform, has announced a first-of-its-kind machine learning operations (MLOps) capability that allows engineering teams to monitor applications built with OpenAI’s GPT Series APIs. With just two lines of code, engineering teams can monitor OpenAI completion queries while simultaneously tracking performance and cost metrics in real-time in a single view with New Relic. This new integration allows New Relic to ingest raw OpenAI data and helps companies leverage the power of emerging AI technologies like OpenAI’s ChatGPT to accelerate innovation and business goals while balancing considerations to cost. This integration expands New Relic’s catalog of supported data and extends New Relic’s access to a wider audience of developers. Engineers can quickly deploy the OpenAI quickstart from New Relic Instant Observability and access this capability for free with no credit card required and minimal setup by signing up for a forever free New Relic account.
Companies around the world are embracing GPT to power help desk tickets and live chat logs, develop content and images, and accelerate semantic searches. New Relic monitoring for OpenAI is fast, easy to use, and unlocks real-time metrics that can help engineering teams optimize usage, reduce costs, and achieve better results. The new capability allows engineers to:
1. Get started for free: Access to New Relic Instant Observability and our out-of-the-box GPT monitoring solution is the first of its kind, and included at no additional cost for New Relic full platform users.
2. Easy installation: With just two lines of code, users can import the monitor module from the nr_openai_monitor library and automatically generate a dashboard that displays a variety of key GPT performance metrics.
3. Monitor cost: Usage of OpenAI’s Davinci model costs can add up quickly and make it difficult to operate at scale. New Relic provides engineering teams with real-time cost tracking of their GPT usage.
4. Optimize performance: New Relic gives engineering teams insight into the average response time and other key performance metrics around GPT requests, allowing engineers to optimize usage and ensure the best possible response times.
5. Analyze prompts and responses: New Relic provides valuable information about the usage, speed, and effectiveness of GPT to help engineering teams achieve better results from their ML models.
The OpenAI GPT integration with New Relic is included at no additional cost to New Relic full platform users. New Relic supports all current OpenAI GPT versions including the recently released GPT-4.
