Datadog LLM Observability Is Now Generally Available to Help Businesses Monitor, Improve and Secure Generative AI Applications
Datadog LLM Observability Is Now Generally Available to Help Businesses Monitor, Improve and Secure Generative AI Applications
New product helps companies like WHOOP and AppFolio monitor hallucinations, adopt LLMs and release generative AI features with confidence
新產品幫助WHOOP和AppFolio等公司監控幻覺，採用LLM並自信地發佈生成的AI功能。
NEW YORK, June 26, 2024 /PRNewswire/ -- Datadog, Inc. (NASDAQ: DDOG), the monitoring and security platform for cloud applications, today announced the general availability of LLM Observability, which allows AI application developers and machine learning (ML) engineers to efficiently monitor, improve and secure large language model (LLM) applications. With LLM Observability, companies can accelerate the deployment of generative AI applications to production environments and scale them reliably.
2024年6月26日，紐約 / PRNewswire / -- Datadog納斯達克：Datadog（NASDAQ：DDOG）今天宣佈，LLM Observability已普遍可用，該平台允許AI應用程序開發人員和機器學習（ML）工程師有效地監視、改進和保護大型語言模型（LLM）應用程序。通過LLM Observability，公司可以加速將生成的AI應用程序部署到生產環境並可靠地擴展它們。
Organizations across all industries are racing to release generative AI features in a cost-effective way, but implementing and bringing them to production can present several challenges due to the complexity of LLM chains, their non-deterministic nature and the security risks they pose.
各行各業的組織正在競相以一種具有成本效益的方式發佈生成的AI功能，但由於LLM鏈的複雜性、其非確定性以及它們造成的安全風險所帶來的挑戰，將它們實施並引入生產環境可能會出現若干困難。
Datadog LLM Observability helps customers overcome these challenges so they can confidently deploy and monitor their generative AI applications. This new product provides visibility into each step of the LLM chain to easily identify the root cause of errors and unexpected responses such as hallucinations. Users can also monitor operational metrics like latency and token usage to optimize performance and cost, and can evaluate the quality of their AI applications—such as topic relevance or toxicity—and gain insights to mitigate security and privacy risks with out-of-the-box quality and safety evaluations.
Datadog LLM Observability幫助客戶克服這些挑戰，從而使他們能夠自信地部署和監視他們的生成式AI應用程序。該產品提供了對LLM鏈的每一步的可見性，以便輕鬆地識別錯誤和意外響應，例如出現幻覺。用戶還可以監視操作指標，如延遲和令牌使用，以優化性能和成本，並評估其AI應用程序的質量，例如主題相關性或毒性，並獲得有關應對風險的安全和隱私的見解，並獲得出廠時質量和安全評估的OTB功能。
Unlike traditional tools and point solutions, Datadog's LLM Observability offers prompt and response clustering, seamless integration with Datadog Application Performance Monitoring (APM), and out-of-the-box evaluation and sensitive data scanning capabilities to enhance the performance, accuracy and security of generative AI applications while helping to keep data private and secure.
與傳統工具和點解的解決方案不同，Datadog的LLM Observability提供了快速響應聚類、與Datadog應用程序性能監視（APM）的無縫集成以及OTB評估和敏感數據掃描功能，以增強生成式AI應用程序的性能、準確性和安全性，同時有助於保持數據的私密性和安全性。
"WHOOP Coach is powered by the latest and greatest in LLM AI. Datadog's LLM Observability allows our engineering teams to evaluate performance of model changes, monitor production performance and increase quality of Coach interactions. LLM Observability allows WHOOP to provide and maintain coaching for all our members 24/7," said Bobby Johansen, Senior Director Software at WHOOP.
“WHOOP教練由最新和最好的LLM AI提供支持。Datadog的LLM Observability使我們的工程團隊能夠評估模型變化的性能，監視生產性能並提高Coach交互的質量。LLM Observability允許WHOOP爲我們所有的會員提供並保持24/7的輔導，”WHOOP的高級軟件總監Bobby Johansen表示。
"The Datadog LLM Observability solution helps our team understand, debug and evaluate the usage and performance of our GenAI applications. With it, we are able to address real-world issues, including monitoring response quality to prevent negative interactions and performance degradations, while ensuring we are providing our end users with positive experiences," said Kyle Triplett, VP of Product at AppFolio.
“Datadog的LLM Observability解決方案幫助我們的團隊了解、調試和評估我們的GenAI應用程序的使用和性能。有了它，我們可以解決現實問題，包括監控響應質量以防止負面互動和性能下降，同時確保我們爲最終用戶提供積極的體驗，”AppFolio的產品副總裁Kyle Triplett表示。
"There's a rush to adopt new LLM-based technologies, but organizations of all sizes and industries are finding it difficult to do so in a way that is both cost effective and doesn't negatively impact the end user experience," said Yrieix Garnier, VP of Product at Datadog. "Datadog LLM Observability provides the deep visibility needed to help teams manage and understand performance, detect drifts or biases, and resolve issues before they have a significant impact on the business or end-user experience."
“人們正在搶先採用基於LLM的新技術，但各種規模和行業的組織發現難以以既具有成本效益又不會對最終用戶體驗產生負面影響的方式這樣做，”Datadog的產品VP Yrieix Garnier表示。“Datadog的LLM Observability提供了深入的可見性，以幫助團隊管理和了解性能、檢測漂移或偏見，並在對業務或最終用戶體驗產生重大影響之前解決問題。”
LLM Observability helps organizations:
LLM Observability可幫助組織：
- Evaluate Inference Quality: Visualize the quality and effectiveness of LLM applications' conversations—such as failure to answer—to monitor any hallucinations, drifts and the overall experience of the apps' end users.
- Identify Root Causes: Quickly pinpoint the root cause of errors and failures in the LLM chain with full visibility into end-to-end traces for each user request.
- Improve Costs and Performance: Efficiently monitor key operational metrics for applications across all major platforms—including OpenAI, Anthropic, Azure OpenAI, Amazon Bedrock, Vertex AI and more—in a unified dashboard to uncover opportunities for performance and cost optimization.
- Protect Against Security Threats: Safeguard applications against prompt hacking and help prevent leaks of sensitive data, such as PII, emails and IP addresses, using built-in security and privacy scanners powered by Datadog Sensitive Data Scanner.
- 評估推斷質量：可視化LLM應用程序對話的質量和效果——例如無法回答——以監視幻覺、漂移和應用程序最終用戶的整體體驗。
- 識別根本原因：快速定位LLM鏈中錯誤和故障的根本原因，爲每個用戶請求提供端到端跟蹤的完全可見性。
- 提高成本和性能：在一個統一的儀表板上高效地監視各種主要平台上的應用程序（包括OpenAI、Anthropic、Azure OpenAI、Amazon Bedrock、Vertex AI等）的關鍵操作指標，以發現性能和成本優化的機會。
- 保護免受安全威脅：利用內置的安全和隱私掃描器（由Datadog敏感數據掃描器提供支持）保護應用程序免受提示性黑客攻擊，並幫助防止敏感數據（如PII、電子郵件和IP地址）泄漏。Datadog敏感數據掃描器.
Datadog LLM Observability is generally available now. To learn more, please visit: http://datadoghq.com/product/llm-observability.
Datadog LLM Observability現已普遍可用。欲了解更多信息，請訪問：http://datadoghq.com/product/llm-observability.
About Datadog
關於Datadog
Datadog is the observability and security platform for cloud applications. Our SaaS platform integrates and automates infrastructure monitoring, application performance monitoring, log management, user experience monitoring, cloud security and many other capabilities to provide unified, real-time observability and security for our customers' entire technology stack. Datadog is used by organizations of all sizes and across a wide range of industries to enable digital transformation and cloud migration, drive collaboration among development, operations, security and business teams, accelerate time to market for applications, reduce time to problem resolution, secure applications and infrastructure, understand user behavior and track key business metrics.
Datadog是面向雲應用的可觀測性和安全性平台。我們的SaaS平台集成和自動化基礎設施監控，應用程序性能監控，日誌管理，用戶體驗監控，雲安全和許多其他功能，爲我們的客戶的整個技術棧提供統一的實時可觀測性和安全性。 Datadog被各種規模的組織和多個行業使用，以實現數字轉型和雲遷移，在開發，運營，安全和業務團隊之間促進合作，在應用程序上市時間上加快速度，減少故障解決時間，並確保應用程序和基礎架構的安全，了解用戶行爲並跟蹤關鍵業務指標。
Forward-Looking Statements
前瞻性聲明
This press release may include certain "forward-looking statements" within the meaning of Section 27A of the Securities Act of 1933, as amended, or the Securities Act, and Section 21E of the Securities Exchange Act of 1934, as amended including statements on the benefits of new products and features. These forward-looking statements reflect our current views about our plans, intentions, expectations, strategies and prospects, which are based on the information currently available to us and on assumptions we have made. Actual results may differ materially from those described in the forward-looking statements and are subject to a variety of assumptions, uncertainties, risks and factors that are beyond our control, including those risks detailed under the caption "Risk Factors" and elsewhere in our Securities and Exchange Commission filings and reports, including the Quarterly Report on Form 10-Q filed with the Securities and Exchange Commission on November 7, 2023, as well as future filings and reports by us. Except as required by law, we undertake no duty or obligation to update any forward-looking statements contained in this release as a result of new information, future events, changes in expectations or otherwise.
本新聞稿可能包括某些根據1933年修訂版的《證券法》或《證券法》第27A條以及1934年修訂版的《證券交易法》或《證券交易法》第21E條的“前瞻性聲明”，包括有關新產品和功能的好處的聲明。這些前瞻性聲明反映了我們針對我們的計劃，意圖，期望，策略和前景的當前觀點，這些觀點基於我們目前擁有的信息和我們所做的假設。實際結果可能與前瞻性聲明中描述的結果有所不同，並且受到一系列假設，不確定性，風險和因素的影響，這些因素超出了我們的控制範圍，包括在我們的證券交易委員會文件和報告中的“風險因素”和其他地方所詳細描述的風險，包括在2023年11月7日向證券交易委員會提交的《第10-Q表格季度報告》以及我們今後提交的文件和報告。除法律要求外，我們不承擔更新本發佈中包含的任何前瞻性聲明的責任或義務，也不承擔因新信息，未來事件，期望變化或其他原因導致的責任或義務。
Contact
Dan Haggerty
press@datadoghq.com
聯繫人
丹·哈格蒂
press@datadoghq.com
View original content to download multimedia:https://www.prnewswire.com/news-releases/datadog-llm-observability-is-now-generally-available-to-help-businesses-monitor-improve-and-secure-generative-ai-applications-302182343.html
查看下載多媒體原始內容：datadog發佈可觀測性功能，幫助企業監測、改進和保障人工智能應用程序的安全性。
SOURCE Datadog, Inc.
資料來源：Datadog，Inc。
譯文內容由第三人軟體翻譯。