share_log

Nebius AI Studio: a High-performing Inference-as-a-Service Platform Recognized for Cost Efficiency

Nebius AI Studio: a High-performing Inference-as-a-Service Platform Recognized for Cost Efficiency

Nebius人工智能工作室:一個以高性能爲特點、因成本效益而得到認可的推理即服務平台
PR Newswire ·  2024/11/28 05:00

AMSTERDAM, Nov. 28, 2024 /PRNewswire/ -- Nebius's recently launched Nebius AI Studio has been recognized as one of the most competitive Inference-as-a-Service offerings on the market by leading independent analytics provider Artificial Analysis.

阿姆斯特丹,2024年11月28日 /PRNewswire/ -- Nebius最近推出的Nebius AI Studio被領先的獨立分析提供商人工分析認可爲市場上最具競爭力的推理即服務產品之一。

Picture 1
圖片 1

Nebius AI Studio offers app builders access to an extensive and constantly growing library of leading open-source models – including the Llama 3.1 and Mistral families, Nemo, Qwen, and Llama OpenbioLLM, as well as upcoming text-to-image and text-to-video models – with per - token pricing, enabling the creation of fast, low-latency applications at an affordable price.

Nebius AI Studio爲應用程序構建者提供訪問廣泛且不斷增長的領先開源模型庫的權限,包括Llama 3.1和Mistral系列、Nemo、Qwen和Llama OpenbioLLM, 以及即將推出的文本轉圖像和文本轉視頻模型——以按令牌定價,使得能夠以實惠的價格創建快速、低延遲的應用程序。

Artificial Analysis assessed key metrics including quality, speed, and price across all endpoints on the Nebius Studio AI platform. The results revealed that the open-source models available on Nebius AI Studio deliver one of the most competitive offerings in the market, with the Llama 3.1 Nemotron 70B and Qwen 2.5 72B models in the most attractive quadrant of the Output Speed vs. Price chart.

人工分析評估了Nebius Studio AI平台上所有終端的關鍵指標,包括質量、速度和價格。結果表明,Nebius AI Studio上可用的開源模型在市場上提供了最具競爭力的產品之一,其中Llama 3.1 Nemotron 700億和Qwen 2.5 720億模型位於輸出速度與價格圖表的最具吸引力的象限。

Photo -

照片 -

Source:

來源:

Roman Chernin, co-founder and Chief Business Officer at Nebius, said:

Nebius聯合創始人兼首席業務官Roman Chernin表示:

"Nebius AI Studio represents the logical next step in expanding Nebius's offering to service the explosive growth of the global AI industry.

"Nebius AI Studio代表了Nebius在擴展其服務以滿足全球人工智能行業爆炸性增長的邏輯下一步。

Our approach is unique because it combines our robust infrastructure and powerful GPU capabilities. The vertical integration of our inference-as-a-service offering on top of our full-stack AI infrastructure ensures seamless performance and enables us to offer optimized, high-performance services across all aspects of our platform. The results confirmed by Artificial Analysis's benchmarking are a testament to our commitment to delivering a competitive offering in terms of both price and performance, setting us apart in the market."

我們的做法獨特,因爲它結合了我們強大的基礎設施和強大的gpu芯片-雲計算能力。我們的推理即服務產品在我們全棧人工智能基礎設施之上的垂直整合確保了無縫性能,使我們能夠在平台的各個方面提供優化的高性能服務。人工分析的基準測試證實的結果證明了我們在價格和性能方面提供具有競爭力的服務的承諾,使我們在市場上脫穎而出。"

Artificial Analysis evaluates the end-to-end performance of LLM inference services such as Nebius AI Studio on the real-world experience of customers to provide benchmarks for AI model users. Nebius' endpoints are hosted in data centers located in Finland and Paris. The company is also building its first GPU cluster in the U.S and adding offices nationwide to serve customers across the country.

人工分析評估Nebius AI Studio等LLm推理服務的端到端性能,基於客戶的實際體驗提供人工智能模型用戶的基準。Nebius的端點託管在芬蘭和巴黎的數據中心。該公司還在美國建立其第一個gpu芯片-雲計算集群,並在全國範圍內增設辦公室,以服務全國的客戶。.喬治·卡梅倫,人工分析的聯合創始人

George Cameron, co-founder of Artificial Analysis, added:

George Cameron,人工智能分析的聯合創始人, 添加:

"In our independent benchmarks of Nebius' endpoints, results show they are amongst the most competitive in terms of price. In particular, Nebius is offering Llama 3.1 405B, Meta's leading model, at $1/M input tokens and $3/M output tokens, making it one of the most affordable endpoints for accessing a frontier model."

"在我們的獨立基準測試中,Nebius 的端點顯示其價格具備市場競爭力。特別是,Nebius 提供 Llama 3.1,總計4050億,Meta 的領先模型,輸入令牌定價爲每百萬 $1,輸出令牌爲每百萬 $3,使其成爲訪問前沿模型的最具性價比的端點之一。"

Nebius AI Studio unlocks a broad spectrum of possibilities, offering flexibility for customers and partners across industries, from healthcare to entertainment and design. Its versatile capabilities empower diverse GenAI builders to tailor solutions that meet the needs of each sector in the market.

Nebius AI Studio 解鎖了廣泛的可能性,爲各行各業的客戶和合作夥伴提供靈活性,從醫療保健到娛樂和設計。其多功能能力使各種GenAI開發者能夠定製滿足市場上各個行業需求的解決方案。

Key features of Nebius AI Studio include:

Nebius AI Studio 的主要特點包括:

  • Higher value at a competitive price. The platform's pricing is up to 50% lower than other big-name providers, offering unparalleled cost-efficiency for GenAI builders
  • Batch inference processing power: the platform enables processing of up to 5 million requests per file - a hundred-fold increase over industry norms- while supporting massive file sizes up to 10 GB. Gen AI app builders are equipped to process entire datasets with support for 500 files per user simultaneously for large scale AI operations.
  • Open source model access: Nebius AI Studio supports a wide range of cutting-edge open-source AI models including the Llama and Mistral families, as well as specialist LLMs such as OpenbioLLM. Nebius' flagship hosted model, Meta's Llama-3.1-405B, offers performance comparable to GPT-4 at far lower cost.
  • High rate limits: Nebius AI Studio offers up to 10 million tokens per minute (TPM), with additional headroom for scaling based on workload demands. This robust throughput capacity ensures consistent performance, even during peak demand, allowing AI builders to handle large volumes of real-time predictions with ease and efficiency.
  • User friendly interface: The Playground side- by- side comparison feature allows builders to test and compare different models without writing code, view APIs code to achieve seamless integration, and adjust generation parameters to fine-tune outputs
  • Dual-flavor approach: Nebius AI Studio offers a dual-flavor approach for optimizing performance and cost. The fast flavor delivers blazing speed for real-time applications, while the base flavor maximizes cost-efficiency for less time-sensitive tasks.
  • 以具有競爭力的價格提供更高的價值。該平台的定價比其他知名供應商低50%,爲GenAI開發者提供無與倫比的成本效率。
  • 批量推理處理能力:該平台支持每個文件處理高達500萬請求。 - 與行業標準相比,增長了百倍- 同時支持高達10 Gb的大文件。人工智能應用開發者能夠處理整個數據集,同時支持每個用戶500個文件,以便進行大規模的人工智能操作。
  • 開源模型訪問:Nebius AI Studio支持衆多尖端的開源人工智能模型,包括Llama和Mistral系列,以及專業的LLM,如OpenbioLLm。Nebius的旗艦託管模型,Meta的Llama-31-4050億,提供了與GPt-4相當的性能,且成本更低。
  • 高速率限制:Nebius AI Studio提供每分鐘高達1000萬tokens的吞吐量,並根據工作負載需求提供額外的擴展空間。這種強大的吞吐能力確保了一致的性能,即使在高峰需求期間,也允許人工智能開發者輕鬆高效地處理大量實時預測。
  • 用戶友好的界面:遊樂場側-- 側邊比較功能允許構建者測試和比較不同的模型而無需編寫代碼,查看API代碼以實現無縫集成, 調整生成參數以微調輸出
  • 雙重風味方法:Nebius AI Studio提供一種雙重風味的方法來優化性能和成本。快速風味爲實時應用提供驚人的速度,而基礎風味爲不那麼時間敏感的任務最大化成本效率。

For more information, please visit our blog:

欲了解更多信息,請訪問我們的博客:

Introducing Nebius AI Studio: Achieve fast, flexible inference today.

介紹Nebius AI Studio:今天就實現快速,靈活的推斷。

About Nebius

關於Nebius

Nebius (NASDAQ: NBIS) is a technology company building full-stack infrastructure to service the explosive growth of the global AI industry, including large-scale GPU clusters, cloud platforms, and tools and services for developers. Headquartered in Amsterdam and listed on Nasdaq, the company has a global footprint with R&D hubs across Europe, North America and Israel.

Nebius(納斯達克:NBIS)是一家科技公司,構建全棧基礎設施以服務全球人工智能行業的爆炸性增長,包括大規模gpu芯片-雲計算集群、雲平台,以及爲開發者提供的工具和服務。該公司總部位於阿姆斯特丹,並在納斯達克上市,擁有全球業務,研發中心遍佈歐洲、北美和以色列。

Nebius's core business is an AI-centric cloud platform built for intensive AI workloads. With proprietary cloud software architecture and hardware designed in-house (including servers, racks and data center design), Nebius gives AI builders the compute, storage, managed services and tools they need to build, tune and run their models.

Nebius的核心業務是爲密集型人工智能工作負載打造的AI爲中心的雲平台。憑藉自有的雲軟件架構和內部設計的硬件(包括服務器、機櫃和數據中心設計),Nebius爲AI構建者提供了他們構建、調整和運行模型所需的計算、存儲、託管服務和工具。

A Preferred cloud service provider in the NVIDIA Partner Network, Nebius offers high-end infrastructure optimized for AI training and inference. The company boasts a team of over 500 skilled engineers, delivering a true hyperscale cloud experience tailored for AI builders.

作爲英偉達合作伙伴網絡中的首選雲服務提供商,Nebius提供經過優化的高端基礎設施,以支持人工智能的訓練和推理。該公司擁有超過500名技術精湛的工程師團隊,提供真正的超大規模雲體驗,專爲人工智能開發者量身定製。

To learn more please visit

要了解更多信息,請訪問

About Artificial Analysis

關於人工分析

Artificial Analysis is an independent analysis company for AI models and API providers.

人工分析是一家獨立的人工智能模型和API提供商的分析公司。

Artificial Analysis provides objective benchmarks and information to support developers, customers, researchers, and other users of AI models to make informed decisions in choosing the best AI models for their use case.

人工分析提供客觀基準和信息,以支持開發者、客戶、研究人員和其他用戶數在選擇適合其使用案例的最佳人工智能模型時做出明智決策。

Logo -

標誌 -

SOURCE Nebius

資訊 Nebius

WANT YOUR COMPANY'S NEWS FEATURED ON PRNEWSWIRE.COM?

想要您公司的新聞在PRNEWSWIRE.COM上特色呈現嗎?

440k+
440k+

Newsrooms &
新聞發佈室&

Influencers
影響力人士
9k+
9k+

Digital Media
數字媒體

Outlets
Outlets
270k+
270k+

Journalists
記者

Opted In
Opted In
GET STARTED
開始使用

譯文內容由第三人軟體翻譯。


以上內容僅用作資訊或教育之目的,不構成與富途相關的任何投資建議。富途竭力但無法保證上述全部內容的真實性、準確性和原創性。
    搶先評論