News

User Story

Engineering

Culture

Cody Yu

Scott Lee

Ricky Xu

William Lin

Praveen Gorthy

Richard Liaw

Richard Liaw headshot

See how Anyscale reduces costs by up to 2.9x compared to online inference providers such AWS Bedrock and OpenAI, and up to 6x in shared prefix scenarios.

Untitled design (41)

Anyscale Batch LLM Inference Slashes Bedrock Costs Up to 6x

Batch LLM Inference on Anyscale slashes AWS Bedrock costs by up to 6x

Kyle Huang

Cheng Su

Hao Chen

Generating embeddings is a critical task for developing successful RAG applications, and Anyscalew with Pinecone is the most cost-efficient solution for this workflow.

blog-anyscale-pincone

RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone

Stephanie Wang

Eric Liang

Eric Liang headshot

Data loading & preprocessing can easily become the performance bottleneck in ML pipelines. With Ray Data, data loading can be fast, flexible and scalable.

featured image ml training with ray data

Fast, Flexible and Scalable Data Loading for ML Training

Fast, flexible, and scalable data loading for ML training with Ray Data

Anyscale + Astronomer

Scalable Machine Learning with Anyscale and Astronomer

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale

Featured Posts and News

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

Ray Summit 2024: Breaking Through the AI Complexity Wall

Anyscale’s New User Experience: A Comprehensive Overview

Batch LLM Inference on Anyscale slashes AWS Bedrock costs by up to 6x

RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone

Fast, flexible, and scalable data loading for ML training with Ray Data

Fast, flexible, and scalable data loading for ML training with Ray Data