News

User Story

Engineering

Culture

Christy Bergman

Cheng Su

Embedding Inference at Scale for RAG Applications with Ray Data and Milvus

Scott Lee

Kyle Huang

Hao Chen

Generating embeddings is a critical task for developing successful RAG applications, and Anyscalew with Pinecone is the most cost-efficient solution for this workflow.

blog-anyscale-pincone

RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone

Stephanie Wang

Eric Liang

Eric Liang headshot

Data loading & preprocessing can easily become the performance bottleneck in ML pipelines. With Ray Data, data loading can be fast, flexible and scalable.

featured image ml training with ray data

Fast, Flexible and Scalable Data Loading for ML Training

Fast, flexible, and scalable data loading for ML training with Ray Data

This blog post delves into how Ray Data streaming works and how to use it for your own ML pipelines distributed across both CPU and GPU devices.

main_streaming_image

How to Stream Distributed Execution Across CPUs & GPUs

Streaming distributed execution across CPUs and GPUs

The Ray Summit 2025 CfP is now open for submissions. The premier AI conference will be held November 3-5 in San Francisco, and the due date for CfPs is June 30th, 2025.  

Ray Summit 2025 CFP Open

Ray Summit 2025: Call for Proposals Closes on June 30th, 2025

Google + Anyscale

Google Cloud Integrates Anyscale's RayTurbo with GKE

Simplifying AI Development at Scale: Google Cloud Integrates Anyscale's RayTurbo with GKE

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale

Featured Posts and News

Ray Summit 2025: Call for Proposals Closes on June 30th, 2025

Simplifying AI Development at Scale: Google Cloud Integrates Anyscale's RayTurbo with GKE

Ray Summit 2024: Breaking Through the AI Complexity Wall

Embedding Inference at Scale for RAG Applications with Ray Data and Milvus

Embedding Inference at Scale for RAG Applications with Ray Data and Milvus

RAG at Scale: 10x Cheaper Embedding Computations with Anyscale and Pinecone

Fast, flexible, and scalable data loading for ML training with Ray Data

Fast, flexible, and scalable data loading for ML training with Ray Data

Streaming distributed execution across CPUs and GPUs