News

User Story

Engineering

Culture

Amog Kamsetty

Hao Chen

Liguang Xie

ByteDance, the company behind Tiktok, leverages multi-modal models to enable many applications, such as text-based image retrieval or object detection.

bytedance-actor-pool

How ByteDance Scales Offline Inference with Multi-Modal LLMs

How ByteDance Scales Offline Inference with multi-modal LLMs to 200 TB Data

Jerry Liu

llamaindex-img-2

Build and Scale a Powerful Query Engine with LlamaIndex and Ray

In this blog, we showcase how you can use LlamaIndex and Ray to build a query engine to answer questions and generate insights about Ray itself.

llamaindex-img-3

Build and Scale a Powerful Query Engine with LlamaIndex & Ray

Eric Liang

Eric Liang headshot

Jules S. Damji

We conduct a comparison of three different solutions for offline batch inference: AWS SageMaker Batch Transform, Apache Spark, and Ray Data.

Figure 1. Throughput difference among three different solutions for 10GB batch inference


Figure 1

Offline Batch Inference | Ray, Apache Spark & SageMaker

Offline Batch Inference: Comparing Ray, Apache Spark, and SageMaker

Philipp Moritz

In part 2 of this blog series, we show you how to turbocharge embeddings in LLM workflows using LangChain and Ray Data.

Embedding - Stages of our Data Pipeline

Turbocharge LangChain: Guide to 20x Faster Embedding

Turbocharge LangChain: guide to 20x faster embedding

Matthew Deng

Richard Liaw

Richard Liaw headshot

Will Drevo

Ray Train

Distributed Deep Learning with Ray Train is Now In Beta

Distributed deep learning with Ray Train is now in Beta

Christy Bergman

Displaying [New York City Yellow Taxi](https://www1.nyc.gov/site/tlc/about/tlc-trip-record-data.page) ride volumes, with 1 week hourly forecast.  Blue=observed, Orange=predicted, per validation dataset.  Forecast generated using Google’s Temporal Fusion Transformer algorithm implemented by Pytorch forecasting, and parallelized by Ray for faster runtime, either on a laptop or on any cloud.  Image by Author.  

forecasting blog 2 of 2 image 1

Time Series Forecasting using an LSTM version of RNN with PyTorch Forecasting and Torch Lightning

Ray Lightning

Introducing Ray Lightning: Multi-node PyTorch Lightning training made easy

Kai Fricke

XGBoost-Ray

Introducing Distributed XGBoost Training with Ray

Retrieval Augmented Generation with Huggingface Transformers and Ray

Archit Kulkarni

Ray x mlflow

Ray & MLflow | Taking Distributed ML Apps to Production

Ray & MLflow: Taking Distributed Machine Learning Applications to Production

Jack Parker-Holder

Pb2: Solo Gif

Population Based Bandits: Provably Efficient Online Hyperparameter Optimization

Anyscale + Astronomer

Scalable Machine Learning with Anyscale and Astronomer

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale

Featured Posts and News

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

Ray Summit 2024: Breaking Through the AI Complexity Wall

Anyscale’s New User Experience: A Comprehensive Overview

How ByteDance Scales Offline Inference with multi-modal LLMs to 200 TB Data

Build and Scale a Powerful Query Engine with LlamaIndex and Ray

Build and Scale a Powerful Query Engine with LlamaIndex and Ray

Offline Batch Inference: Comparing Ray, Apache Spark, and SageMaker

Turbocharge LangChain: guide to 20x faster embedding

Distributed deep learning with Ray Train is now in Beta

Time Series Forecasting using an LSTM version of RNN with PyTorch Forecasting and Torch Lightning

Introducing Ray Lightning: Multi-node PyTorch Lightning training made easy

Introducing Distributed XGBoost Training with Ray

Retrieval Augmented Generation with Huggingface Transformers and Ray

Ray & MLflow: Taking Distributed Machine Learning Applications to Production

Population Based Bandits: Provably Efficient Online Hyperparameter Optimization