News

User Story

Engineering

Culture

Waleed Kadous

Jun Gong

Antoni Baum

Richard Liaw

Richard Liaw headshot

In part 4 of our Generative AI series, we share how to build a system for fine-tuning & serving LLMs in 40 minutes or less.

fine-tune-stack

How to Fine-Tune a 6 Billion Parameter LLM for Less Than $7

How to fine tune and serve LLMs simply, quickly and cost effectively using Ray + DeepSpeed + HuggingFace

Jiao Dong

Hao Zhang

Lianmin Zheng

Jules S. Damji

Phi Nguyen

In part 2 of our generative AI blog series, we cover how Ray empowers large language models (LLM) frameworks such as Alpa.

Figure 5: Technical integration layered stack for LLM


Figure-5

High-Performance LLM Training at 1000 GPU Scale With Alpa & Ray

Training 175B Parameter Language Models at 1000 GPU scale with Alpa and Ray

Eric Liang

Eric Liang headshot

Kai Fricke

Learn the infrastructure challenges for supporting workloads production deployments around foundation models, and how Ray tackles these challenges.

layered-stack

How Ray Solves Generative AI & LLM Infrastructure Challenges

How Ray solves common production challenges for generative AI infrastructure

Avnish Narayan

Christy Bergman

raysummit-blog-image

blog-recommended-content-ray-summit-2022

Reinforcement learning sessions at Ray Summit: A guided tour

Anyscale + Astronomer

Scalable Machine Learning with Anyscale and Astronomer

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale