News

User Story

Engineering

Culture

Akshay Malik

Praveen Gorthy

Richard Liaw

Richard Liaw headshot

Explore RayTurbo, Anyscale's optimized Ray runtime. Best price-performance and developer capabilities for AI workloads, built by the team that built Ray.

Screenshot 2024-09-27 at 12.12.40 PM

Announcing RayTurbo

Matt Connor

Cindy Zhang

image6

Solve resource fragmentation with Anyscale's new Replica Compaction feature.  Easily optimize resource usage for online inference replication.

Anyscale’s New Replica Compaction

Introducing Anyscale’s New Replica Compaction

Deploy Ray Serve with up to 50% fewer nodes using Anyscale Replica Compaction

Neelay Shah

Anyscale is teaming with NVIDIA to combine the developer productivity of Ray Serve and RayLLM with the cutting-edge optimizations from NVIDIA Triton Inference Server software and the NVIDIA TensorRT-LLM library.

NVIDIA-Anyscale Logo 1280x680.jpg

Low-latency Generative AI Model Serving with Ray, NVIDIA Triton Inference Server, and NVIDIA TensorRT-LLM

Edward Oakes

Phi Nguyen

ray-serve-ga-blog

Ray Serve: Tackling the cost and complexity of serving AI in production

Learn how Ray Serve & Anyscale solves common challenges of serving AI in production - improving time to market, reducing cost, and ensuring reliability.

Tackling the Cost & Complexity of Serving AI in Production

Anyscale + Astronomer

Scalable Machine Learning with Anyscale and Astronomer

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

Anyscale

Featured Posts and News

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

Ray Summit 2024: Breaking Through the AI Complexity Wall

Anyscale’s New User Experience: A Comprehensive Overview

Announcing RayTurbo

Deploy Ray Serve with up to 50% fewer nodes using Anyscale Replica Compaction

Low-latency Generative AI Model Serving with Ray, NVIDIA Triton Inference Server, and NVIDIA TensorRT-LLM

Ray Serve: Tackling the cost and complexity of serving AI in production

Ray Serve: Tackling the cost and complexity of serving AI in production

Ray Serve: Tackling the cost and complexity of serving AI in production