Ray RLlib

Ray Train

Ray Datasets

RayDP

Retail

Gaming

Government

Financial

Ray Serve

Anyscale

Ray Core

Healthcare

Technology

News

User Story

Engineering

Culture

Anyscale Ray Team

In this blog post, we explore Harrison Chase insightful talk on "Building Context-Aware Reasoning Applications with LangChain and LangSmith" Read the recap and watch the full session.

top 20 bw-03

Building Context-Aware Reasoning Applications with LangChain and LangSmith

In this blog post, we explore Joseph Spisak's insightful talk on "Llama: Scaling Up LLMs in an Open Ecosystem." Read the recap and watch the full session.

top 20 ray session joseph spisak meta

Llama, Scaling Up LLMs in an Open Ecosystem

Yi Cheng

Cade Daniel

Chen Shen

Liguang Xie

In this post, we discuss the importance of speed when loading large language models and what techniques we employed to make it 20x faster. In particular, we use the Llama 2 series of models. We share how you can reduce latency and costs using the Anyscale platform.

loading llms 20x faster

Loading Llama-2 70b 20x faster with Anyscale Endpoints

Akshay Malik

Edward Oakes

Phi Nguyen

ray-serve-ga-blog

Ray Serve: Tackling the cost and complexity of serving AI in production

Learn how Ray Serve & Anyscale solves common challenges of serving AI in production - improving time to market, reducing cost, and ensuring reliability.

Tackling the Cost & Complexity of Serving AI in Production

Jules S. Damji

Richard Liaw

Richard Liaw headshot

ray 2-7 annoucement

Ray 2.7 features major stability improvements to Ray AI Libraries and KubeRay and introduces RayLLM

Stephanie Wang

Scott Lee

Cheng Su

Hao Chen

Eric Liang

Eric Liang headshot

Data loading & preprocessing can easily become the performance bottleneck in ML pipelines. With Ray Data, data loading can be fast, flexible and scalable.

featured image ml training with ray data

Fast, Flexible and Scalable Data Loading for ML Training

Fast, flexible, and scalable data loading for ML training with Ray Data

Yifei Feng

Sriram Sankar

Siddharth Venkatesh

Ameer Haj Ali

Discover how the Anyscale platform accelerates Gen AI & LLM app development, optimizes compute availability, reduces costs and more.

cloud infrastructure for llm and generative ai social

Cloud Infrastructure for LLM and Generative AI | Anyscale

Cloud Infrastructure for LLM and Generative AI Applications

Robert Nishihara

Joe Spisak

We are excited to announce collaboration between Meta and Anyscale to bolster the Llama ecosystem.

anyscale-meta

Anyscale and Meta Collaborate to Advance the Llama-2 Ecosystem

Artur Niederfahrenhorst

Kourosh Hakhamaneshi

Rehaan Ahmad

In this blog, we compare full-parameter fine-tuning with LoRA and answer questions around the strengths and weaknesses of the two techniques. 

lora blog 1

Fine-Tuning LLMs: In-Depth Analysis with LLAMA-2 | Anyscale

Fine-Tuning LLMs: LoRA or Full-Parameter? An in-depth Analysis with Llama 2

Vihan Lakshman

Pratik Pranav

Siddharth Jain

Tharun Medini

ThirdAI shares how to employ their BOLT framework along with Ray for distributed training of deep learning and foundational models using only CPUs.

training time vs number of nodes 1b

How ThirdAI uses Ray for Parallel Training of Billion-Parameter Neural Networks on Commodity CPUs

Waleed Kadous

factuality 373 examples

Llama 2 is about as factually accurate as GPT-4 for summaries and is 30 times cheaper

Using Anyscale Endpoints, we compared Llama 2 7b, 13b and 70b vs. OpenAI's GPT-3.5-turbo and GPT-4 for accuracy and cost.

Llama 2 vs. GPT-4: Nearly As Accurate and 30X Cheaper

Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper

Anyscale + Astronomer

Scalable Machine Learning with Anyscale and Astronomer

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog

Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.

All Posts

Building Context-Aware Reasoning Applications with LangChain and LangSmith

Llama, Scaling Up LLMs in an Open Ecosystem

Loading Llama-2 70b 20x faster with Anyscale Endpoints

Ray Serve: Tackling the cost and complexity of serving AI in production

Ray Serve: Tackling the cost and complexity of serving AI in production

Ray Serve: Tackling the cost and complexity of serving AI in production

Ray 2.7 features major stability improvements to Ray AI Libraries and KubeRay and introduces RayLLM

Fast, flexible, and scalable data loading for ML training with Ray Data

Fast, flexible, and scalable data loading for ML training with Ray Data

Cloud Infrastructure for LLM and Generative AI Applications

Anyscale and Meta Collaborate to Advance the Llama-2 Ecosystem

Fine-Tuning LLMs: LoRA or Full-Parameter? An in-depth Analysis with Llama 2

How ThirdAI uses Ray for Parallel Training of Billion-Parameter Neural Networks on Commodity CPUs

Llama 2 is about as factually accurate as GPT-4 for summaries and is 30 times cheaper

Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper