News

User Story

Engineering

Culture

Endpoints Team

Anyscale Endpoints is the first LLM APIs providing a wide range of capabilities to empower developers to build their applications not just from serving and fine tuning LLMs, but also leveraging embedding services and function calling.

anyscale-endpoints-llama-and-orca

Anyscale Endpoints: JSON Mode, Function calling, New models: Llama Guard and Mistral-7B-OpenOrca

JSON Mode and Function calling Features

Anyscale Endpoints: JSON Mode and Function calling Features

Portkey and Anyscale Endpoints, when used in combination, offer a comprehensive LLMOps stack for developing AI applications with open-source Large Language Models (LLMs).

portkey-and-anyscale

Portkey ♥️ Anyscale Endpoints

Anyscale + Astronomer

Scalable Machine Learning with Anyscale and Astronomer

Unlocking the Power of Scalable Machine Learning with Anyscale and Astronomer

At Ray Summit 2024, we brought together AI experts and practitioners to dive into the future of distributed AI and scalable machine learning.

image3

Ray Summit 2024: Breaking Through the AI Complexity Wall

Explore the new and improved Anyscale Workspaces. Get advanced observability features so you spend less time on busywork and more time building AI apps.

Anyscale Share Image

Explore Anyscale’s New UX

Anyscale’s New User Experience: A Comprehensive Overview

With Anyscale on AWS Marketplace, you can build, scale, and optimize AI/ML and Generative AI—all within the trusted AWS cloud environment.

Group 491 (1)

Anyscale Available on AWS Marketplace

Anyscale Now Available on AWS Marketplace and Achieves Generative AI Competency

This section is used to order the "Types" and "Tags" that show up for filters on the Blog Index

Types

Products / Libraries

Blog