Alauda AI
Alauda Build of InferNex Bridge

Pre-installation Configuration

Install Workbench

Configure Alauda AI Global Resources

Install Alauda AI

Tools Menu Configuration

Upgrade Alauda AI

Migrating to Knative Operator

Infrastructure Management

Hardware Profile

Hardware Profile Management

Create Hardware Profile using CLI

Schedule Workloads to Specific GPU Nodes

Creating CPU-Only and GPU-Accelerated Profiles

Device Management

About Alauda Build of Hami

About Alauda Build of NVIDIA GPU Device Plugin

Namespace Management

Create Workbench

Run Kubeflow Pipelines from JupyterLab with Elyra

Using Connections

Model Deployment & Inference

Inference Service

Inference Service

Create Inference Service using CLI

Extend Inference Runtimes

Using KServe Modelcar for Model Storage

Enable Expert Parallel for vLLM Inference Services

Configure External Access for Inference Services

Speculative Decoding for vLLM Inference Services

Configure Scaling for Inference Services

Scheduling Inference Services based on the CUDA version

Set Up Autoscaling for Inference Services with KEDA

Troubleshooting

Experiencing Inference Service Timeouts with MLServer Runtime

Inference Service Fails to Enter Running State

Model Management

Model Repository

Upload Models Using Notebook

Training Guides

Kubeflow Trainer Quick Start

Preemptible TrainJobs with Kueue, Checkpointing, and Inference Coexistence

Training Runtime Images

Fine-tuning LLMs with Training Hub

Fine-tuning LLMs using Workbench

Fine-tune and Pretrain LLMs on Ascend NPU

Monitoring & Ops

Features Overview

Logging & Tracing

Resource Monitoring

Resource Monitoring

Add a Monitoring Dashboard

Troubleshooting

Monitor Dashboard Stuck at Loading

Install Label Studio

LLM Compressor with Alauda AI

Alauda Build of KubeRay Operator

CodeFlare SDK Tutorial

Alauda Build of Kueue

Configuring quotas

Monitoring pending workloads

Configuring fair sharing

Gang scheduling

Integrate with Alauda DevOps Pipelines

Integrate with InferenceService

Manage Ascend NPU quota with Kueue

Alauda support for Volcano

Install Volcano

Alauda Build of KServe

Alauda Build of InferNex Bridge

Install InferNex Bridge

Alauda Build of Llama Stack

Install Llama Stack

agentic_mlops

Use Coding Agents with On-Premise Inference Services

Run MLOps with Coding Agents and On-Premise LLMs

Alauda Build of LeaderWorkerSet

Install LeaderWorkerSet

Evaluating RAG with Ragas

Alauda Build of JobSet

Alauda Build of TrustyAI

Install TrustyAI

AI Guardrails for LLM safety

NeMo Guardrails

TrustyAI Service (TAS)

Alauda Build of Envoy AI Gateway

Install Envoy AI Gateway

Authenticating Consumers

Configuring Token Quotas

Metering Token Usage

Routing to LLM Providers

Charging Back Token Usage

Alauda Build of Feast

Alauda support for Kubeflow

Install Kubeflow Operators

Upgrade Kubeflow Operators

how_to

Use Kubeflow Notebooks

Use Kubeflow Tensorboards

Use Kubeflow Volumes

Use Kubeflow Model Registry

MLflow Tracking Server

Use Kubeflow Pipelines

Kubernetes APIs

Inference Service APIs

ClusterServingRuntime [serving.kserve.io/v1alpha1]

InferenceService [serving.kserve.io/v1beta1]

Workspace Kind [kubeflow.org/v1beta1]

Workspace [kubeflow.org/v1beta1]

AmlNamespace [manage.aml.dev/v1alpha1]

AmlCluster [amlclusters.aml.dev/v1alpha1]

Architecture, Version and Components

Alauda Build of InferNex Bridge

Previous pageInstall KServe Next pageIntroduction