AI Blueprint Microservices With Ray
Deploys a live Ray cluster across Cloudera AI Applications, offering a unified REST API to deploy, scale, and monitor distributed inference workloads—from vLLM/SGLang LLMs and LiteLLM gateways to YOLO vision models, MCP tool servers, and custom Ray Serve apps.
What is this resource?
Deploys a live Ray cluster across Cloudera AI Applications, offering a unified REST API to deploy, scale, and monitor distributed inference workloads—from vLLM/SGLang LLMs and LiteLLM gateways to YOLO vision models, MCP tool servers, and custom Ray Serve apps.
Review the original project for installation steps, licenses, compatibility and updates. This directory provides discovery links, not downloadable or verified code.
Safety & attribution
This is an external resource, not independently security-audited by this directory. Inspect permissions, scripts and changes before using it with your files or accounts.