
Open-source hybrid edge-cloud AI inference engine for mobile devices and wearables.
Cactus Engine is a cross-platform, open-source inference engine that runs speech, vision, and text models locally on smartphones, laptops, and wearables. It uses hardware-specific acceleration, quantization, and zero-copy memory mapping to minimize latency and RAM usage, with a hybrid router that hands complex requests off to cloud models.
The engine exposes OpenAI-compatible APIs and ships with bindings for Python, React Native, Swift, Kotlin, Flutter, and C++, allowing developers to add on-device AI to existing mobile and edge applications.


Meta's on-device machine-learning runtime for mobile and edge devices.

Apple's machine-learning framework for Apple silicon devices.



Kneron's Edge AI Platform delivers on-device NPUs and full-stack software for edge inference.


ONNX Runtime is a cross-platform inference and training accelerator for machine-learning models.


Cloudflare AI: serverless inference, agents, RAG, and secure runtime primitives on the global edge.


Edge software that runs AI models locally for real-time decisions, including offline.



Unified production inference platform with gateway, router, cache, observability, evaluation, fine-tuning, and custom GPU hosting.


Baseten Inference Stack for high performance with custom kernels, decoding, caching on optimized infra.


Pipeshift's platform provides infrastructure for fine-tuning, inference, and orchestration of open-source AI models.


A plug-and-play local AI inference computer with a pre-installed open-source engine and tuned models.


Crusoe Managed Inference deploys and scales production LLM workloads with breakthrough speed and throughput.


Open-source inference serving platform for deploying AI models from any framework on CPUs and GPUs.


Baseten Dedicated Inference is a high-performance inference platform for deploying, serving, and scaling custom and open-source AI models in production.


Inference Neocloud delivers dedicated ASIC racks for high-speed AI inference workloads.


IonRouter is a high-throughput, low-cost inference API and drop-in OpenRouter alternative powered by Cumulus Labs' IonAttention engine.


AI inference platform delivering serverless and dedicated GPU inference with top-ranked speed and price-performance.




An integrated compute, training, inference, and sandbox stack for enterprises to train and deploy their own AI models.
Kneron's Edge AI Platform delivers on-device NPUs and full-stack software for edge inference.

ONNX Runtime is a cross-platform inference and training accelerator for machine-learning models.

Cloudflare AI: serverless inference, agents, RAG, and secure runtime primitives on the global edge.

Edge software that runs AI models locally for real-time decisions, including offline.

High-performance deep learning inference SDK for optimizing trained models on NVIDIA GPUs.

Unified production inference platform with gateway, router, cache, observability, evaluation, fine-tuning, and custom GPU hosting.

Baseten Inference Stack for high performance with custom kernels, decoding, caching on optimized infra.

Pipeshift's platform provides infrastructure for fine-tuning, inference, and orchestration of open-source AI models.

A plug-and-play local AI inference computer with a pre-installed open-source engine and tuned models.

Crusoe Managed Inference deploys and scales production LLM workloads with breakthrough speed and throughput.

Open-source inference serving platform for deploying AI models from any framework on CPUs and GPUs.

Baseten Dedicated Inference is a high-performance inference platform for deploying, serving, and scaling custom and open-source AI models in production.

Inference Neocloud delivers dedicated ASIC racks for high-speed AI inference workloads.

IonRouter is a high-throughput, low-cost inference API and drop-in OpenRouter alternative powered by Cumulus Labs' IonAttention engine.

AI inference platform delivering serverless and dedicated GPU inference with top-ranked speed and price-performance.

Hailo-10H is an edge AI accelerator for generative AI inference on devices rather than in the cloud.

Custom AI model builder for enterprise infrastructure.

An integrated compute, training, inference, and sandbox stack for enterprises to train and deploy their own AI models.
