OpenAI API Local Model Server Compatibility

[allanbunch]

OpenAI API Compatibility

Node-RED OpenAI API node provides a seamless interface to local and remote AI systems and libraries that expose OpenAI compatible REST API endpoints. The following have been tested and provide various degrees of OpenAI API resource coverage. All provide chat/completions API functionality.

Compatible AI Platforms

Platform	Description	Use Case
⚡ Nitro	A fast, lightweight 3mb inference server to supercharge apps with local AI.	Nitro is a drop-in replacement for OpenAI's REST API
👋 Jan	Bringing AI to your Desktop	Open-source ChatGPT alternative that runs 100% offline on your computer.
LM Studio	Discover, download, and run local LLMs	Run LLMs on your laptop, entirely offline.
Text Generation Web UI	A Gradio web UI for Large Language Models.	Its goal is to become the AUTOMATIC1111/stable-diffusion-webui of text generation.
LiteLLM	An open-source library to simplify LLM completion + embedding calls.	Call 100+ LLMs using the same Input/Output Format
Ollama	Get up and running with large language models, locally.	Run Llama 2, Code Llama, and other models. Customize and create your own.
LocalAI	LocalAI is a free, Open Source OpenAI alternative.	LocalAI acts as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing.