Awesome ML & GenAI in Elixir

A curated list of Machine Learning (ML) and Generative AI (GenAI) packages and resources for the Elixir programming language.

Besides giving an overview for experienced Elixir developers, this list can be useful for ML and AI practitioners looking for other ecosystems.

Contents

• Core Tools
• Machine Learning
  • Traditional Machine Learning
  • Deep Learning
• Generative AI
  • LLM Tools
  • Agent Frameworks
  • Development Tools
• Livebooks & Examples
• Resources

Core Tools

• Nx - Tensors for Elixir with compilation to CPU/GPU. It is the base for a lot of other libraries.
• Explorer - Series and dataframes for data exploration in Elixir.
• Livebook - Write interactive and collaborative notebooks, with integrations to databases, messaging, visualization and more.
• Kino - Render rich and interactive output. Used in Livebook.

Machine Learning

Traditional Machine Learning

• Scholar - Traditional machine learning tools built on top of Nx. Implements algorithms for:
  • Classification
  • Regression
  • Clustering
  • Dimensionality reduction
  • Metrics and preprocessing
• EXGBoost - Decision Trees implemented using the XGBoost C API.
• Mockinjay - Implementation of Microsoft's Hummingbird library for converting trained Decision Tree models into Nx tensor computations.
• Soothsayer - Time series forecasting library inspired by Facebook's Prophet and NeuralProphet.
• Ulam - Elixir interface to Stan, a probabilist programming language.

Deep Learning

• Axon - Neural Networks for Elixir. Built with Nx.
• Bumblebee - Pre-trained neural network models on top of Axon. Provides integration with Hugging Face.
• Ortex - Wrapper around ONNX. Enables you to run ONNX models using Nx.

Computer Vision

• Evision - OpenCV bindings for Elixir/Erlang.
• NxImage - Image processing in Nx.

Generative AI

LLM Tools

• Honeycomb - Fast LLM inference service and library built on Elixir, Bumblebee, and EXLA with OpenAI API compatibility.
• Instructor.ex - Structured outputs from LLMs using Ecto schemas. Works with OpenAI, llama.cpp and Bumblebee.
• Mentor - Library for generating validated structured outputs from LLMs with automatic retries and schema validation.
• Ollama-ex - Elixir client for Ollama API with support for completions, chat, tools, and function calling.
• Rag - Library for building Retrieval Augmented Generation (RAG) systems with support for vector stores like pgvector and chroma.
• TextChunker - Semantic text chunking library optimized for vector embedding and RAG applications.

Agent Frameworks

• Jido - Framework for building autonomous, distributed agent systems with modular actions, stateful agents, and sensors. AI-framework agnostic.
• LangChain - Framework for developing applications powered by language models, with support for OpenAI, Anthropic, Google, and Bumblebee models.
• SwarmEx - Lightweight library for AI agent orchestration with built-in telemetry and tool integration.

Development Tools

• HexDocs MCP - Enables semantic search of Elixir package documentation for AI assistants via Model Context Protocol (MCP).
• Hermes MCP - SDK for the Model Context Protocol (MCP) with support for multiple transport options (STDIO, HTTP/SSE, WebSocket).
• MCP Proxy - Proxy that connects STDIO-based MCP clients to HTTP-based Server-Sent Events (SSE) MCP servers.
• Tidewave Phoenix - AI-powered development assistant for Phoenix web applications that connects editor AI assistants to web framework runtime via MCP.

Livebooks & Examples

• José Valim's Livebooks - Livebooks that José used for talks and Advent of Code.
• Programming Machine Learning - Livebook notebooks with code examples for the Programming Machine Learning book by Paolo Perrotta
• Machine Learning in Elixir - Livebooks following along with the book Machine Learning in Elixir by Sean Moriarity
• Asynchronous Processing in Elixir - Interactive guide using Livebook to asynchronous data processing in Elixir.

Resources

Books

• Machine Learning in Elixir - Learning to Learn with Nx and Axon (by Sean Moriarity)
• Genetic Algorithms in Elixir - Solve Problems Using Evolution (by Sean Moriarity)

Videos

• (2025) Keynote: Designing LLM Native systems - Sean Moriarity
• (2024) Using LLMs and AI Agents to super power your Phoenix apps - Byron Saltysiak
• (2023) A year in production with Machine Learning on the BEAM (Explorer, Scholar, Bumblebee, Livebook)
• (2023) Nx-powered decision trees (Nx, EXGBoost)
• (2023) Building AI apps with Elixir
• (2023) MLOps in Elixir: Simplifying traditional MLOps with Elixir (Nx, Bumbleblee)
• (2023) Fine-tuning language models with Axon (Axon)
• (2023) Data wrangling with Livebook and Explorer (Livebook, Explorer)
• (2022) The Future AI Stack by Chris Grainer (Explorer, Axon)
• (2022) Announcing Bumblebee: pre-trained machine learning models for GPT2, StableDiffusion, and more (Livebook, Bumblebee)
• (2022) Axon: functional programming for deep learning (Axon)

Articles

• (2023) From Python to Elixir Machine Learning - Nice wrapup on what you gain from the Elixir ecosystem for Machine Learning.

Contributions

Contributions welcome! Read the contribution guidelines first.

License

This project is licensed under the CC0 License. Feel free to use, share, and adapt the content.