nexa-sdk

Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.

Kotlin v0.2.73
7.8k stars  ·  956 forks  ·  Updated  ·  Apache-2.0
Install
# Maven: see https://github.com/NexaAI/nexa-sdk
View on GitHub
📄 Documentation
gemma3gogpt-ossgranite4llamallama3llmon-device-aiphi3qwen3qwen3vlsdk
Supported APIs (4)

The Docker DVP Data API allows Docker Verified Publishers to view image pull analytics data for their namespaces. Analyt

The Engine API is an HTTP API served by Docker Engine. It is the API the Docker client uses to communicate with the Engi

Docker Hub is a service provided by Docker for finding and sharing container images with your team. It is the world's la

APIs for sampling from and fine-tuning language models

Version history All releases ↗

## What's Changed * feat: add back video understanding example by @vinovo in https://github.com/NexaAI/nexa-sdk/pull/1044 * feat: add `nexa update` …

## What's Changed * feat: fix embedding error by @zhiyuan8 in https://github.com/NexaAI/nexa-sdk/pull/1018 * feat: enhance ASR example with streamin…

## What's Changed * chore: update BRIDGE_VERSION to v1.0.43-rc1 by @mengshengwu in https://github.com/NexaAI/nexa-sdk/pull/998 * chore(runner): upda…

**Full Changelog**: https://github.com/NexaAI/nexa-sdk/compare/v0.2.69...v0.2.70

## What's Changed * feat: code clean by @zhiyuan8 in https://github.com/NexaAI/nexa-sdk/pull/992 * feat: update libs by @zhiyuan8 in https://github.co…

## What's Changed * feat(store): support specify data dir by @RemiliaForever in https://github.com/NexaAI/nexa-sdk/pull/932 * feat(doc): add zh versio…

## What's Changed * feat : update bridge version by @zhiyuan8 in https://github.com/NexaAI/nexa-sdk/pull/975 * Update README.md by @alanzhuly in htt…

## What's Changed * feat(store): support specify data dir by @RemiliaForever in https://github.com/NexaAI/nexa-sdk/pull/932 * feat(doc): add zh versio…

Quality signals
Score
Stars7.8k
Forks956
Last updated
LicenseApache-2.0
Language
Kotlin
Browse all Kotlin SDKs →