Requirements
- Windows 10/11 x64
- Python 3.10+
- Optional: NVIDIA GPU with CUDA
Install
Quick Test
Was this page helpful?
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Setup NexaAI Python SDK on Windows x64 with GGUF models and CUDA support.
python -m venv .venv
.\.venv\Scripts\Activate.ps1
pip install nexaai
from nexaai import LLM, ModelConfig
llm = LLM.from_(model="NexaAI/Qwen3-0.6B-GGUF", config=ModelConfig())
print(llm.generate("Hello", None).text)