Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
Qwen
Qwen

Getting Started

  • Quickstart
  • Key Concepts
  • Speed Benchmark
  • Performance of Quantized Models

Inference

  • Transformers

Run Locally

  • llama.cpp
  • Ollama
  • LM Studio
  • MLX LM

Deployment

  • SGLang
  • vLLM
  • TGI
  • dstack
  • SkyPilot
  • OpenLLM

Quantization

  • AWQ
  • GPTQ
  • llama.cpp

Training

  • Axolotl
  • LLaMA-Factory
  • MS-SWIFT
  • Unsloth
  • verl

Framework

  • Qwen-Agent
  • Function Calling
  • LlamaIndex
  • Langchain
Back to top
Copyright © 2024, Qwen Team
Made with Sphinx and @pradyunsg's Furo