GitHub - testli-ai/outlines-llama-cpp-python-streaming-output: This repository demonstrates how to use outlines and llama-cpp-python for structured JSON generation with streaming output, integrating llama.cpp for local model inference and outlines for schema-based text generation.

Install uv: Follow the installation guide.
Sync dependencies: Run uv sync to install the necessary dependencies.
Download models: Execute uv run src/download_models.py to download the required models.
Test streaming output: Run uv run src/generate_exam.py to test the streaming output.

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
src		src
.gitignore		.gitignore
.python-version		.python-version
README.md		README.md
main.py		main.py
pyproject.toml		pyproject.toml
uv.lock		uv.lock

Provide feedback