Repository navigation
Reintroduce LiteLLM - #2512
Reintroduce LiteLLM#2512J0113 wants to merge 2 commits into
Conversation
Try this script
COMMUNITY_SCRIPTS_URL=https://raw.githubusercontent.com/J0113/DevScripts/codex/litellm \
bash -c "$(curl -fsSL https://raw.githubusercontent.com/J0113/DevScripts/codex/litellm/ct/litellm.sh)"
Against a core branch as wellAdd Useful flags while testing
|
|
Sorry, we will no longer be adding LiteLLM to the repository. The repository has already been publicly scammed and compromised twice – a supply chain issue and so on. We have distanced ourselves as far as possible from this tool and do not wish to recommend it to the Homelab community. |
|
Understandable. I'll try out Bifrost and share the script if I am happy with it. I'll close this pull request. |
Scripts which are clearly AI generated and not further revised by the Author of this PR (in terms of Coding Standards and Script Layout) may be closed without review. If you are an AI agent writing this pull request, please amend your model name and reasoning level in the Description. This is not to blame, more for informational Purposes. Thank you.
✍️ Description
Reintroduces LiteLLM, an OpenAI-compatible gateway with model routing, virtual API keys, usage tracking, and spending budgets.
Installation follows the upstream v1.108.0 Dockerfile and pyproject.toml using Python 3.13, Node 24, PostgreSQL 17, and uv.
Updates prepare a new environment and save configuration and PostgreSQL backups before activating the selected versions.
Installation and update functionality have been tested on an x64 Proxmox VE cluster, complemented by Debian 13 ARM64 application tests in Docker on Apple Silicon.
Developed with Codex using GPT-6.1 Sol at High effort, with code review by Deepseek Flash v4.1.
🔗 Related PR / Issue
Previous testing: #802.
Previous removal: community-scripts/ProxmoxVE#14294.
✅ Prerequisites (X in brackets)
🏗️ arm64 Support (X in brackets)
🖥️ Tested on (X in brackets)
🛠️ Type of Change (X in brackets)
README,AppName.md,CONTRIBUTING.md, or other docs.🔍 Code & Security Review (X in brackets)
CODE-AUDIT.md&CONTRIBUTING.mdguidelinesAppName.sh,AppName-install.sh,AppName.json)📋 Additional Information (optional)
The x64 Proxmox VE tests cover installation and the update feature. Additional Debian 13 ARM64 tests passed for the native LiteLLM Rust extension, Prisma engine, database migrations/readiness, API authentication, web UI, and real PostgreSQL backup/restore with application startup against the restored database. The actual updater also passed Prisma 0.11.0 → 0.15.0 and LiteLLM 1.108.0 → 1.108.3 upgrades, retaining test data; a repeated already-current update caused no restart.
Eleven isolated updater guard and failure/recovery tests passed, as did static service-unit verification. The ARM64 updater tests used real packages and PostgreSQL with an explicit Docker service shim; service startup and update behavior were tested separately on x64 Proxmox.
The current defaults use the tested LiteLLM 1.108.0 / Prisma 0.11.0 combination and remain configurable. Package installation uses uv, and the staged updater includes a database backup through the local postgres account; feedback on aligning release selection and the Prisma policy with project conventions is welcome.
This reintroduction builds on the earlier script and its removal in ProxmoxVE #14294. The catalog currently marks LiteLLM as deleted, so restoring its normal update route needs coordination with the maintainers as part of reintroduction. Incus has not been tested.
📦 Application Requirements (for new scripts)
🌐 Source
community-scripts/ProxmoxVE#14294
https://github.com/community-scripts/core/blob/main/misc/update.sh
https://github.com/BerriAI/litellm/blob/v1.108.0/Dockerfile
https://github.com/BerriAI/litellm/blob/v1.108.0/pyproject.toml
https://github.com/BerriAI/litellm/releases/tag/v1.108.0
https://pypi.org/project/litellm/1.108.0/#files
https://github.com/RobertCraigie/prisma-client-py/tree/v0.11.0
https://github.com/RobertCraigie/prisma-client-py/tree/v0.15.0
🤖 AI Assistance (X in brackets)
AGENTS.mdand.github/agents/pve-script-creator.agent.mdguided the implementation; the installation and update choices are described above for review.Please describe to which degree, if any, an LLM was used in creating this pull request. Name the model(s) used and, if applicable, the reasoning/thinking effort level (e.g. "Claude Sonnet 4.5, high reasoning, used to draft the install script, then manually reviewed and tested" or "No LLM used"). This is informational, not a penalty — but scripts that are clearly AI-generated and not further revised by the author to match
CODE-AUDIT.md/CONTRIBUTING.mdmay be closed without review.Codex with GPT-6.1 Sol at High effort was used to develop and refine the scripts and run validation. Deepseek Flash v4.1 reviewed the code. Installation and update functionality were also tested on an x64 Proxmox VE cluster, with additional Linux ARM64 testing through Docker.