Add Proxy Support with NO_PROXY #11240
Open
+318
−76
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Use undici's EnvHttpProxyAgent for native NO_PROXY support - Automatically respects NO_PROXY/no_proxy environment variable - Supports exact match, wildcard (*), and suffix (.domain.com) patterns - Apply to MCP connections (SSE transport) and LLM endpoints (Anthropic/OpenAI) - Respects PROXY env var with automatic NO_PROXY bypass
- Create shared proxy utility in packages/api/src/utils/proxy.ts - Use undici EnvHttpProxyAgent for native NO_PROXY in fetch-based code - Add shouldBypassProxy() for axios-based code with HttpsProxyAgent - Support patterns: exact match, wildcard (*), suffix (.domain), port-specific - Update 16 files to respect NO_PROXY environment variable - Document NO_PROXY with common patterns in .env.example Files using EnvHttpProxyAgent (native NO_PROXY): - DALLE3, TavilySearch, TavilySearchResults, OpenAIImageTools (undici) - Azure/OpenAI Assistants, OpenID strategy Files using shared utility (manual NO_PROXY): - Mistral file operations, Model fetching, Bedrock - FluxAPI, Audio services (STT/TTS) - OpenID JWT strategy
Ensures consistent timeout behavior whether proxy is used or not. Without this fix, proxy connections had no timeout while non-proxy connections used bodyTimeout and headersTimeout defaults.
The api service was only mounting .env file but not passing PROXY/NO_PROXY as actual container environment variables. This ensures the proxy settings are available both to the Node.js app (via dotenv) and the container environment (for any child processes).
Added HTTP_PROXY, HTTPS_PROXY, and NO_PROXY to meilisearch for corporate environments that require all outbound traffic through proxy. Maps LibreChat's PROXY env var to standard Linux proxy env vars.
Many applications check for both uppercase (HTTP_PROXY) and lowercase (http_proxy) variants. Added lowercase versions for better compatibility.
Added HTTP_PROXY, HTTPS_PROXY and lowercase variants (http_proxy, https_proxy, no_proxy) to ensure proxy settings are available as actual container environment variables, not just via dotenv.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Adds comprehensive proxy support to LibreChat, including NO_PROXY environment variable support to bypass proxy for internal services and specified hosts.
Features:
Change Type
Testing
Set proxy configuration in .env: (please change the proxy name)
PROXY=http://proxy.example.com:8080
NO_PROXY=localhost,127.0.0.1,mongodb,meilisearch,vectordb,rag_api,host.docker.internal
Start with docker compose up -d
Verify external API calls (OpenAI, Anthropic) go through proxy
Verify internal services (mongodb, rag_api) bypass proxy
Test Configuration:
Checklist
Please delete any irrelevant options.