Open-Weight LLMs and Secure Enclaves Replace ChatGPT

·

OpenAI와 Anthropic을 단호히 거부하자

Closed frontier models from OpenAI and Anthropic have dominated the LLM market as the de facto standard. However, growing concerns in practice revolve around the fact that neither company effectively relinquishes access to conversation data through a simple training-opt-out toggle, and that loosely guarded model access may have been granted to certain U.S. cybersecurity firms and defense contractors. As a result, the search for alternatives to break this dependency in real-world environments is accelerating. The core of these alternatives lies in open-weight models and private inference services built on secure enclaves.

Training opt-out settings are not a privacy guarantee

OpenAI and Anthropic offer their most powerful models only as closed services, and users pay for chat or API access. Even when the training opt-out toggle is enabled, both companies retain full access to conversations and can review them or share them with governments and enterprises. This shows that training opt-out and private conversations are fundamentally different concepts. Even if both companies are currently likely to respect the opt-out, that alone is not enough to ensure long-term trust in how data is handled.

In the cybersecurity domain in particular, strict guardrails are applied. Agents that monitor conversations block session activity when they detect potential hacking behavior, but this approach is frequently criticized for producing false positives. On the other hand, certain users are granted model access with loose or no restrictions, and it is estimated that access may extend to multiple U.S. cybersecurity firms, almost certainly U.S. defense contractors, and any U.S. government agency that wants it. While restricting powerful models has some legitimacy, critics argue that leaving final access decisions to Sam Altman and Dario Amodei, who then coordinate with the executive branch, is undemocratic.

How far have open-weight models come?

Open-weight models are analyzed to lag roughly four months behind OpenAI and Anthropic’s advanced proprietary models, and this gap is considered small. GLM-5.3 is reported to perform roughly on par with Claude Opus 5.5 in software engineering, and the smaller GLM-5.3-Flash is evaluated as comparable to Claude Opus 4.8. If one can obtain a Mac Studio with 512GB of RAM, running GLM-5.3 locally as an individual is a realistic option.

However, the usefulness of a model and the trustworthiness of its developer as a data custodian are separate questions, and creating an account directly with Z.ai, GLM’s developer, or sending data to it is not recommended. Given that ZCode, the coding harness corresponding to Claude Code, was recently found to have uploaded local source code repositories to Alibaba Cloud without user consent, it is safer to assume that data provided to Chinese companies can be shared with the Chinese government. DeepSeek, Qwen, and Kimi families are also cited as impressive open-weight models, but the same distinction applies: relying on their developers as data custodians for conversations should be treated separately.

French company Mistral is classified as the only major LLM developer that is neither an American nor a Chinese company, and the nickname of its new frontier model Mistral Large 4 is Le Chonk. Entrusting data to Mistral rather than to an American or Chinese company is considered considerably more reasonable.

How secure enclaves reshape private inference

Secure enclave-based inference enables private AI use without local hosting. It is not perfect, but it provides a meaningful privacy difference compared with providers having unrestricted access to all data. Tinfoil is cited as the company working most actively in this space, with technical details available in its secure enclave and remote attestation documentation. Maple AI is another alternative, internally using Tinfoil’s inference service.

By use case, Tinfoil is recommended for serious agentic coding work such as software engineering, reverse engineering, malware analysis, CTF, and penetration testing, and charges for private inference based on token usage with no monthly subscription. Maple is positioned for general consumers who want a ChatGPT-like experience, including chatbot conversations, web search, document access and processing, and mobile apps, with a small free tier and a $20/month Pro plan.

For those who do not want to pay extra for private inference, an inference router like OpenCode Go is an option. OpenCode Go costs $10 per month and provides credits that exceed $10, with requests passing from the user’s computer through the OpenCode Go API to the actual inference provider. However, both OpenCode Go and its backend providers can access session data, and while GLM, Qwen, Kimi, and DeepSeek models are explicitly listed as zero-day retention targets, this is only a policy promise and not technically guaranteed.

Comparing private and low-cost inference options

Item Tinfoil Maple AI OpenCode Go
Core approach Secure enclave-based private inference Internally uses Tinfoil inference Inference router, connects to various backends
Recommended use Agentic coding, reverse engineering, penetration testing Chatbot, search, document processing, mobile Low-cost routing for mostly public work
Pricing No monthly fee, token-based usage Free tier + $20/month Pro $10/month + credits exceeding $10
Privacy guarantee Technically reinforced via secure enclaves Private via Tinfoil backend Zero-day retention policy (not technically guaranteed)
GLM-5.3 unit price Input $1.80 / cached $0.80 / output $5.75 (per 1M tokens) Same inference backend Same rate via router

Practical workflow: OpenCode + Tinfoil + GLM-5.3

Connecting Tinfoil and OpenCode Go to the coding harness OpenCode simultaneously and using GLM-5.3 mostly at a low inference level has been introduced as a real-world applied case. The inference provider is split depending on whether the work is public: fully public tasks, such as feature implementation for already open-source code, use OpenCode Go, while all other tasks use Tinfoil.

GLM-5.3’s token pricing is $1.80 per million tokens for input, $0.80 for cached tokens, and $5.75 for output, and reports indicate that setting a low inference level significantly reduces token usage while still delivering impressive results. In practice, evaluations describe costs as similar or lower, privacy as higher, and guardrails as far fewer. However, the pace of model change is fast, and what constitutes the best choice six months from now is unknown.

In early use cases, open-weight models appear to fully replace ChatGPT and Claude, and the ability to choose the runtime environment and provider itself acts as a practical insurance against single-vendor lock-in. As the ZCode unauthorized upload case shows, the data custodian trust issue remains an area that must be evaluated separately from model selection when choosing a coding harness.

Reference source

This article was written after verifying the following original: geeknews — Resolutely rejecting OpenAI and Anthropic

Leave a Reply

Your email address will not be published. Required fields are marked *