Encrypted Clouds?

I love the progress happening on open models but I feel like it is kind of getting clear that hardware to run good sized models is completely unaffordable for me right now. I know that you all love Qwen 27B and I do agree that it is a great model but it is just not enough for my personal use cases. I have tried a few of the bigger ones like GLM, DeepSeek and Kimi and I can definitely measure differences in the areas I am looking for and I would really like to utilize them somehow. I have so many ideas for things I want to do with these models but most of these require me sending quite some personal data of myself and I am just unwilling to send that data to Anthropic or OpenAI. I've been looking into what options I have and I did find an interesting one: tinfoil.sh . Unfortunately I am not that well versed in cryptography and security so I am not completely sure whether I could trust them are not. For those who know more, what are your opinions on them? Any other alternatives? I know local will always be best but I'm currently itching to do so much stuff with AI. I do use regular providers for most of my impersonal AI needs but there are sooo many things I want to do that require tighter control on my privacy. I really regret not getting a 6000 pro when it was 8k but now at 14k it is a definite no, and with the Mac Studio getting ever more delayed and repriced I am afraid I don't have many more options left :( submitted by /u/Prestigious_Roof_902 [link] [comments]

Related

• CPU-only inference on a Celeron N5095 SBC: 6 models from 0.6B to 8B, benchmarked
• What’s the community’s favorite benchmark to validate performance?
• Current efficient frontier of open models
• Mobile Offline LLMs: What do you use them for?

Source: r/LocalLLaMA | 2026-08-02