![](/assets/artwork/1x1-42817eea7ade52607a760cbee00d1495.gif)
Private LLM - Local AI Chatbot 17+
Secure Private AI Chatbot
Numen Technologies Limited
-
- $9.99
Screenshots
Description
Now with the new Llama-3.1 8B Instruct, Llama-3.1 8B Instruct abliterated and Llama-3.1 70B Instruct models.
Discover Private LLM, your secure, private AI assistant for iPhone, iPad, and macOS. Designed to boost your productivity and creativity while ensuring your privacy, Private LLM is a one-time purchase offering a universe of AI capabilities without subscriptions. Our chatbot utilizes cutting-edge on-device AI to keep your interactions confidential and completely offline, compatible with all your Apple devices.
Why Choose Private LLM?
- Diverse AI Models at Your Command: Select from a wide array of open-source LLM model families such as Google Gemma 2B, Mixtral 8x7B, Mistral 7B, Llama 2 (7B, 13B, and 33B), CodeLlama 13B, Solar 10.7B, and Phi 2 3B. Customize your AI experience for creative brainstorming, coding assistance, or daily inquiries.
- Seamless Siri & Shortcuts Integration: Enhance your AI interactions with Siri commands and customizable Shortcuts, making your digital assistant more integrated and accessible within your Apple ecosystem.
- Customizable System Prompts: Fine-tune your AI's responses and interactions to your liking with customizable system prompts, catering to your specific needs and preferences.
- Complete Privacy and Security: Private LLM confines your conversations to your device, providing unparalleled privacy. Our on-device AI enables powerful computing without data compromise or the need for an internet connection.
- Family Sharing & Offline Functionality: A one-time purchase that supports Family Sharing. Download models as needed and enjoy full AI assistant functionality, even offline.
- System Wide Grammar Correction and Summarization: Offering grammar correction, summarization, text shortening, and rephrasing within any app on your Mac.
Private LLM is more than a chatbot; it's an all-encompassing AI companion that respects your privacy while offering versatile, on-demand assistance. Whether for creative writing, solving complex programming issues, or general inquiries, Private LLM adapts to your needs, ensuring your data remains secure and on your device. Embark on a journey with Private LLM today and elevate your productivity and creative projects with the most private AI assistant for macOS and iOS devices.
Leveraging state-of-the-art Omniquant quantized models, Private LLM is a native Mac app that surpasses others with superior text generation, faster performance, and deeper integration compared to apps using generic baseline RTN quantized models like Ollama and LMStudio.
Supported Model Families:
- Google Gemma Based Models
- Mixtral 8x7B Based Models
- Llama 33B Based Models
- Llama 2 13B Based Models
- CodeLlama 13B Based Models
- Llama 2 7B Based Models
- Solar 10.7B Based Models
- Phi 2 3B Based Models
- Mistral 7B Based Models
- StableLM 3B Based Models
- Yi 6B Based Models
- Yi 34B Based Models
For a full list of supported models, including detailed specifications, please visit our website.
Optimized for Apple Silicon Macs with the Apple M1 chip or later, Private LLM for macOS delivers the best performance. Users on older Intel Macs without eGPUs may experience reduced performance.
What’s New
Version 1.8.9
- Support for downloading 5 new models. Three models from the new Meta Llama 3.1 family of models and two Meta Llama 3 based models (Support varies by device capabilities).
- 4-bit OmniQuant quantized version of the Meta Llama 3.1 8B Instruct model.
- 4-bit OmniQuant quantized version of the Meta Llama 3.1 8B Instruct abliterated model.
- 4-bit OmniQuant quantized version of the Meta Llama 3.1 70B Instruct model.
- 4-bit OmniQuant quantized version of the Llama 3 based L3 Umbral Mind RP v3.0 model.
- 4-bit OmniQuant quantized version of the Llama 3 based Llama 3 Instruct 8B SPPO Iter3 model.
- Stability improvements and bug fixes.
Thank you for choosing Private LLM. We are committed to continue improving the app and to making it more useful for you. For support requests and feature suggestions, please feel free to email us at support@numen.ie, or tweet us @private_llm. If you enjoy the app, leaving an App Store is a great way to support us.
Ratings and Reviews
So much potential
I've been using this app for a couple of months at this point. When it was first released, it was a neat proof of concept, but it only supported 7B models and was overall just too simple to use effectively. With a recent update, a 13B model was released for all macs with 16GB of memory, and it makes such a huge difference! It's not quite at the same level as ChatGPT 3.5T, but it's close enough that I never use 3.5T anymore; this is my go-to. I greatly appreciate the on-device processing (hallelujah privacy!), and it doesn't even use too much power - my battery still lasts for hours and hours. The performance is also great; my base M1 Air powers right through the prompts.
I only have two complaints about the app at this point. 1) The 13B model uses about 12GB of memory by itself, which does force the use of swap on a 16GB Air. Not much the dev can do about this, but it is something to keep in mind. You'll want to close out of other programs before launching this. 2) There still is no feature that has separate conversations. If you want to start a new conversation, you need to delete the existing conversation. I'd love it if we could get separate conversations in a future update; it would make this app so much easier to use.
Overall, I love it and do not regret buying it at all. I can't wait to see what future updates bring :)
A great tool, with huge potential.
Obviously being an offline GPT limits the responses, but the fundamentals for something impressive in future less memory restricted devices eg iPhone 15 and beyond is really exciting. Offline and privacy focused are essential qualities of this app and it works quite well. A good bargain for the price with an active developer. One recommendation/piece of feedback would be to provide information on what the settings TOP-P and temperature do. If we come across an error or weird, reproducible response could you provide an option to email you a log so we can forward you the issue easily? This way you don’t need to embed any privacy violating analytics packages.
Developer Response ,
Thanks for your feedback! Indeed we're hoping the upcoming iPhone 15 series of devices will have more memory, so we can ship bigger and smarter models for newer devices (As free updates, of course!). We're in the process of adding an FAQ on our website to answer the temperature, top-p question. We've already received the question a few times by now on our support email and on discord. Perhaps I should also add a help section within the app. Thanks for the suggesting the email log idea, I'll add it to our backlog. We specifically don't embed any analytics packages in the app, that would be antithetical to the concept of privacy, which is one of our app's USPs. The only logs we get are crash-logs from iOS's off by default, and opt-in Analytics feature (Settings -> Privacy & Security -> Analytics & Improvements -> Share With App Developers). Also, responses from the LLM in the app are (intentionally) stochastic, and are often hard to reproduce.
Phi3-Mini Please! (Nice app even on Intel Mac)
I'm reading Phi3-Mini is quite capable for its size. I know it was just released, but if you could get a version up soon that would be great. Maybe your existing Phi2 implementation will facilitate that.
Easy to download and run an LLM locally. No muss, no fuss.
Would like to echo another reviewer: please add support for increasing font size. I found I can actually access the default Mac font menu and specify something different, but it doesn't seem to have any effect on the actual font used in the application.
Developer Response ,
Thanks for the review! We’d added support for downloading Phi3-Mini the day it was released, on the iOS app (universal app, thus a free download for anyone who's purchased the macOS app). We’ll add it to the macOS app, along with the three Llama 3 8B based models that are already on the iOS app, next week. Also, I understand the need for adjustable font sizes on macOS. On iOS, people use Dynamic Type to globally alter font sizes from Settings, but macOS doesn’t have Dynamic type (yet). We’ll prioritize this on our roadmap. EDIT: Support for Phi-3 and Llama 3B models was shipped in the latest update (v1.8.5).
App Privacy
The developer, Numen Technologies Limited, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.
Data Not Collected
The developer does not collect any data from this app.
Privacy practices may vary, for example, based on the features you use or your age. Learn More
Information
- Seller
- Numen Technologies Limited
- Size
- 1.3 GB
- Category
- Productivity
- Compatibility
-
- iPhone
- Requires iOS 17.0 or later and a device with the A12 Bionic chip or later.
- iPad
- Requires iPadOS 17.0 or later and a device with the A12 Bionic chip or later.
- Mac
- Requires macOS 14.0 or later.
- Apple Vision
- Requires visionOS 1.0 or later and a device with the A12 Bionic chip or later.
- Languages
-
English
- Age Rating
- 17+ Infrequent/Mild Mature/Suggestive Themes Infrequent/Mild Medical/Treatment Information
- Copyright
- © 2024 Numen Technologies Limited
- Price
- $9.99
Supports
-
Family Sharing
Up to six family members can use this app with Family Sharing enabled.