2025-01-29
in my case here. a single m1 mac mini 8gb.
can run only the smallest deepseek model.
using llama.cpp.
but without homebrew.
is easy still. (if the toolchain on your mac isn't all a mess—of brew packages & compiled code, like a debian linux.)
but on a brand-new m1 mac, say.
u need xcode first. app-store search & download. then agree to xcode terms.
sudo xcodebuild -license
then Command Line Tools.
xcode-select --install
at the time of writing this. (dated above.) u need cmake in order to compile llama.cpp.
a fresh new cmake tarball. (cmake*tar.gz)
but first. u need a new make binary.
(in order to compile cmake.)
if u check
make --version
u see. that the make that apple ships on your arm64 mac is for i386 architectures actually. which is no good. your make command needs to match your architecture.
so u need to download a make tarball too. (make*.tar.gz)
tar -xf make.tar && cd make
and u can read the INSTALL or README. but to compile, it's your typical
./configure && make && make install
probably quit & reopen your shell then.
and check your make command now.
make --version
is the one u just compiled. good.
now u can compile cmake.
tar -xf cmake.tar && cd cmake
again the INSTALL & or README. a little bit different here.
./bootstrap && make && make install
good.
now you're ready to compile llama.cpp.
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
mkdir build && cd build
cmake ..
make
congratulations.
u downloaded that deepseek .gguf file from hugging face. move it.
mv deepseek.gguf /path/to/llama.cpp/models/
ready to run the model now. (from llama.cpp/bin.) there's different commands. but one that'll get u started.
./llama-cli -m /path/to/llama.cpp/models/deepseek.guff -p "is this thing on?" -n 150
the -m flag...am assuming is for model
the -p...prompt
the -n...believe it's number of tokens output
enjoy.
comments
Winston here from Iowa. I’m always watching for new sites and looking at older ones and thought I’d reach out to see if you could use a hand driving targeted traffic, automating repetitive tasks, or some good old fashioned bulk targeted outreach campaigns to lists I already own.
I’ve been doing this for over 20 years — building sites, editing videos, crafting bulk email campaigns (I even provide the targeted lists as I mentioned), running traffic, creating custom software, fixing and optimizing WordPress sites, I'll even pay for any plugins you might want/need. If a solution exists, I’ve probably built it or bought it — and if I haven’t, I will for your project. I’m happy to shoulder 90% of the cost with tools, lists, licenses, and tech I already own.
All I ask is a flat $99/month for my time, month to month — no catch. I don't mean to impose, I just wanted to offer real help if you’re open to it.
Quick background: born and raised in the Midwest, married, three girls. If I can support them by helping you using everything I’ve built over the years, that’s the kind of win-win I can imagine. It still amazes me how few people actually help the way I do — and I’d love the chance to show you.
If you need anything at all, just ask, doesn't cost anything to do that.
P.S. – If I missed something you might need help with, just ask. I only scratched the surface here.
All the best,
Winston
Cell: 1-319-435-1790
Chat with me anytime: https://kutt.it/deserve
Winston here from Iowa. I’m always watching for new sites and looking at older ones and thought I’d reach out to see if you could use a hand driving targeted traffic, automating repetitive tasks, or some good old fashioned bulk targeted outreach campaigns to lists I already own.
I’ve been doing this for over 20 years — building sites, editing videos, crafting bulk email campaigns (I even provide the targeted lists as I mentioned), running traffic, creating custom software, fixing and optimizing WordPress sites, I'll even pay for any plugins you might want/need. If a solution exists, I’ve probably built it or bought it — and if I haven’t, I will for your project. I’m happy to shoulder 90% of the cost with tools, lists, licenses, and tech I already own.
All I ask is a flat $99/month for my time, month to month — no catch. I don't mean to impose, I just wanted to offer real help if you’re open to it.
Quick background: born and raised in the Midwest, married, three girls. If I can support them by helping you using everything I’ve built over the years, that’s the kind of win-win I can imagine. It still amazes me how few people actually help the way I do — and I’d love the chance to show you.
If you need anything at all, just ask, doesn't cost anything to do that.
P.S. – If I missed something you might need help with, just ask. I only scratched the surface here.
All the best,
Winston
Cell: 1-319-435-1790
Chat with me anytime: https://kutt.it/deserve
comment