RUN LLMs Locally On ANDROID: LlaMa3, Gemma & More

RM LLMs Locally On Android device using Ollama. Ollama is simple tool that allows running open source models like llama3, Gemma, tinyllama & more.
Downloads
Termux - github.com/termux/termux-app
Ollama Snippet - gitlab.com/-/snippets/3682973
Command List
termux-setup-storage
termux-change-repo
pkg upgrade
pkg install git cmake golang
Setup Ollama
git clone --depth 1 github.com/ollama/ollama.git
cd ollama
go generate ./...
go build .
./ollama serve &
Watch MORE Tech Videos
Dual boot ubuntu 24.04 LTS And Windows 11 - • How to Dual Boot Ubunt...
RASPBERRY Pi 5 - How to SetUp PLEX Media Server in 10 Minutes (2024) - • RASPBERRY Pi 5 - How t...
Raspberry Pi 5 - How To Build POWERFUL Home Server in 10 Minutes With CasaOS (2024) - • Raspberry Pi 5 - How T...
Install Kali Linux On M1 / M2 / M3 Macs Using UTM in 5 MINUTES (NEW METHOD) - • Install Kali Linux On ...
KDE Plasma 6 is Brilliant - TOP 6 NEW FEATURES - • KDE Plasma 6 is Brilli...
Install UBUNTU 23.10 On M1 M2 Macs NATIVELY || RUN New Ubuntu On Bare Metal On Apple silicon MAC - • Install UBUNTU 23.10 O...
FEDORA ASAHI REMIX + HYPRLAND Setup For M1 & M2 Macs 🔥 • FEDORA ASAHI REMIX + H...
Dual Boot popOS & windows 11 - • How to Dual Boot Pop O...
~ Buy Me A Coffee - buymeacoffee.com/kskroyal
~ Connect On Instagram - @KSKROYALTECH
~ For Business Enquires ONLY - [e-mail]
~ My Website - kskroyal.com/
© KSK ROYAL
MereSai

[@GhostCoder83]

Very helpful good work 👍

[@johnkintree763]

Excellent.

[@dennissit1770]

I have this error when I run ./ollama run tinyllama on my phone "Error: [0] server cpu not listed in available servers map[] ?" How can I fix this? Thanks

[@kskroyaltech]

Did u delete GO directory by any chance ?

[@galavant_amli]

Bhai With ls command, there is no green ollama showing.
What to do now.

[@ericdanielski4802]

Nice video.

[@bit-worm]

when i run "ollama run dolphin-llama3" on termux and i get the error " Error: [0] server cpu not listed in available server map[]" how do i fix it

[@laberbla6466]

local llms will be the shit one day... imagine an ai assistant with voice and stuff offline on your phone which you can fully trust. What a dream.

[@raceup]

getting the "server cpu not listed in available server map" literally scorched the internet
but coudnt find anything for termux

[@vaibhavG69]

These ollama models are only using cpu it wont use gpu do u have any solutions for that ?

[@DeonBands]

Thank you for this, would ollama then serve on android localhost, if so can I build android app to use server?

[@kskroyaltech]

But it may throw an error. It wont work the way like computer.

[@DeonBands]

@@kskroyaltech ua-cam.com/video/jRZy8pJ-SQg/v-deo.html

[@mikew2883]

Very cool! 👍 Is there a way to run the Ollama Web UI with it?

[@kskroyaltech]

its not working the way it does on computer.

[@gronerth]

I use open webuI on a pc connected remotely with ollama on an android, but it is extremely slow, even using s10.
i use userland with ubuntus.(llama3:8b hello take 10min), (tinydolphin hello take 3 min).
i use it "curl -fsSL ollama.com/install.sh | sh". i dont know if in this way i take slow program.

[@abdallahabdoulouafi1260]

hey bro when i run the command ./ollama serve &
It says ./ollama: No such file or directory
Can you figure out what is the problem

[@Dats4794]

Same

[@furkanyasar-jr4qg]

Hello mate, what is the application you use to manage your phone from the computer? 1:16

[@kskroyaltech]

I didnt use any application, I used USB OTG to connect bluetooth mouse and keyboard.

[@furkanyasar-jr4qg]

@@kskroyaltech okey tnk

[@ignitez3027]

bro how do you make UA-cam videos, especially the voice?

[@dhwany3gamer490]

how are your mouse and keyboard connected to phone

[@kskroyaltech]

I am using Wireless Bluetooth Mouse and Keyboard connected through USB C port on phone.

[@adrianmares269]

I have a very similar speed even on my laptop 😅

[@kskroyaltech]

Gotcha

[@webslime_ceo]

Hi, can you please make a video with the installation of gentoo dualboot? preferably with a kde graphical shell. I will be very grateful and I think this will help expand the gento community.

[@kskroyaltech]

Will try man.

[@webslime_ceo]

@@kskroyaltech When are you going to do this?

[@Dats4794]

How to run ollama again? Cause it says "No such file or directory"

[@kskroyaltech]

make sure you are inside the ollama directory on termux and run ./ollama pull phi

[@NikhilKumar-im7hg]

It still doesn’t run ollama model. Again the error is “no such file or directory”. The error is also valid bcoz when I run ls command it doesn’t show any ollama folder. How can we find the above git cloned ollama folder? Please help.

[@NikhilKumar-im7hg]

Waiting for ur reply 😊

[@staticlee4287]

I’m having the same problem

[@NikhilKumar-im7hg]

Layla app has the icon of animated caterpillar.

[@Dats4794]

I still get an error "error: could not connect to ollama app, is it running?"

[@YakrifZee]

Run this command:
ollama serve

[@Dats4794]

​@@YakrifZee already did 😢

[@kskroyaltech]

make sure you are inside the ollama directory on termux and run ./ollama pull phi

[@shenzhenfps]

Hey, I need help fro VMware please contact me

[@kskroyaltech]

YEs tell me.