Tony is a Geek

On a previous post HERE I described my first foray into using ollama as an LLM Engine on a Raspberry Pi 5 device. This time, I'm going to describe how to install / use that ollama Engine with a front-end UI.   Show options where you could use docker containers to run the components Show how to use native installation onto a laptop (VM Ubuntu) as it's just simpler Then, how to modify that UI code, rebuild it & see the changes. "Why Tony? Why?" Y'know, if you have to ask "Why?" then you don't understand.  Well, the reason being, I did some work about 1-year ago in relation to LLMs, very cutting-edge, very new & never done before, pretty ground breaking stuff.  However, it was too far advanced that no-one really understood it, quite a lot still don't.  Now, 1-year later, people are saying, "wow!amazing" about things that are loosely similar to what I did a year ago... sigh... the burden of being a geek.  So, this time, I'm jus...

Well, it's been about a year since I was writing some python code ( yes, I did type that & admit that I did that & to be fair it worked okay....as cardboard code ), I was using Llama.cpp, langchain and I wrote RAG and COT code.  I was quantizing my own model on the laptop that I was using, therefore I was fully exploiting the 64CPUs, 16GB GPU & 128GB RAM and was then pushing the boundaries with that spec when using the streaming Q&A, ingesting my own documents & storing in a Chroma vector store and then questioning the content....I actually overloaded and crashed the Windows 10 OS on the laptop & it needed a fresh re-build afterwards... it never quite worked the same. Anyway, my point being I was chuffed that I could run a Llama LLM offline on a laptop & it worked pretty reasonably, I was using code that I'd written & it was doing okay.  I attempted to explain it to other people & it turns out it was too complicated... Then a very early vers...

I have been asked by more than a few people about my views on A.I. ( which does NOT exist btw - there is no Artificial Intelligence, it does not exist yet, get over it ) and what I've been doing with it in relation to my work/work.  Well, I cannot tell you that, obviously. I have though in the past, populated articles on this site that reflect things that I have been doing / investigating for work/work and have made a record of them so that if/when I wish to repeat them I can return here and follow my instructions OR I have posted 'items of interest', things that I think might be interesting to follow up on at a near date/time in the future. I steer away from all the ChatGPT or Generative AI ( again, pi$$ poor name ) hype-b*ll*x that has been spewing out from very ignorant and naive people over the past 6-months.  Most of them should know better, as to the rest, well, they are the clueless one's, no change there, and they are just focused on the money $$$$ side of thin...