Running Ollama on the Intel Arc GPU

How I Got Ollama Running on My Intel Arc GPU – A Step-by-Step Journey

Hey everyone, Daniel here from Tiger Triangle Technologies! I just uploaded a new YouTube video that I’m really excited about, and I wanted to share the experience with you in this blog post. If you’ve ever tried running Ollama on an Intel Arc graphics card and hit a wall because it seems to favor Nvidia or newer AMD cards, this one’s for you. I’ve got some great news: there’s a solution called IPEX-LLM that saved the day for me, and I’m going to walk you through how I made it work.

The Case of the Slow Chatbot - and how to make it lightning fast

 

It was a brisk afternoon at Tiger Triangle Technologies, and the hum of computations filled the air, more eager than a bustling London thoroughfare. I had scarcely finished my previous experiment—indeed, quite a robust affair with Blazor web applications—when a most peculiar challenge presented itself: the elusive matter of optimizing performance for the Ollama software suite.

Seated at my desk, surrounded by stacks of benchmark records, diagnostics, and freshly sharpened code, I felt a thrill much akin to that of a detective on the brink of discovery. “Ah, here we are,” I muttered. “Today, we’re diving deep into the mysteries of local model performance.”

The challenge was one fit for a connoisseur of computational intrigues, a true fundamental, if you will, in the realm of Ollama’s capabilities. For those as intent on maximizing Ollama’s prowess as I was, today’s expedition would surely reveal insights worth their weight in bytes.

Force Ollama to Use Your AMD GPU

 

How to Force Ollama to Use Your AMD GPU—Even if It’s Not Officially Supported

Hello, Daniel here from Tiger Triangle Technologies! Today, I’m diving into a workaround to help you force Ollama to recognize and utilize an AMD GPU that’s technically unsupported. If you’re a fan of AMD like me and felt the sting of exclusion when Ollama's official list didn’t include your model, you’re in the right place.

Ollama announced support for AMD GPUs in March 2024, which was thrilling news for those of us who prefer Team Red. However, excitement quickly dwindled upon closer inspection: my AMD Radeon 6750 XT was missing from the compatibility list. If you’re in a similar boat, no worries—there’s a solution for us AMD users on Windows. Here’s a straightforward guide to get you up and running with your “unsupported” AMD card!

Check if Ollama is Using Your GPU or CPU

How to Check if Ollama is Using Your GPU or CPU

If you're aiming to get the most out of Ollama, knowing whether it’s using your GPU or CPU can make a significant difference in performance. This blog post is part of a series where I dive into ways to boost your Ollama experience, and today, we're focusing on how to determine if Ollama is actually using your GPU.

Uncensored AI Models - The Guardrails are Off

Hi. I'm Daniel from Tiger Triangle Technologies.

Today, we're diving back into the fascinating world of uncensored models. In part one of this series, I laid out the case for why these models are crucial. Now, it's time to roll up our sleeves and get hands-on with this technology. Welcome to part two of our exploration into uncensored models.

A Case for Uncensored Models

Exploring Uncensored AI Models: A Deep Dive into Ethical AI

Hello, and welcome to Tiger Triangle Technologies! I'm Daniel, and today we're delving into a topic that’s both controversial and crucial: uncensored AI models. This discussion is about having private AI assistants that can answer questions where other chatbots dare not tread.

You may have encountered a situation where an AI chatbot refused to answer a seemingly innocuous question. This kind of response can be surprising, especially when the question seems harmless.

Getting Started with Open WebUI

Welcome back to Tiger Triangle Technologies 🐯! Today, we're diving into the world of private AI assistants with Open WebUI, your solution for running a local, feature-rich AI chatbot right from your own machine.

What is Open WebUI?

Open WebUI is more than just another chatbot—it's an extensible, feature-packed alternative to online solutions like Chat GPT. And their dev team is adding more goodies all the time. Running locally on your computer, Open WebUI gives you full control over your AI assistant, ensuring your data stays private and secure.

Model File Magic with Ollama and Open WebUI

Creating Model Files the Easy Way

Greetings, fellow tech enthusiasts, and welcome back to another riveting adventure with yours truly, Daniel from Tiger Triangle Technologies! Today, we're diving headfirst into the wild world of model file creation using the ever-magical Ollama. Didn't we do that last time? Yes, however this time we are using a graphical user interface which makes it an absolute breeze!

Craft Thine Own Chatbot with Ollama

Hey there, it's Daniel from Tiger Triangle Technologies, your friendly neighborhood guide through the wild world of AI. Buckle up because today, we're diving into the realm of Ollama model files, where the magic of personalized AI assistants awaits!

Imagine if your AI assistant could transcend its basic functions and morph into a digital maestro, specialized in anything from software engineering to channeling their inner Jarvis from Iron Man. Well, guess what? With Ollama, you can! And in this video, I will show you how to change the DNA of your AI chatbot.

The Power and Extensibility of Ollama - Using PowerShell and REST API

Hey there tech enthusiasts, Daniel from Tiger Triangle Technologies here! In this video, we're building on our previous exploration of Ollama, a large language model with some serious potential. This time, we're kicking things up a notch by introducing PowerShell and the REST API to the mix. Buckle up, because we're about to unlock even greater capabilities and open the doors for some truly extensible Ollama applications!

Getting Started with Ollama - Your Own AI Assistant Running Locally

Hey everyone, Daniel from Tiger Triangle Technologies here! Today, I'm here to talk about running your own AI assistant locally on your machine.

Let's face it, AI assistants are all the rage these days. But what if you don't want your conversations with your toaster plotting world domination to be floating around in the cloud? Or maybe you just want a little more control over what your AI assistant is doing, like making sure it uses all it's training data to find the best cat videos, not just the ones approved by its corporate overlords. Well, that's where local AI assistants come in!