• 1 Post
  • 11 Comments
Joined 1 year ago
cake
Cake day: July 6th, 2023

help-circle





  • There is one extra step. I have an 6700xt, and with the docker containers, you just have to pass the environment variable HSA_OVERRIDE_GFX_VERSION=10.3.0 to allow that card to work. For cards other than 6000 series, you would need to look up the version to pass for your generation.

    Here’s an example compose file that I use for ollama that runs ai models on my 6700xt.

    version: '3'
    services:
      ollama:
        image: ollama/ollama:rocm
        container_name: ollama
        devices:
          - /dev/kfd:/dev/kfd
          - /dev/dri:/dev/dri
        group_add:
          - video
        ports:
          - "11434:11434"
        environment:
          - HSA_OVERRIDE_GFX_VERSION=10.3.0
        volumes:
          - ollama_data:/root/.ollama
    
    volumes:
      ollama_data: