vLLM has quickly become the go-to inference
engine for developers who need high-throughput LLM serving.We
brought vLLM to Docker Model Runner for NVIDIA
GPUs on Linux, then extended it to Windows via WSL2. That changes today.Docker Model Runner now supports
vllm-metal, a new backend that brings vLLM
inference to macOS using Apple Silicon’s Metal GPU.If you have a
Mac with an M-series chip, you can now run MLX models through vLLM
with the same OpenAI-compatible API, same 
We’re excited to share a seamless new integration between
Docker Model Runner (DMR)
and Open WebUI, bringing together two open source
projects to make working with self-hosted models easier than ever.
With this update, Open WebUI automatically detects and connects to
Docker Model Runner running at localhost:12434.If Docker Model
Runner is enabled, Open WebUI uses it out of the box, no additional
configuration required. The result:a fully Docker-managed,
self-hosted model experience running in minutes.
Note for 
Docker Captains are leaders from the developer community that
are both experts in their field and are passionate about sharing
their Docker knowledge with others.“From the Captain’s Chair” is a
blog series where we get a closer look at one Captain to learn more
about them and their experiences. Today we are interviewing
Kristiyan Velkov, a Docker Captain and Front-end Tech Lead with
over a decade of hands-on experience in web development and DevOps.
Kristiyan builds applications with React, Next.js, Angular, and
Vue.js, and designs 
AI agents are moving from demos to daily workflows.They write code,
run commands, and complete multi-step tasks without constant
hand-holding.But general-purpose agents don’t know Docker.They
don’t understand your containers, your images, or your specific
setup. Gordon does.Just run docker ai in your terminal or try it in
Docker Desktop. Available today in Docker Desktop 4.61, still in
beta, Gordon is an AI agent purpose-built for Docker.It has shell
access, Docker CLI access, your filesystem, and deep knowledge of
Docker Weitere Beiträge ...
Seite 1 von 24