Code

Distributed inference example#890

Code

Draft

angeloskath wants to merge 5 commits intomainml-explore/mlx-examples:mainfrom distributed-layersml-explore/mlx-examples:distributed-layersCopy head branch name to clipboard

+99-13

Commits

Commits on Jan 13, 2025

• Start distributed inference for llama models

  

  angeloskath

  authored and

  awni

  committed
  0c26d86

  Copy full SHA for 0c26d86

• Temporarily remove async_eval

  

  angeloskath

  authored and

  awni

  committed
  330b28a

  Copy full SHA for 330b28a

• Remove async eval and add sequential load

  

  angeloskath

  authored and

  awni

  committed
  8043638

  Copy full SHA for 8043638

• Make the chat distributed

  

  angeloskath

  authored and

  awni

  committed
  1344236

  Copy full SHA for 1344236

Commits on Jan 14, 2025

• fix lazy load

  awni

  committed
  b5ef406

  Copy full SHA for b5ef406