Repositories list

• Econo-Megatron

  Public
  Ongoing research training transformer models at scale

  Python

  •

  Other

  •2.5k•0•0•0•Updated Dec 20, 2024Dec 20, 2024

• COMP6211J_Course_HKUST

  Public
  0•39•0•0•Updated Dec 3, 2024Dec 3, 2024

• FlashFlex

  Public
  Accommodating Large Language Model Training over Heterogeneous Environment.

  Python

  •

  Apache License 2.0

  •5•15•1•0•Updated Oct 31, 2024Oct 31, 2024

• ZI-ISAG

  Public
  Python

  •

  Apache License 2.0

  •0•0•0•0•Updated Sep 4, 2024Sep 4, 2024

• FlexGen

  Public
  Running large language models on a single GPU for throughput-oriented scenarios.

  Jupyter Notebook

  •

  Apache License 2.0

  •557•0•0•0•Updated Jun 27, 2024Jun 27, 2024

• COMP4901Y_Course_HKUST

  Public
  Course Material for the UG Course COMP4901Y

  course-materialsmachine-learning-systemsllm

  Python

  •3•52•0•0•Updated May 12, 2024May 12, 2024

• HexGen

  Public
  [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.

  machine-learningdeep-learningdecentralized+ 5heterogeneousmodel-servinglarge-language-modelsgenerative-inferencellama2

  Python

  •

  Apache License 2.0

  •1•17•0•0•Updated May 6, 2024May 6, 2024

• Cross_Region_VPN_Profiling

  Public
  Python

  •2•0•0•0•Updated Dec 29, 2022Dec 29, 2022