Skip to content

@rioyokotalab YOKOTA Laboratory at Institute of Science Tokyo

Change the repository type filter

All

    Repositories list

    81 repositories

    • cutlass

      Public
      CUDA Templates for Linear Algebra Subroutines
      C++
      •1k•1•0•0•Updated Dec 4, 2024Dec 4, 2024

    • icrl-blog-post-2025

      Public
      HTML
      •
      MIT License
      •136•0•0•0•Updated Oct 31, 2024Oct 31, 2024

    • moe-recipes

      Public
      Ongoing Research Project for Mixture of Expert models
      Python
      •0•0•0•0•Updated Oct 2, 2024Oct 2, 2024

    • Megatron-LM

      Public
      Ongoing research training transformer language models at scale, including: BERT & GPT-2
      Python
      •
      Other
      •2.5k•0•0•0•Updated Sep 26, 2024Sep 26, 2024

    • nanoGPT

      Public
      The simplest, fastest repository for training/finetuning medium-sized GPTs.
      Python
      •
      MIT License
      •6.2k•1•0•0•Updated Sep 21, 2024Sep 21, 2024

    • bigcodebench

      Public
      BigCodeBench: Benchmarking Code Generation Towards AGI
      Python
      •
      Apache License 2.0
      •30•0•0•0•Updated Sep 16, 2024Sep 16, 2024

    • nccl-reader

      Public
      Optimized primitives for collective multi-GPU communication
      C++
      •
      Other
      •846•0•3•0•Updated Aug 2, 2024Aug 2, 2024

    • cosmopedia

      Public
      Python
      •
      Apache License 2.0
      •45•0•0•0•Updated Jul 17, 2024Jul 17, 2024

    • Hatrix

      Public
      C++
      •1•3•12•1•Updated Jul 5, 2024Jul 5, 2024

    • nbd

      Public
      N-Body generator for Hatrix
      C++
      •1•0•0•0•Updated Jun 17, 2024Jun 17, 2024

    • hpsc-2024

      Public
      Shell
      •37•14•0•0•Updated Jun 12, 2024Jun 12, 2024

    • FRANK

      Public
      C++
      •
      BSD 3-Clause "New" or "Revised" License
      •2•2•11•0•Updated May 9, 2024May 9, 2024

    • kenkyu_project

      Public
      Python
      •
      MIT License
      •0•1•0•0•Updated Apr 30, 2024Apr 30, 2024

    • grok-1

      Public
      Grok open release
      Python
      •
      Apache License 2.0
      •8.3k•0•0•0•Updated Mar 17, 2024Mar 17, 2024

    • toast-gpt

      Public
      Python
      •
      MIT License
      •1•0•0•0•Updated Mar 8, 2024Mar 8, 2024

    • toast-vit

      Public
      Python
      •
      MIT License
      •0•0•0•0•Updated Feb 14, 2024Feb 14, 2024

    • zero-bubble-pipeline-parallelism

      Public
      Zero Bubble Pipeline Parallelism
      Python
      •
      Other
      •2.5k•0•0•0•Updated Feb 13, 2024Feb 13, 2024

    • DeepSpeedFugaku

      Public
      main: microsoft/Meagtron-DeepSpeed, cpu: 富岳上で動かすstableブランチ
      Python
      •
      Other
      •1•5•2•0•Updated Feb 2, 2024Feb 2, 2024

    • Megatron-Llama2

      Public
      2023 ABCI Llama-2 継続学習プロジェクト
      Python
      •
      Other
      •3•13•0•0•Updated Jan 22, 2024Jan 22, 2024

    • megablocks

      Public
      Python
      •
      Apache License 2.0
      •177•0•0•0•Updated Dec 15, 2023Dec 15, 2023

    • FederatedLearning

      Public
      An adaptable federated learning framework with a central server, supporting diverse datasets, models, and optimizers. Facilitates collaborative, yet private, data training with customizable aggregation algorithms.
      Python
      •
      MIT License
      •0•0•0•0•Updated Nov 16, 2023Nov 16, 2023

    • m2

      Public
      Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
      Assembly
      •44•0•0•0•Updated Nov 2, 2023Nov 2, 2023

    • gpt-neox

      Public
      An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
      Python
      •
      Apache License 2.0
      •1k•0•0•0•Updated Sep 25, 2023Sep 25, 2023

    • Megatron-LLaMA

      Public
      Best practice for training LLaMA models in Megatron-LM
      Python
      •
      Other
      •2.5k•0•0•0•Updated Sep 4, 2023Sep 4, 2023

    • Megatron-DeepSpeed

      Public
      Ongoing research training transformer language models at scale, including: BERT & GPT-2
      Python
      •
      Other
      •2.5k•0•0•0•Updated Aug 30, 2023Aug 30, 2023

    • elses

      Public
      Fortran
      •0•0•0•0•Updated Aug 3, 2023Aug 3, 2023

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of autoregressive language models.
      Python
      •
      MIT License
      •2k•0•0•0•Updated Jul 31, 2023Jul 31, 2023

    • STRUMPACK

      Public
      Structured Matrix Package (LBNL)
      C++
      •
      Other
      •41•0•0•0•Updated Jul 25, 2023Jul 25, 2023

    • nbd-cpu-only

      Public
      C++
      •1•0•0•0•Updated Jul 6, 2023Jul 6, 2023

    • PixPro-with-OpticalFlow

      Public
      Pixel-level Contrastive Learning of Driving Videos with Optical Flow, CVPR 2023 Workshop
      Python
      •
      MIT License
      •0•5•0•0•Updated Jun 27, 2023Jun 27, 2023