- 24 6月, 2023 5 次提交
-
-
由 Ramya Ramineni 提交于
* Bug fix * Fixed formatting error --------- Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com> -
由 Jeff Rasley 提交于
-
由 Joe Mayer 提交于
Co-authored-by: NJeff Rasley <jerasley@microsoft.com> -
由 Connor Holmes 提交于
Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com> Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com>
-
由 Cheng Li 提交于
* fix autotuner when backward is not called * fix format --------- Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
- 23 6月, 2023 8 次提交
-
-
由 Masahiro Tanaka 提交于
* zeropp chinese blog * try better quality images * make title larger * even larger... * various fix * center captions * more fixes * fix format * add ZeRO++ Japanese blog * add links --------- Co-authored-by: NHeyangQin <heyangqin@microsoft.com> Co-authored-by: NConglong Li <conglong.li@gmail.com>
-
由 Heyang Qin 提交于
-
由 Heyang Qin 提交于
Co-authored-by: NHeyangQin <heyangqin@microsoft.com> Co-authored-by: NGuanhuaWang <alexwgh333@gmail.com> Co-authored-by: Ncmikeh2 <connorholmes@microsoft.com> Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com> Co-authored-by: NMichael Wyatt <michaelwyatt@microsoft.com> Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com> Co-authored-by: NReza Yazdani <reyazda@microsoft.com>
-
由 stephen youn 提交于
Co-authored-by: NStephen Youn <styoun@microsoft.com> Co-authored-by: NArash Bakhtiari <arash@bakhtiari.org> Co-authored-by: NCheng Li <pistasable@gmail.com> Co-authored-by: NEthan Doe <yidoe@microsoft.com> Co-authored-by: Nyidoe <68296935+yidoe@users.noreply.github.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
由 Jeff Rasley 提交于
-
由 Heyang Qin 提交于
* zeropp chinese blog * try better quality images * make title larger * even larger... * various fix * center captions * more fixes * fix format
-
由 Jeff Rasley 提交于
-
由 Jeff Rasley 提交于
-
- 22 6月, 2023 5 次提交
-
-
由 Guorun 提交于
* Update profiler.py * pre-commit run --all-files * Delete .DS_Store * Delete .DS_Store * Delete .DS_Store --------- Co-authored-by: NJeff Rasley <jerasley@microsoft.com> Co-authored-by: NCheng Li <pistasable@gmail.com>
-
由 Cheng Li 提交于
-
由 Bill Luo 提交于
* fix conv_flops_compute when padding is a str when stride=1 * fix error * change type of paddings to tuple * fix padding calculation * apply formatting check --------- Co-authored-by: NCheng Li <pistasable@gmail.com> Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
由 Heyang Qin 提交于
-
由 Logan Adams 提交于
* Add H100 workflow * Switch to nightly from PR - will let us check stability first
-
- 21 6月, 2023 1 次提交
-
-
由 Ikko Eltociear Ashimine 提交于
Huggingface -> Hugging Face Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com>
-
- 20 6月, 2023 1 次提交
-
-
由 Vlad 提交于
-
- 16 6月, 2023 2 次提交
-
-
由 Dino Chen 提交于
* fix ccl_backend path when it should fallback * fix residual_add fallback when only one kernel is ready --------- Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com> -
由 Alejandro Dubrovsky 提交于
Co-authored-by: NAlex Dubrovsky <dubro@amazon.com>
-
- 15 6月, 2023 2 次提交
-
-
由 Conglong Li 提交于
-
由 mzl 提交于
Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
- 14 6月, 2023 5 次提交
-
-
由 Logan Adams 提交于
-
由 tensor-tang 提交于
* fixgated_mlp.py * fix hybrid_engine.py --------- Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com> -
由 john li 提交于
* include cublas error details when getting cublas handle fails * run clang-format * just use raw enum value to avoid depending on minimum cuda version --------- Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com> -
由 StrayWarrior 提交于
Co-authored-by: NFeng Zhoutian <fengzhoutian@meituan.com> Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com>
-
由 Logan Adams 提交于
* Fix apex installation * Switch install flag from build-opt to global-opt to fix missing cpp_ext * Try installing with support for newer pip * Add build packaging * Update to latest * Pin to specific commit while pyproject.toml is fixed
-
- 13 6月, 2023 1 次提交
-
-
由 Joe Mayer 提交于
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
- 10 6月, 2023 5 次提交
-
-
由 Ma, Guokai 提交于
--------- Co-authored-by: NJeff Rasley <jerasley@microsoft.com> -
由 Jeff Rasley 提交于
-
由 Logan Adams 提交于
* Add non-interactive prompt, causing issues for some users * Update pytorch version too
-
由 Abhilash Majumder 提交于
Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com> -
由 Ma, Guokai 提交于
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com> Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
-
- 09 6月, 2023 3 次提交
-
-
由 Olatunji Ruwase 提交于
Co-authored-by: NJeff Rasley <jerasley@microsoft.com> Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com>
-
由 Logan Adams 提交于
* Fix typo in name of hybrid engine function * Fix
-
由 hablb 提交于
* Remove dead code params_already_reduced is not used * Prevent evaluation of debug strings Debug strings are evaluated even when logging is disabled * Use contiguous gradients tensor reduce scatter between ranks Use allreduce instead of reduce scatter. lower cpu overhead. * move overflow tracker to optimizer.step Don't check overflow in gradients for every bucket. Do overflow chack once on grad flat buffer just before optimizer step --------- Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>
-
- 08 6月, 2023 2 次提交
-
-
由 Conglong Li 提交于
* DeepSpeed overview in Japanese * DeepSpeed overview in Japanese
-
由 john li 提交于
* Small tweak on cuda version mismatch documentation * clarify minor versions should also match --------- Co-authored-by: NLogan Adams <114770087+loadams@users.noreply.github.com>
-