Repository navigation

Dev -> Main - #885

Merged

priyakasimbeg merged 212 commits into

mainfrom

dev

Sep 5, 2025

Commits on Feb 20, 2025
- Use jax.jit for sharding initial steps
  rka97
  committed
  ae48ccd
- Use jax.jit for adamw
  rka97
  committed
  eb5cac7
- Pass yapf checks
  rka97
  committed
  82977da
- CIFAR workload sharding
  rka97
  committed
  99545d4
- librispeech_conformer now running
  rka97
  committed
  018711a
- fix formatting
  rka97
  committed
  fbeb5f1
- shard default
  rka97
  committed
  6e4e7b0
- start imagenet
  rka97
  committed
  4a2c02d
- remove bn sync in imagenet (jit handles it automatically)
  rka97
  committed
  47beba1
- ImageNet-ViT also works
  rka97
  committed
  3a18f19
- Start working on WMT. OOM error
  rka97
  committed
  bd0f565
- post-rebase, still on wmt
  rka97
  committed
  3044efb
- cache sharding fix
  rka97
  committed
  e301c49
Commits on Feb 21, 2025
- Merge branch 'dev' into jit_switch
  priyakasimbeg
  committed
  e5ed97a
- target_setting_algorithms sharding, compilation caching
  rka97
  committed
  4fcf984
- Update tests to correct batch size
  rka97
  committed
  d147e39
- yapf and isort checks..
  rka97
  committed
  a2b61be
Commits on Mar 6, 2025
- Merge branch 'jit_switch' of https://github.com/mlcommons/algorithmic-efficiency into jit_switch
  priyakasimbeg
  committed
  be11c23
- Merge branch 'dev' into jit_switch
  priyakasimbeg
  committed
  e2a3b5f
Commits on Mar 7, 2025
- switch fastmri from pmap to jit
  priyakasimbeg
  committed
  a80f4ec
- migrate criteo workload
  priyakasimbeg
  committed
  c39ca51
- update utils function used for sharding conformer
  priyakasimbeg
  committed
  06377d9
Commits on Mar 8, 2025
- update conformer and deepspeech
  priyakasimbeg
  committed
  9cbe7d9
Commits on Mar 11, 2025
- debugging
  priyakasimbeg
  committed
  c6ecd67
Commits on Mar 12, 2025
- debuging
  priyakasimbeg
  committed
  f35690d
Commits on Mar 18, 2025
- reformatting
  priyakasimbeg
  committed
  848b50c
- reformatting
  priyakasimbeg
  committed
  fb62eae
- reformatting
  priyakasimbeg
  committed
  fe3f9f0
- reformatting
  priyakasimbeg
  committed
  004afbd
- reformatting
  priyakasimbeg
  committed
  f1db3d3
Commits on Mar 19, 2025
- sharding deepspeech
  priyakasimbeg
  committed
  c208cc7
- ogbg jit migration
  priyakasimbeg
  committed
  2e4cc9e
Commits on Mar 20, 2025
- deepspeech jit changes
  priyakasimbeg
  committed
  d3a06fc
- set jax to 0.5.1
  priyakasimbeg
  committed
  2cfa2a9
- merge
  priyakasimbeg
  committed
  70705a7
Commits on Apr 1, 2025
- upgrade jax to 0.5.3
  priyakasimbeg
  committed
  75d6315
- change bsz back
  priyakasimbeg
  committed
  1df0690
Commits on Apr 3, 2025
- formatting
  priyakasimbeg
  committed
  c1d0c66
- remove debugging statements from submission_runner.py
  priyakasimbeg
  committed
  1b9466c
- pyproject.toml
  priyakasimbeg
  committed
  7a71cf0
- clean up ogbg
  priyakasimbeg
  committed
  9e1f337
- clean up ogbg
  priyakasimbeg
  committed
  a1d0abd
- Merge branch 'jit_switch' of github.com:mlcommons/algorithmic-efficiency into jit_switch
  priyakasimbeg
  committed
  adb2b7e
- clean up mnist workload.py
  priyakasimbeg
  committed
  99caa03
- refactoring & clean up
  priyakasimbeg
  committed
  b14174b
- simplify changes in cifar jax
  priyakasimbeg
  committed
  a3a9b9f
- small fix
  priyakasimbeg
  committed
  0a340a2
- rename sharding utils
  priyakasimbeg
  committed
  60c1cce
- fix sharding rename
  priyakasimbeg
  committed
  1edb724
- refactoring
  priyakasimbeg
  committed
  49864fb
Commits on Apr 4, 2025
- modifications to cifar
  priyakasimbeg
  committed
  7820ac6
Commits on Apr 5, 2025
- fix
  priyakasimbeg
  committed
  0a2043c
- clean up and small fixes
  priyakasimbeg
  committed
  95037bf
- add test for sharding invariance
  priyakasimbeg
  committed
  e79c761
Commits on Apr 8, 2025
- fix
  priyakasimbeg
  committed
  110e792
Commits on Apr 14, 2025
- Update pyproject.toml
  priyakasimbeg
  authored
  9c91c65
- Update workload.py
  priyakasimbeg
  authored
  21bb997
- Update workload.py
  priyakasimbeg
  authored
  eb56919
- Merge branch 'jit_switch' of github.com:mlcommons/algorithmic-efficiency into jit_switch
  priyakasimbeg
  committed
  c489749
Commits on May 19, 2025
- upgrade jax
  priyakasimbeg
  committed
  1277cc2
- update dockerfile
  priyakasimbeg
  committed
  def4ac5
- remove extra installs
  priyakasimbeg
  committed
  450cbee
Commits on May 20, 2025
- update jax version
  priyakasimbeg
  committed
  89718e7
- update install commands for pytorch cpu only
  priyakasimbeg
  committed
  7dcf5af
- update dockerfile
  priyakasimbeg
  committed
  4335688
- update dockerfile
  priyakasimbeg
  committed
  8d1fe7e
- update dockerfile
  priyakasimbeg
  committed
  240e2e5
- update dockerfile
  priyakasimbeg
  committed
  cc8d604
- update dockerfile
  priyakasimbeg
  committed
  fe56eaf
Commits on May 27, 2025
- modify initial model_state
  priyakasimbeg
  committed
  de4c38b
- docker build script change
  priyakasimbeg
  committed
  5b7fb31
- temporarily use pre-releases for jax install
  priyakasimbeg
  committed
  57b8fe6
Commits on May 28, 2025
- fix to pyproject.toml
  priyakasimbeg
  committed
  e23e99a
Commits on May 29, 2025
- chnage defaults for job config script
  priyakasimbeg
  committed
  505fab2
Commits on Jun 4, 2025
- fix docker image
  priyakasimbeg
  committed
  4acaffe
- jax deprecation fix for jax.tree_map
  priyakasimbeg
  committed
  3481f0e
- try to fix jax installation
  priyakasimbeg
  committed
  447d621
- temporary pip install change for jax gpu nightly
  priyakasimbeg
  committed
  a3df78c
Commits on Jun 7, 2025
- add step_time to summary df
  priyakasimbeg
  committed
  8aa3ffc
Commits on Jun 10, 2025
- capture trace
  priyakasimbeg
  committed
  1cc068a
- add flag to skip evals
  priyakasimbeg
  committed
  274a911
Commits on Jun 12, 2025
- add log dir to save traces to
  priyakasimbeg
  committed
  2580f5c
- remove editable flag from docker install for ml packages
  priyakasimbeg
  committed
  00d3810
- add cpu version for pytorch package to pyproject.toml
  priyakasimbeg
  committed
  c87d908
- merge
  priyakasimbeg
  committed
  12f1a87
- decrease logging frequency
  priyakasimbeg
  committed
  f387724
- fix pyproject.toml
  priyakasimbeg
  committed
  f4c6072
- fix
  priyakasimbeg
  committed
  8616a64
- update dockerfile
  priyakasimbeg
  committed
  89ddb7f
- update installation instructions
  priyakasimbeg
  committed
  993fe6f
Commits on Jun 25, 2025
- Rework Readme
  fsschneider
  committed
  ca4f4b6
- Remove deprecated rules and call for submissions
  fsschneider
  committed
  2d2fd37
- Clarify automatic versioning
  fsschneider
  committed
  2544fb9
- Mention changelog
  fsschneider
  committed
  c8da1f9
- Backlog changes
  fsschneider
  committed
  d233344
- Increment version + formatting
  fsschneider
  committed
  679e5ec
- Formatting
  fsschneider
  committed
  891fdb7
- Mention our version policy
  fsschneider
  committed
  0390e13
- More descriptive link text
  fsschneider
  committed
  818710b
- Add versioning protocol
  fsschneider
  committed
  03114bd
- Document dropout PR
  fsschneider
  committed
  a2ab920
- Compact layout for default dropout values
  fsschneider
  committed
  64e9961
- Change from 5 to 3 studies
  fsschneider
  committed
  23004a2
- Change from 5 to 3 studies
  fsschneider
  committed
  576c661
- Remove held-out workloads
  fsschneider
  committed
  bdfd9d8
Commits on Jul 2, 2025
- use jraph.batch_np instead of jraph.batch since jraph.batch with jnp leaks device memory
  priyakasimbeg
  committed
  20b726a
- modify documentation
  priyakasimbeg
  committed
  9d1f915
Commits on Jul 3, 2025
- add plot util to visualize training metrics with wandb
  priyakasimbeg
  committed
  3486145
Commits on Jul 8, 2025
- First draft at re-ordering algorithms
  fsschneider
  committed
  0ac2dbe
Commits on Jul 9, 2025
- Fix typo in documentation regarding `update_params` function arguments
  fsschneider
  committed
  a83d573
- Add detailed docstrings for functions in submission.py
  fsschneider
  committed
  200ef7c
- Move paper baselines into `archived_paper_baselines` subdirectory
  fsschneider
  committed
  8cfd172
- Add proper readme for algorithms collection
  fsschneider
  committed
  1f7915e
- prize_qualification_baselines -> Baselines
  fsschneider
  committed
  db6681e
- Remove mention of prize_qualification
  fsschneider
  committed
  dd2cd50
- Add Training Algorithm Collection section to README.md
  fsschneider
  committed
  af89c29
- Fix paths to algorithms
  fsschneider
  committed
  a0d8558
- Fix a few more :)
  fsschneider
  committed
  a106537
- Update Changelog
  fsschneider
  committed
  5f0c77f
- Fixed link to cloud-startup
  fsschneider
  committed
  4ebefc7
- Docs rewrite: Part I
  fsschneider
  committed
  e31b6d9
- Formatting tweaks
  fsschneider
  committed
  10faf4d
- expand plot_curves.py to take entire directory
  priyakasimbeg
  committed
  5cbb368
- plot utils fixes
  priyakasimbeg
  committed
  c0edfbe
- temporarily use old stephints
  priyakasimbeg
  committed
  cdf35d8
- add wandb
  priyakasimbeg
  committed
  8f6648c
Commits on Jul 10, 2025
- Typos and clarity
  fsschneider
  committed
  37803c6
- Add important rules from COMPETITON RULES
  fsschneider
  committed
  e813bb5
- Simplify Intro
  fsschneider
  committed
  44dd919
- Small readability tweaks
  fsschneider
  committed
  3411368
- Rewrite benchmark process intro
  fsschneider
  committed
  79312f6
- Re-write (parts of) Submission section
  fsschneider
  committed
  a6d939d
- Remove last mention of model track
  fsschneider
  committed
  29a552a
- remove unused baselines that rely on pmap
  priyakasimbeg
  committed
  582951c
- move prize qualifcation baselines
  priyakasimbeg
  committed
  b689a98
Commits on Jul 11, 2025
- migrate qualifcation baselines to use jit
  priyakasimbeg
  committed
  2c653f8
- formatting
  priyakasimbeg
  committed
  eb009ac
- documentation update
  priyakasimbeg
  committed
  45a7fbe
- removed unused code
  priyakasimbeg
  committed
  7dff874
- fix
  priyakasimbeg
  committed
  c028f94
- fix
  priyakasimbeg
  committed
  55204a6
- fix
  priyakasimbeg
  committed
  4f1c43e
- fix name
  priyakasimbeg
  committed
  b952422
- fix
  priyakasimbeg
  committed
  5f46ec7
Commits on Jul 15, 2025
- add legacy LSTM layer to Deepspeech
  priyakasimbeg
  committed
  3593463
Commits on Jul 17, 2025
- swap out lstm layer
  priyakasimbeg
  committed
  7f35327
Commits on Jul 30, 2025
- pin jax version
  priyakasimbeg
  committed
  86e6379
- pin jax version
  priyakasimbeg
  committed
  378f76c
- pin jax to 0.6.2
  priyakasimbeg
  committed
  db652ee
Commits on Jul 31, 2025
- fix jax version
  priyakasimbeg
  committed
  3b5a623
- pin cudnn version
  priyakasimbeg
  committed
  8e98702
Commits on Aug 5, 2025
- add script to export runs to wandb
  priyakasimbeg
  committed
  d47c70a
Commits on Aug 9, 2025
- merge from dev
  priyakasimbeg
  committed
  6634043
- fix formatting for ruff
  priyakasimbeg
  committed
  579ebc1
- small fixes in make_job_config.py
  priyakasimbeg
  committed
  9d3c2d8
- fix format
  priyakasimbeg
  committed
  0eba94b
Commits on Aug 12, 2025
- fix
  priyakasimbeg
  committed
  64255e2
- delete incomplete sharding test
  priyakasimbeg
  committed
  fb3bb33
- linting
  priyakasimbeg
  committed
  d814fc7
- linting
  priyakasimbeg
  committed
  993949a
- fix
  priyakasimbeg
  committed
  be88d01
- remove unmaintained baselines
  priyakasimbeg
  committed
  5859935
- fix sharding for ogbg pytorch
  priyakasimbeg
  committed
  462e1a5
- fix
  priyakasimbeg
  committed
  c337cc4
- reformatting
  priyakasimbeg
  committed
  2717519
- fix
  priyakasimbeg
  committed
  91912cc
- format
  priyakasimbeg
  committed
  ecbf90e
- fix reference algorithm test for ogbg pytorch
  priyakasimbeg
  committed
  cfd4ec9
- fix
  priyakasimbeg
  committed
  df20d97
- factor out more array reshaping for pytorch workloads
  priyakasimbeg
  committed
  5f076ac
- factor out sharding from data_utils
  priyakasimbeg
  committed
  e0ed0a2
- fix
  priyakasimbeg
  committed
  26a77e9
- fix pytorch input pipelines
  priyakasimbeg
  committed
  abfa9ee
Commits on Aug 13, 2025
- test fixes
  priyakasimbeg
  committed
  af44acd
- revert step hints for speech workloads
  priyakasimbeg
  committed
  17d69e5
Commits on Aug 15, 2025
- fix imagenet
  priyakasimbeg
  committed
  bb73fef
- fix speech workloads
  priyakasimbeg
  committed
  655e031
- fix wmt
  priyakasimbeg
  committed
  a7403ed
- fix in imagenet_v2 data pipleine
  priyakasimbeg
  committed
  4573499
Commits on Aug 18, 2025
- fix wmt jax
  priyakasimbeg
  committed
  6715342
- fix ogbg pytorch
  priyakasimbeg
  committed
  e0e225d
- fix conformer pytorch
  priyakasimbeg
  committed
  21a196a
Commits on Aug 19, 2025
- fix to ogbg CI test
  priyakasimbeg
  committed
  43d2191
Commits on Aug 21, 2025
Commits on Aug 25, 2025
- dropout torch fix in mnist, cifar
  Niccolo-Ajroldi
  committed
  0761690
- dropout piping in submission: prize quali
  Niccolo-Ajroldi
  committed
  f4c2268
- dropout piping in submission: prize quali
  Niccolo-Ajroldi
  committed
  8210146
- dropout piping in submission: paper baselines
  Niccolo-Ajroldi
  committed
  d5cd811
- dropout minor fixes jax workloads
  Niccolo-Ajroldi
  committed
  751041a
- pipe dropout=0.0 to modeldiff
  Niccolo-Ajroldi
  committed
  034e7a4
- dropout: fix DOCS and spec
  Niccolo-Ajroldi
  committed
  76180d9
- dropout piping dev JAX workloads
  Niccolo-Ajroldi
  committed
  56ab820
- formatting
  Niccolo-Ajroldi
  committed
  816c167
Commits on Aug 26, 2025
- Merge pull request #884 from Niccolo-Ajroldi/dropout_subs_fix
  priyakasimbeg
  authored
  0643268
Commits on Aug 27, 2025
- Merge remote-tracking branch 'upstream/dev' into prepare_v0.6
  fsschneider
  committed
  e02e401
- Full pass tweaking documentation
  fsschneider
  committed
  6f63317
- Add `pmap` to `jit` switch to v0.6
  fsschneider
  committed
  75fdc24
- Fix GitHub math [no ci]
  fsschneider
  authored
  a4e6d3a
Commits on Aug 29, 2025
- Add link to Changelog for details and links to rule change discussions [no CI]
  fsschneider
  authored
  ad26373
- Augment with links to rules change discussion/justifications [no CI]
  fsschneider
  authored
  f7bd572
Commits on Aug 30, 2025
- Merge pull request #876 from fsschneider/prepare_v0.6
  priyakasimbeg
  authored
  484e66c
Commits on Sep 4, 2025
- fix resnet call function signature
  priyakasimbeg
  committed
  74b95fb
- fix criteo1tb
  priyakasimbeg
  committed
  e716ac9
- temporary fix remove dropout from attention layers
  priyakasimbeg
  committed
  d1770c2
- make attention dropout static
  priyakasimbeg
  committed
  01cfbb0
- Merge pull request #886 from mlcommons/dropout_fixes
  priyakasimbeg
  authored
  24d9815
- fix for wmt
  priyakasimbeg
  committed
  9325826
- Merge pull request #887 from mlcommons/dropout_fixes
  priyakasimbeg
  authored
  8642cca
Commits on Sep 5, 2025
- fix for wmt dropout
  priyakasimbeg
  committed
  dfce4ca
- Merge pull request #888 from mlcommons/dropout_fixes
  priyakasimbeg
  authored
  7d8f609

Commits

Commits on Feb 20, 2025

Commits on Feb 21, 2025

Commits on Mar 6, 2025

Commits on Mar 7, 2025

Commits on Mar 8, 2025

Commits on Mar 11, 2025

Commits on Mar 12, 2025

Commits on Mar 18, 2025

Commits on Mar 19, 2025

Commits on Mar 20, 2025

Commits on Apr 1, 2025

Commits on Apr 3, 2025

Commits on Apr 4, 2025

Commits on Apr 5, 2025

Commits on Apr 8, 2025

Commits on Apr 14, 2025

Commits on May 19, 2025

Commits on May 20, 2025

Commits on May 27, 2025

Commits on May 28, 2025

Commits on May 29, 2025

Commits on Jun 4, 2025

Commits on Jun 7, 2025

Commits on Jun 10, 2025

Commits on Jun 12, 2025

Commits on Jun 25, 2025

Commits on Jul 2, 2025

Commits on Jul 3, 2025

Commits on Jul 8, 2025

Commits on Jul 9, 2025