Issues

• schedule-free adamw: Analyze why jax performed better than pytorch on finewebedu workload

  mlcommons/algorithmic-efficiency#925 · Filter by author wyfEmma opened on May 19, 2026

• librispeech deepspeech validation loss differs between pytorch and jax, but wer aligns

  mlcommons/algorithmic-efficiency#924 · Filter by author wyfEmma opened on May 9, 2026
  5

• Anima: live PH monitoring in conversational agent — overfitting detection every 50 interactions

  mlcommons/algorithmic-efficiency#919 · Filter by author dancinlife opened on Mar 25, 2026

• Dual-engine architecture: tension-based confidence yields AUROC=1.0 anomaly detection and AUC=0.925 precognition

  mlcommons/algorithmic-efficiency#918 · Filter by author dancinlife opened on Mar 25, 2026

• Topological overfitting detection: H0 gap catches overfitting before accuracy diverges (r=0.998)

  mlcommons/algorithmic-efficiency#917 · Filter by author dancinlife opened on Mar 25, 2026

• Add step_hint_batch_size property to workloads to allow submissions to know the batch size the baseline defining the step hint used

  mlcommons/algorithmic-efficiency#914 · Filter by author georgedahl opened on Feb 27, 2026

• Cifar dataloader does not work

  Bug

  mlcommons/algorithmic-efficiency#889 · Filter by author davidtweedle opened on Sep 18, 2025
  2

• Add Lion baseline

  ⚡ Submission
  mlcommons/algorithmic-efficiency#879 · Filter by author tfaod opened on Aug 5, 2025
  2

  

• Speech workloads speed regression on JAX

  mlcommons/algorithmic-efficiency#877 · Filter by author priyakasimbeg opened on Jul 15, 2025

• Publish Docker Image to Docker Hub to Support a Wider Set of Contributors

  mlcommons/algorithmic-efficiency#868 · Filter by author Naeemkh opened on Apr 22, 2025

• v2 Self-Tuning Budget for ResNet is Half of Benchmark Schedule-Free Run Time

  mlcommons/algorithmic-efficiency#867 · Filter by author tfaod opened on Apr 19, 2025
  2

• submission_runner_test.py is not included in CI tests

  🧪 Test
  mlcommons/algorithmic-efficiency#865 · Filter by author Naeemkh opened on Apr 17, 2025

• Recalibrate eval time intervals

  mlcommons/algorithmic-efficiency#858 · Filter by author priyakasimbeg opened on Apr 2, 2025

• Optimize Git Hook Configuration

  Good First Issue
  mlcommons/algorithmic-efficiency#853 · Filter by author Naeemkh opened on Mar 13, 2025
  1

• Add schedule-free adamw submission in JAX

  ⚡ Submission
  mlcommons/algorithmic-efficiency#809 · Filter by author priyakasimbeg opened on Oct 31, 2024
  20

  

• Clean up train diff tests

  Good First Issue
  mlcommons/algorithmic-efficiency#808 · Filter by author priyakasimbeg opened on Oct 31, 2024

• Wrong return type in librispeech model_fn

  mlcommons/algorithmic-efficiency#762 · Filter by author Niccolo-Ajroldi opened on May 9, 2024

• Example fails at torch.compile

  mlcommons/algorithmic-efficiency#754 · Filter by author ClashLuke opened on Apr 5, 2024

• Resnet DDP Warning: grad strides do not match bucket view strides

  mlcommons/algorithmic-efficiency#741 · Filter by author Niccolo-Ajroldi opened on Mar 29, 2024
  3

• Incorrect Imagenet evals with pytorch_eval_num_workers > 0

  🐛 Bug🔥 PyTorch
  mlcommons/algorithmic-efficiency#732 · Filter by author priyakasimbeg opened on Mar 27, 2024
  2

• Skip eval on train and test for self-reporting results

  ✨ Feature RequestGood First Issue
  mlcommons/algorithmic-efficiency#725 · Filter by author Niccolo-Ajroldi opened on Mar 26, 2024
  2

• Two copies of criteo_resnet_pytorch exist in .github/workflows/regression_tests_variants.yml

  mlcommons/algorithmic-efficiency#704 · Filter by author tfaod opened on Mar 12, 2024
  1

• LibriSpeech Conformer Workload OOMs or NCCL Errors When Run With Multiple Trials

  🔥 PyTorch
  mlcommons/algorithmic-efficiency#663 · Filter by author hjmshi opened on Feb 29, 2024
  9

• Add tests for scoring code

  mlcommons/algorithmic-efficiency#624 · Filter by author priyakasimbeg opened on Feb 1, 2024

• LM1B: Jax

  ✨ Feature RequestFuture Version
  mlcommons/algorithmic-efficiency#621 · Filter by author dvsaisurya opened on Jan 24, 2024