Issues

• Does load-balanced loss help the loss converge？

  tensorflow/mesh#391 · Filter by author mathfinder opened on Jun 13, 2023

• When running BERT on GPU: Resource exhausted: failed to allocate memory

  tensorflow/mesh#383 · Filter by author Currycurrycurry opened on Sep 11, 2022
  1

• Getting "NanLossDuringTrainingError: NaN loss during training."

  tensorflow/mesh#379 · Filter by author dhruval-p opened on Apr 17, 2022

• mask_1_flat and mask_2_flat applied to gates twice?

  tensorflow/mesh#378 · Filter by author marhlder opened on Mar 31, 2022

• About the mixture of expert model

  tensorflow/mesh#369 · Filter by author fym0503 opened on Dec 19, 2021

• Mesh-tf model conversion to onnx?

  tensorflow/mesh#368 · Filter by author b-analyst opened on Nov 14, 2021
  2

• How to freeze embedding layers

  tensorflow/mesh#364 · Filter by author lintangsutawika opened on Oct 8, 2021

• Beam search

  tensorflow/mesh#362 · Filter by author antonio-mastropaolo opened on Oct 6, 2021

• Ability to add Custom Tensorflow Hooks

  tensorflow/mesh#352 · Filter by author trisongz opened on Aug 17, 2021

• [MOE-transformer] How do you build static graph of MOE-Model?

  tensorflow/mesh#330 · Filter by author imyzx2017 opened on Jun 25, 2021

• How to use tf.contrib.opt.ScipyOptimizerInterface or tfp.optimizer.lbfgs_minimize with MeshTF ?

  tensorflow/mesh#328 · Filter by author harshil-patel-code opened on Jun 14, 2021

• How to assign values to specific slice of a data block on a specific GPU?

  tensorflow/mesh#324 · Filter by author harshil-patel-code opened on Jun 3, 2021

• performing the opposite of mtf.lowering

  tensorflow/mesh#318 · Filter by author DavidPeleg6 opened on May 4, 2021
  1

• [Wrong Code Comments] In moe.py, there are two wrong code comments

  tensorflow/mesh#305 · Filter by author xiaodathereal opened on Mar 25, 2021

• OpenNMT-tf

  tensorflow/mesh#280 · Filter by author vvjn opened on Jan 27, 2021

• Tensorflow Mesh needs documentation. Will this be provided anytime soon?

  tensorflow/mesh#276 · Filter by author shyamalschandra opened on Jan 14, 2021
  1

• error when learning_rate_schedule is a callable

  tensorflow/mesh#265 · Filter by author marton-avrios opened on Dec 17, 2020

• different target score when using logits from sample_autoregressive

  tensorflow/mesh#262 · Filter by author marton-avrios opened on Dec 14, 2020

• bias in selfAttention

  tensorflow/mesh#253 · Filter by author wintersurvival opened on Dec 3, 2020

• AttributeError: module 'mesh_tensorflow' has no attribute 'auto_mtf'

  tensorflow/mesh#247 · Filter by author zaccharieramzi opened on Nov 20, 2020
  4

• Does this supports tf 2 keras API?

  tensorflow/mesh#239 · Filter by author GF-Huang opened on Nov 14, 2020

• Debug in mesh Tensorflow

  tensorflow/mesh#235 · Filter by author patrickvonplaten opened on Nov 11, 2020
  3

• Predict vs Eval functionality

  tensorflow/mesh#223 · Filter by author bhavanadalvi opened on Oct 28, 2020

• Mesh tensorflow support for multi-node

  tensorflow/mesh#201 · Filter by author assij opened on Oct 6, 2020
  5

• Future of this project?

  tensorflow/mesh#181 · Filter by author Mistobaan opened on Sep 8, 2020
  2