Issues

• Why do I find inconsistencies between the output of my ALBERT model converted to ONNX format and tested with ONNX Runtime, compared to the original PyTorch format model?

  google-research/albert#277 · Filter by author Orient12 opened on Dec 22, 2023

• Load in Browser Tensorflow

  google-research/albert#276 · Filter by author sysmaya opened on Jul 2, 2023

• The results can't be reproduced

  google-research/albert#269 · Filter by author kavin525zhang opened on Jul 29, 2022
  2

• Difference between v1 and v2 for xxlarge

  google-research/albert#266 · Filter by author yanaiela opened on Jun 12, 2022

• when training in Race , The eval_accuracy is flat , it only has three numbers which are 0.0, 0.33334, 0.66667, 1.0

  google-research/albert#264 · Filter by author AGuangzzz opened on May 25, 2022

• How to get the test embeddings from output of fine-tuned model (tutorial)

  google-research/albert#260 · Filter by author kelseyneis opened on Mar 7, 2022

• Default Tutorial Not Working - Can't download MRPC data

  google-research/albert#257 · Filter by author Jadiker opened on Feb 6, 2022
  2

• Probable error on line 306 in create_pretraining_data.py for albert

  google-research/albert#256 · Filter by author wjdghks950 opened on Jan 18, 2022

• which word segmentation tool is used for pretraining Chinese ALBERT

  google-research/albert#250 · Filter by author bojone opened on Nov 7, 2021

• Discrepancy in tokenization results using albert's tokenizer and sentencepiece library

  google-research/albert#249 · Filter by author anjali-chadha opened on Oct 18, 2021

• fine tune on my own English dataset

  google-research/albert#248 · Filter by author cxx-cindy opened on Sep 11, 2021

• albert base fine-tuned on squad2.0 gets stuck in loop when predicting on new file

  google-research/albert#243 · Filter by author alexander-fichtl opened on Mar 29, 2021
  1

• The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.

  google-research/albert#242 · Filter by author guotong1988 opened on Mar 23, 2021

• torch.nn.modules.module.ModuleAttributeError: 'AlbertEmbeddings' object has no attribute 'bias'

  google-research/albert#241 · Filter by author dhs29 opened on Mar 17, 2021
  1

• The output of the features of a given text consists of two tensor. Are they both the deep features?

  google-research/albert#240 · Filter by author FriedaSmith opened on Mar 17, 2021

• Where to download "all.txt" to train the sentencepiece?

  google-research/albert#238 · Filter by author YuHengKit opened on Dec 19, 2020

• where to download the "spm_model_file" called "30k-clean.model"

  google-research/albert#237 · Filter by author Sarah-Callies opened on Dec 9, 2020

• Could you provide the training hyper paras

  google-research/albert#235 · Filter by author juyiming opened on Nov 10, 2020
  1

• [Implementation] Sentence order prediction (SOP) label for a single-chunk-document in create_pretraining_data.py

  google-research/albert#234 · Filter by author joongbo opened on Oct 26, 2020

• albert_base可以使用多块GPU同时训练么

  google-research/albert#233 · Filter by author Yaaasuo opened on Oct 17, 2020

• ValueError: Expected input batch_size (864) to match target batch_size (32).

  google-research/albert#232 · Filter by author abhibha1807 opened on Sep 30, 2020

• [Problem/ Squad V2] the result is too low compare with the F1 score in paper, Is something wrong?

  google-research/albert#230 · Filter by author Gs-Zhang opened on Sep 22, 2020
  7

• Can ALBERT's parameter sharing concept be used in image-GPT paper implementation?

  google-research/albert#229 · Filter by author spygaurad opened on Sep 17, 2020

• Finetune with multiple GPU

  google-research/albert#228 · Filter by author ReyonRen opened on Sep 11, 2020

• Error creating and exporting TFLite after fine-tuning (using run_squad_v1.py/run_squad_v2.py)

  google-research/albert#227 · Filter by author manojpreveen opened on Aug 19, 2020
  2