In the implementation, a random position of the sequence is used to compute the NCE loss. The paper mentions that the GRU output at each step is used to predict 12 timesteps in the future.
"The output of the GRU at every timestep is used as the context c from which we predict 12 timesteps in
the future using the contrastive loss"
Was this decision made to reduce training time?
In the implementation, a random position of the sequence is used to compute the NCE loss. The paper mentions that the GRU output at each step is used to predict 12 timesteps in the future.
"The output of the GRU at every timestep is used as the context c from which we predict 12 timesteps in
the future using the contrastive loss"
Was this decision made to reduce training time?