Thanks for making this nice recap of the hart of AI the optimizers!
I have a question regarding the SLS method can you implement something similar to Adam so without the Closure part ?
It would be nice to have a generic method compatible with classical optimizers in pytorch.
Another related question: is it so good like the paper claim ?
Thanks for making this nice recap of the hart of AI the optimizers!
I have a question regarding the SLS method can you implement something similar to Adam so without the Closure part ?
It would be nice to have a generic method compatible with classical optimizers in pytorch.
Another related question: is it so good like the paper claim ?