Hi, thanks for clarifying the difference between Variable and Parameter in this thread.
It might be slightly off the topic, but I have a question about the codes used in here.
The very first code written by rasbt, which implemented OLS regression manually using only Variable, looks perfectly fine to me, and I got exactly same output. However, the loss is not monotonically decreasing for some unknown reason. Am I missing something?
By the way, by replaced Variable used in the second code by rasbt to Parameter, the loss decreases monotonically as usual.
I put the result of the code execution under this link 46 (Jupyter Notebook posted in the gist).