I keep forgetting the exact formulation of `binary_cross_entropy_with_logits` in pytorch. So write this down for future reference. The function binary_cross_entropy_with_logits takes as two kinds of inputs: (1) the value right before the probability transformation (softmax) layer, whose range is (-infinity, +infinity); (2) the target, whose values are binary binary_cross_entropy_with_logits calculates the following loss (i.e., negative …
Monthly Archives: July 2019
mujoco only works with gcc8
pip install mujoco-py would only build with gcc8. On Mac, use ll /usr/local/Cellar/gcc* to find all gcc versions you have installed. Uninstall them and only install gcc@8. Another time I saw the following error when using pip install mujoco-py: This error is suspected to be due to a corrupted gcc@8. I solved this by using …
Notes for “Defensive Quantization: When Efficiency Meets Robustness”
I have been reading “Defensive Quantization: When Efficiency Meets Robustness” recently. Neural network quantization is a brand-new topic to me so I am writing some notes down for learning. The first introduction I read is [1], from which I learn that the term “quantization” generally refers to reducing the memory usage of model weights by …
Continue reading “Notes for “Defensive Quantization: When Efficiency Meets Robustness””