A review of entropy, conditional entropy, and mutual information, with the basic proofs. I then set up how I plan to use mutual information to relate spatial mappings between cortical regions to their temporal coupling.
A loss term that penalizes predicting cortical labels that aren't adjacent to the true label. Implemented in PyTorch and DGL and used as a regularizer alongside standard cross-entropy.