There is no clean way to tie weights of two Fully Connected layers. The request is to extend the Fully Connected layer to allow construction with a TensorFlow variable as its weight matrix, enabling weight tying.
**This issue is to track progress on new features for the Fully Connected Weight Tying** At the moment there is no clean way of tying the weights of two Fully Connected layers. One must define them manually to be able to do so. The solution would be the ability to instantiate a Fully Connected layer given a Tensorflow variable for its weights. - [ ] Extend the Fully Connected layer to have the option of being constructed with a Variable as its weight matrix - [ ] Create a simple test where a pair of tied layers are being trained for a few batches and then their weights are being checked