Currently, users must modify each application to implement gradient clipping. The request is to embed gradient clipping into the base application with a 'process_gradients' method, allowing users to select the clipping type.
**This issue is to track progress on new features for embedding gradient clipping into the base application** At the moment if somebody wants to do gradient clipping they need to modify each application. The solution is to create a new method in the base application that is being called to processes the gradient before they are being applied. - [ ] Extend the base application with a process_gradients method - [ ] Implement the processing allowing the user to select which type of gradient clipping they desire - [ ] Create tests to see if the gradient clipping works and stabilizes the network