Memory Management In Deep Learning
Memory management in big data processing is a critial issue, especially in deep learning where there might be billions of parameters in one model.
Review on Training Deep Nets with Sublinear Memory Cost
Source: This is an arXiv paper published by Tianqi Chen on 22 Apr, 2016.
A easy to understand the basic idea of this paper is on