Distributed Tensorflow is mainly a part of the "regular" Tensorflow, that occupies its very own subdirectory within itself. "The ...