Release 1.8.6rc0 (#660)

* Release 1.8.6rc0

* Update CHANGELOG.md

* Typo Fix

* Changelog Updated

* tl_logging more readable

* Typo Fixed

* https enforced for badges

* RTD badges pointing to Latest Commit

* Decorators API Refactored

* extra_requires `all`, `all_cpu` and `all_gpu` added

* Error fix

* YAPF Formating Correction

* Test for private method decorator added

* Test Logging Verbosity Fixed to Debug when runned individually

* YAPF corrections applied

* Changelog Added

* Changelog updated

* PR number changed

* Changelog updated

* Update .travis.yml

* Update CONTRIBUTING.md

* Update CONTRIBUTING.md

* Update CHANGELOG.md

Author: Jonathan DEKHTIAR

.gitignore

@@ -18,3 +18,4 @@ tensorlayer/__pycache__
 
 update_tl.bat
 update_tl.py
+.vscode/

.travis.yml

@@ -46,7 +46,7 @@ env:
 
 install:
   - pip install tensorflow==$_TF_VERSION
-  - pip install -e .[db,dev,doc,extra,test]
+  - pip install -e .[all]
 
 script:
   # units test

CHANGELOG.md

@@ -76,9 +76,15 @@ To release a new version, please update the changelog as followed:
   - [Changelog Probot](https://github.com/mikz/probot-changelog) Configuration added (by @DEKHTIARJonathan in #637)
   - Travis Builds now handling a matrix of TF Version from TF==1.6.0 to TF==1.8.0 (by @DEKHTIARJonathan in #644)
   - CircleCI added to build and upload Docker Containers for each PR merged and tag release (by @DEKHTIARJonathan in #648)
-- Docker:
+- Decorator:
+  - `tl.decorators` API created including `deprecated_alias` and `private_method` (by @DEKHTIARJonathan in #660)
+- Docker:  
   - Containers for each release and for each PR merged on master built (by @DEKHTIARJonathan in #648)
-  - Containers built in the following configurations: py2+cpu, py2+gpu, py3+cpu, and py3+gpu (by @DEKHTIARJonathan in #648)
+  - Containers built in the following configurations (by @DEKHTIARJonathan in #648): 
+    - py2 + cpu
+    - py2 + gpu
+    - py3 + cpu
+    - py3 + gpu 
 - Documentation:
   - Release semantic version added on index page (by @DEKHTIARJonathan in #633)
   - Optimizers page added (by @DEKHTIARJonathan in #636)
@@ -87,12 +93,15 @@ To release a new version, please update the changelog as followed:
   - ElementwiseLambdaLayer added to use custom function to connect multiple layer inputs (by @One-sixth in #579)
 - Optimizer:
   - AMSGrad Optimizer added based on `On the Convergence of Adam and Beyond (ICLR 2018)` (by @DEKHTIARJonathan in #636)
+- Setup:
+  - Creation of installation flaggs `all`, `all_cpu`, and `all_gpu` (by @DEKHTIARJonathan in #660)
 - Test:
   - `test_utils_predict.py` added to reproduce and fix issue #288 (by @2wins in #566)
   - `Layer_DeformableConvolution_Test` added to reproduce issue #572 with deformable convolution (by @DEKHTIARJonathan in #573)
   - `Array_Op_Alphas_Test` and `Array_Op_Alphas_Like_Test` added to test `tensorlayer/array_ops.py` file (by @DEKHTIARJonathan in #580)
   - `test_optimizer_amsgrad.py` added to test `AMSGrad` optimizer (by @DEKHTIARJonathan in #636)
   - `test_logging.py` added to insure robustness of the logging API (by @DEKHTIARJonathan in #645)
+  - `test_decorators.py` added (by @DEKHTIARJonathan in #660)
 - Tutorials:
   - `tutorial_tfslim` has been introduced to show how to use `SlimNetsLayer` (by @2wins in #560).
 
@@ -111,6 +120,7 @@ To release a new version, please update the changelog as followed:
 - README.md and other markdown files have been refactored and cleaned. (by @zsdonghao @DEKHTIARJonathan @luomai in #639)
 - Ternary Convolution Layer added in unittest (by @DEKHTIARJonathan in #658)
 - Convolution Layers unittests have been cleaned & refactored (by @DEKHTIARJonathan in #658)
+- All the tests are now using a DEBUG level verbosity when run individualy (by @DEKHTIARJonathan in #660)
 
 ### Deprecated
 
@@ -137,8 +147,84 @@ To release a new version, please update the changelog as followed:
 - Update scikit-image from 0.13.1 to 0.14.0 (by @DEKHTIARJonathan and @pyup-bot in #656)
 
 ### Contributors
-@lgarithm @DEKHTIARJonathan @2wins @One-sixth @zsdonghao
+@lgarithm @DEKHTIARJonathan @2wins @One-sixth @zsdonghao @luomai
 
+## [1.8.6] - 2018-05-30
+
+### Added
+- API:
+  - `tl.alphas` and `tl.alphas_like` added following the tf.ones/zeros and tf.zeros_like/ones_like (by @DEKHTIARJonathan in #580)
+- CI Tool:
+  - [Stale Probot](https://github.com/probot/stale) added to clean stale issues (by @DEKHTIARJonathan in #573)
+  - [Changelog Probot](https://github.com/mikz/probot-changelog) Configuration added (by @DEKHTIARJonathan in #637)
+  - Travis Builds now handling a matrix of TF Version from TF==1.6.0 to TF==1.8.0 (by @DEKHTIARJonathan in #644)
+  - CircleCI added to build and upload Docker Containers for each PR merged and tag release (by @DEKHTIARJonathan in #648)
+- Decorator:
+  - `tl.decorators` API created including `deprecated_alias` and `private_method` (by @DEKHTIARJonathan in #660)
+- Docker: 
+  - Containers for each release and for each PR merged on master built (by @DEKHTIARJonathan in #648)
+  - Containers built in the following configurations (by @DEKHTIARJonathan in #648): 
+    - py2 + cpu
+    - py2 + gpu
+    - py3 + cpu
+    - py3 + gpu 
+- Documentation:
+  - Release semantic version added on index page (by @DEKHTIARJonathan in #633)
+  - Optimizers page added (by @DEKHTIARJonathan in #636)
+  - `AMSGrad` added on Optimizers page added (by @DEKHTIARJonathan in #636)
+- Layer:
+  - ElementwiseLambdaLayer added to use custom function to connect multiple layer inputs (by @One-sixth in #579)
+- Optimizer:
+  - AMSGrad Optimizer added based on `On the Convergence of Adam and Beyond (ICLR 2018)` (by @DEKHTIARJonathan in #636)
+- Setup:
+  - Creation of installation flaggs `all`, `all_cpu`, and `all_gpu` (by @DEKHTIARJonathan in #660)
+- Test:
+  - `test_utils_predict.py` added to reproduce and fix issue #288 (by @2wins in #566)
+  - `Layer_DeformableConvolution_Test` added to reproduce issue #572 with deformable convolution (by @DEKHTIARJonathan in #573)
+  - `Array_Op_Alphas_Test` and `Array_Op_Alphas_Like_Test` added to test `tensorlayer/array_ops.py` file (by @DEKHTIARJonathan in #580)
+  - `test_optimizer_amsgrad.py` added to test `AMSGrad` optimizer (by @DEKHTIARJonathan in #636)
+  - `test_logging.py` added to insure robustness of the logging API (by @DEKHTIARJonathan in #645)
+  - `test_decorators.py` added (by @DEKHTIARJonathan in #660)
+- Tutorials:
+  - `tutorial_tfslim` has been introduced to show how to use `SlimNetsLayer` (by @2wins in #560).
+
+### Changed
+- Tensorflow CPU & GPU dependencies moved to separated requirement files in order to allow PyUP.io to parse them (by @DEKHTIARJonathan in #573)
+- The document of LambdaLayer for linking it with ElementwiseLambdaLayer (by @zsdonghao in #587)
+- RTD links point to stable documentation instead of latest used for development (by @DEKHTIARJonathan in #633)
+- TF Version older than 1.6.0 are officially unsupported and raises an exception (by @DEKHTIARJonathan in #644)
+- Readme Badges Updated with Support Python and Tensorflow Versions (by @DEKHTIARJonathan in #644)
+- TL logging API has been consistent with TF logging API and thread-safe (by @DEKHTIARJonathan in #645)
+- Relative Imports changed for absolute imports (by @DEKHTIARJonathan in #657)
+- `tl.files` refactored into a directory with numerous files (by @DEKHTIARJonathan in #657)
+- `tl.files.voc_dataset` fixed because of original Pascal VOC website was down (by @DEKHTIARJonathan in #657)
+- extra requirements hidden inside the library added in the project requirements (by @DEKHTIARJonathan in #657)
+- requirements files refactored in `requirements/` directory (by @DEKHTIARJonathan in #657)
+- README.md and other markdown files have been refactored and cleaned. (by @zsdonghao @DEKHTIARJonathan @luomai in #639)
+- Ternary Convolution Layer added in unittest (by @DEKHTIARJonathan in #658)
+- Convolution Layers unittests have been cleaned & refactored (by @DEKHTIARJonathan in #658)
+- All the tests are now using a DEBUG level verbosity when run individualy (by @DEKHTIARJonathan in #660)
+
+### Fixed
+- Issue #498 - Deprecation Warning Fix in `tl.layers.RNNLayer` with `inspect` (by @DEKHTIARJonathan in #574)
+- Issue #498 - Deprecation Warning Fix in `tl.files` with truth value of an empty array is ambiguous (by @DEKHTIARJonathan in #575)
+- Issue #565 related to `tl.utils.predict` fixed - `np.hstack` problem in which the results for multiple batches are stacked along `axis=1` (by @2wins in #566)
+- Issue #572 with `tl.layers.DeformableConv2d` fixed (by @DEKHTIARJonathan in #573)
+- Typo of the document of ElementwiseLambdaLayer (by @zsdonghao in #588)
+- Error in `tl.layers.TernaryConv2d` fixed - self.inputs not defined (by @DEKHTIARJonathan in #658)
+- Deprecation warning fixed in `tl.layers.binary._compute_threshold()` (by @DEKHTIARJonathan in #658)
+- All references to `tf.logging` replaced by `tl.logging` (by @DEKHTIARJonathan in #661)
+- Tutorial:
+  - `tutorial_word2vec_basic.py` saving issue #476 fixed (by @DEKHTIARJonathan in #635)
+  - All tutorials tested and errors have been fixed (by @DEKHTIARJonathan in #635)
+
+### Dependencies Update
+- Update pytest from 3.5.1 to 3.6.0 (by @DEKHTIARJonathan and @pyup-bot in #647)
+- Update progressbar2 from 3.37.1 to 3.38.0 (by @DEKHTIARJonathan and @pyup-bot in #651)
+- Update scikit-image from 0.13.1 to 0.14.0 (by @DEKHTIARJonathan and @pyup-bot in #656)
+
+### Contributors
+@lgarithm @DEKHTIARJonathan @2wins @One-sixth @zsdonghao @luomai
 
 ## [1.8.5] - 2018-05-09
 
@@ -179,5 +265,6 @@ To release a new version, please update the changelog as followed:
 ### Contributors
 @zsdonghao @luomai @DEKHTIARJonathan
 
-[Unreleased]: https://github.com/tensorlayer/tensorlayer/compare/1.8.5...master
+[Unreleased]: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc0...master
+[1.8.6]: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc0...1.8.5
 [1.8.5]: https://github.com/tensorlayer/tensorlayer/compare/1.8.4...1.8.5

CONTRIBUTING.md

@@ -41,11 +41,20 @@ source venv/bin/activate
 # Windows:
 venv\Scripts\activate.bat
 
+# ============= IF TENSORFLOW IS ALREADY INSTALLED ============= #
+pip install -e .[all]
+
+# ============= IF TENSORFLOW IS NOT ALREADY INSTALLED ============= #
+
 # for a machine **without** an NVIDIA GPU
 pip install -e .[tf_cpu,db,dev,doc,extra,test]
+# or
+pip install -e .[all_cpu]
 
 # for a machine **with** an NVIDIA GPU
 pip install -e .[tf_gpu,db,dev,doc,extra,test]
+# or
+pip install -e .[all_gpu]
 ```
 
 Launching the unittest:

README.md

@@ -6,14 +6,15 @@
 
 [![Build Status](https://img.shields.io/travis/tensorlayer/tensorlayer.svg?label=Travis&branch=master)](https://travis-ci.org/tensorlayer/tensorlayer)
 [![PyPI version](https://badge.fury.io/py/tensorlayer.svg)](https://pypi.org/project/tensorlayer/)
-[![Github commits (since latest release)](https://img.shields.io/github/commits-since/tensorlayer/tensorlayer/latest.svg)](https://github.com/tensorlayer/tensorlayer/compare/1.8.5...master)
+[![Github commits (since latest release)](https://img.shields.io/github/commits-since/tensorlayer/tensorlayer/latest.svg)](https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc0...master)
 [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/tensorlayer.svg)](https://pypi.org/project/tensorlayer/)
 [![Supported TF Version](https://img.shields.io/badge/tensorflow-1.6.0+-blue.svg)](https://github.com/tensorflow/tensorflow/releases)
 [![Codacy Badge](https://api.codacy.com/project/badge/Grade/ca2a29ddcf7445588beff50bee5406d9)](https://app.codacy.com/app/tensorlayer/tensorlayer)
 
 [![CircleCI](https://img.shields.io/circleci/project/github/tensorlayer/tensorlayer.svg?label=Docker%20Build&branch=master)](https://circleci.com/gh/tensorlayer/tensorlayer/tree/master)
 [![Docker Pulls](https://img.shields.io/docker/pulls/tensorlayer/tensorlayer.svg?maxAge=604800)](https://hub.docker.com/r/tensorlayer/tensorlayer/)
-[![Documentation Status](https://img.shields.io/readthedocs/tensorlayer/stable.svg?label=ReadTheDocs)](https://tensorlayer.readthedocs.io/)
+[![Documentation Status](https://img.shields.io/readthedocs/tensorlayer/latest.svg?label=ReadTheDocs-EN)](https://tensorlayer.readthedocs.io/)
+[![Documentation Status](https://img.shields.io/readthedocs/tensorlayercn/latest.svg?label=ReadTheDocs-CN)](https://tensorlayercn.readthedocs.io/)
 [![PyUP Updates](https://pyup.io/repos/github/tensorlayer/tensorlayer/shield.svg)](https://pyup.io/repos/github/tensorlayer/tensorlayer/)
 [![Gitter](https://badges.gitter.im/Join%20Chat.svg)](https://gitter.im/tensorlayer/Lobby)
 
@@ -28,9 +29,9 @@
 <br/>
 
 [![Mentioned in Awesome TensorLayer](https://awesome.re/mentioned-badge.svg)](https://github.com/tensorlayer/awesome-tensorlayer)
-[![English Documentation](http://img.shields.io/badge/documentation-enlish-blue.svg)](https://tensorlayer.readthedocs.io/)
-[![Chinese Documentation](http://img.shields.io/badge/documentation-中文-blue.svg)](https://tensorlayercn.readthedocs.io/)
-[![Chinese Book](http://img.shields.io/badge/book-中文-blue.svg)](http://www.broadview.com.cn/book/5059/)
+[![English Documentation](https://img.shields.io/badge/documentation-english-blue.svg)](https://tensorlayer.readthedocs.io/)
+[![Chinese Documentation](https://img.shields.io/badge/documentation-中文-blue.svg)](https://tensorlayercn.readthedocs.io/)
+[![Chinese Book](https://img.shields.io/badge/book-中文-blue.svg)](http://www.broadview.com.cn/book/5059/)
 
 TensorLayer is a deep learning and reinforcement learning library on top of [TensorFlow](https://www.tensorflow.org). It provides rich neural layers and utility functions to help researchers and engineers build real-world AI applications. TensorLayer is awarded the 2017 Best Open Source Software by the prestigious [ACM Multimedia Society](http://www.acmmm.org/2017/mm-2017-awardees/).
 
@@ -42,7 +43,7 @@ As TensorFlow users, we have been looking for a library that can serve for vario
  phases. This library is easy for beginners by providing rich neural network implementations,
 examples and tutorials. Later, its APIs shall naturally allow users to leverage the powerful
 features of TensorFlow, exhibiting best performance in addressing real-world problems. In the
-end, the extra abstraction shall not compromise TensorFlow performance, and thus suit for 
+end, the extra abstraction shall not compromise TensorFlow performance, and thus suit for
 production deployment. TensorLayer is a novel library that aims to satisfy these requirements.
 
 It has three key features:
@@ -66,15 +67,15 @@ on a Titan X Pascal GPU.
 
 Similar to TensorLayer, Keras and TFLearn are also popular TensorFlow wrapper libraries.
 These libraries are comfortable to start with. They provide high-level abstractions;
-but mask the underlying engine from users. It is thus hard to customize model behaviors 
-and touch the essential features of TensorFlow. 
+but mask the underlying engine from users. It is thus hard to customize model behaviors
+and touch the essential features of TensorFlow.
 
 Without compromise in simplicity, TensorLayer APIs are generally more flexible and transparent.
 Users often find it easy to start with the examples and tutorials of TensorLayer, and then dive
 into the TensorFlow low-level APIs only if need. TensorLayer does not create library lock-in. Users can easily import models from Keras, TFSlim and TFLearn into a TensorLayer environment.
 
 TensorLayer has a fast growing usage in academic and industry organizations. It is used by researchers from
-Imperial College London, Carnegie Mellon University, Stanford University, 
+Imperial College London, Carnegie Mellon University, Stanford University,
 University of Technology of Compiegne (UTC), Tsinghua University, UCLA,
 and etc., as well as engineers from Google, Microsoft, Alibaba, Tencent, Xiaomi, Penguins Innovate, Bloomberg and many others.
 

README.rst

@@ -5,24 +5,24 @@
            <img src="img/tl_transparent_logo.png" width="50%" height="30%"/>
        </div>
    </a>
-   
+
 .. image:: https://img.shields.io/travis/tensorlayer/tensorlayer.svg?label=Travis&branch=master
     :target: https://travis-ci.org/tensorlayer/tensorlayer
-   
+
 .. image:: https://badge.fury.io/py/tensorlayer.svg
     :target: https://pypi.org/project/tensorlayer/
-   
+
 .. image:: https://img.shields.io/github/commits-since/tensorlayer/tensorlayer/latest.svg
-    :target: https://github.com/tensorlayer/tensorlayer/compare/1.8.5...master
-   
+    :target: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc0...master
+
 .. image:: https://img.shields.io/pypi/pyversions/tensorlayer.svg
     :target: https://pypi.org/project/tensorlayer/
-   
+
 .. image:: https://img.shields.io/badge/tensorflow-1.6.0+-blue.svg
     :target: https://github.com/tensorflow/tensorflow/releases
-   
+
 .. image:: https://api.codacy.com/project/badge/Grade/ca2a29ddcf7445588beff50bee5406d9
-    :target: https://app.codacy.com/app/tensorlayer/tensorlayer 
+    :target: https://app.codacy.com/app/tensorlayer/tensorlayer
 
 .. raw:: html
 
@@ -36,9 +36,12 @@
 .. image:: https://img.shields.io/docker/pulls/tensorlayer/tensorlayer.svg?maxAge=604800
     :target: https://hub.docker.com/r/tensorlayer/tensorlayer/
 
-.. image:: https://img.shields.io/readthedocs/tensorlayer/stable.svg?label=ReadTheDocs
+.. image:: https://img.shields.io/readthedocs/tensorlayer/latest.svg?label=ReadTheDocs-EN
     :target: https://tensorlayer.readthedocs.io/
 
+.. image:: https://img.shields.io/readthedocs/tensorlayercn/latest.svg?label=ReadTheDocs-CN
+    :target: https://tensorlayercn.readthedocs.io/
+
 .. image:: https://pyup.io/repos/github/tensorlayer/tensorlayer/shield.svg
     :target: https://pyup.io/repos/github/tensorlayer/tensorlayer/
 
@@ -61,14 +64,14 @@
 
 .. image:: https://awesome.re/mentioned-badge.svg
     :target: https://github.com/tensorlayer/awesome-tensorlayer
-    
-.. image:: http://img.shields.io/badge/documentation-enlish-blue.svg
+
+.. image:: https://img.shields.io/badge/documentation-english-blue.svg
     :target: https://tensorlayer.readthedocs.io/
-    
-.. image:: http://img.shields.io/badge/documentation-中文-blue.svg
+
+.. image:: https://img.shields.io/badge/documentation-中文-blue.svg
     :target: https://tensorlayercn.readthedocs.io/
-    
-.. image:: http://img.shields.io/badge/book-中文-blue.svg
+
+.. image:: https://img.shields.io/badge/book-中文-blue.svg
     :target: http://www.broadview.com.cn/book/5059/
 
 TensorLayer is a deep learning and reinforcement learning library on top

setup.py

@@ -68,6 +68,10 @@ def req_file(filename, folder="requirements"):
 	'test': req_file("requirements_test.txt")
 }
 
+extras_require['all'] = sum([extras_require.get(key) for key in ['db', 'dev', 'doc', 'extra', 'test']], list())
+extras_require['all_cpu'] = sum([extras_require.get(key) for key in ['all', 'tf_cpu']], list())
+extras_require['all_gpu'] = sum([extras_require.get(key) for key in ['db', 'tf_gpu']], list())
+
 # Readthedocs requires TF 1.5.0 to build properly
 if os.environ.get('READTHEDOCS', None) == 'True':
     install_requires.append("tensorflow==1.5.0")

tensorlayer/__init__.py

@@ -27,6 +27,7 @@
     from . import activation
     from . import array_ops
     from . import cost
+    from . import decorators
     from . import distributed
     from . import files
     from . import iterate
@@ -52,7 +53,7 @@
     global_dict = {}
 
 # Use the following formating: (major, minor, patch, prerelease)
-VERSION = (1, 8, 5)
+VERSION = (1, 8, 6, "rc0")
 __shortversion__ = '.'.join(map(str, VERSION[:3]))
 __version__ = '.'.join(map(str, VERSION[:3])) + "".join(VERSION[3:])
 

tensorlayer/decorators/__init__.py

@@ -0,0 +1,13 @@
+"""
+TensorLayer provides rich layer implementations trailed for
+various benchmarks and domain-specific problems. In addition, we also
+support transparent access to native TensorFlow parameters.
+For example, we provide not only layers for local response normalization, but also
+layers that allow user to apply ``tf.nn.lrn`` on ``network.outputs``.
+More functions can be found in `TensorFlow API <https://www.tensorflow.org/versions/master/api_docs/index.html>`__.
+"""
+
+from .deprecation import deprecated_alias
+from .private_method import private_method
+
+__all__ = ['deprecated_alias', 'private_method']

tensorlayer/deprecation.py renamed to tensorlayer/decorators/deprecation.py

@@ -4,7 +4,7 @@
 import functools
 import warnings
 
-from . import tl_logging as logging
+from tensorlayer import tl_logging as logging
 
 
 def deprecated_alias(end_support_version, **aliases):