Skip to content

Releases: yahoo/TensorFlowOnSpark

v2.2.5

21 Apr 20:41
a0f757b
Compare
Choose a tag to compare
  • Allow use with tensorflow-cpu package.
  • Dependency updates
  • Minor fixes.

v2.2.4

25 May 22:25
effa1b6
Compare
Choose a tag to compare
  • Added option to defer releasing temporary socket/port to user map_function for cases where user code may not bind to the assigned port soon enough to avoid other processes binding to the same port, e.g. extensive pre-processing before invoking TF APIs.
  • Updated screwdriver.cd build template.
  • Trigger documentation publish after PyPI push.

v2.2.3

23 Mar 16:46
e4d4780
Compare
Choose a tag to compare
  • Added ability to disable spark barrier execution in TFParallel
  • Updated with spark 3 + scala 2.12 dependencies
  • Fixed documentation build

v2.2.2

18 Dec 21:57
0b38ae2
Compare
Choose a tag to compare
  • Migrated build from travis-ci to screwdriver.cd

v2.2.1

16 Mar 18:59
690b35f
Compare
Choose a tag to compare
  • Added support for port ranges in TFOS_SERVER_PORT environment variable.
  • Updated mnist/keras/mnist_tf.py example with workaround for tensorflow datasets issue.
  • Added more detailed error message for missing executor_id.
  • Added unit tests for gpu allocation variants.

v2.2.0

19 Feb 01:05
df75099
Compare
Choose a tag to compare
  • Added support for Spark 3.0 GPU resources
  • Updated to support Spark 2.4.5
  • Fixed dataset ordering in mnist_inference.py examples (thanks to @qsbao)
  • Added optional environment variables to configure TF server/grpc ports and TensorBoard ports on executors
  • Fixed bug with TFNode.start_cluster_server in backwards-compatibility code for TF1.x
  • Fixed file conflict issue with compat.export_saved_model in TF2.1
  • Removed support for Python 2.x

v2.1.3

22 Jan 17:09
09628a7
Compare
Choose a tag to compare
  • Detect TF version w/o importing to avoid runtime initialization before GPU allocation.

v2.1.2

10 Jan 22:19
12e6595
Compare
Choose a tag to compare
  • Use tf.config.list_physical_devices() to avoid TF runtime initialization.

v2.1.1

09 Jan 23:42
c236511
Compare
Choose a tag to compare
  • added compat.is_gpu_available() method to use:
    • tf.config.list_logical_devices('GPU') (for TF2.1)
    • tf.test.is_cuda_available() (for earlier versions of TF).
  • added ability to launch TensorBoard on chief:0 or master:0 nodes (for small clusters without worker nodes).

v2.1.0

09 Dec 18:38
38b13b9
Compare
Choose a tag to compare
  • Added compat module to manage minor API changes in TensorFlow.
  • Added compatibility for TF2.1.0rc0 (exporting saved_models and configuring auto-shard policy)
  • Re-introduced compatibility for TF1.x (except support for InputMode.TENSORFLOW in the ML Pipeline API).
  • Added TFParallel class for parallelized single-node inferencing via Spark executors.
  • Updated examples for TF API changes.
  • Updated to use module-level loggers.