The Masterful AutoML Platform¶
Masterful is an AutoML platform for data and training of deep learning models. It improves your model’s accuracy - without the need for more labels - through robust implementations of semi-supervised learning, synthetic data, drop-in architectural optimizations, and metalearning techniques. These techniques are accessible individually through the Advanced API, but to further reduce the effort required to manually tune and experiment with techniques, Masterful provides the autofit algorithm. Autofit metalearns the optimal combination of techniques so that ML developers don’t need to run a manual grid search on hyperparameters.
The platform supports most types of classification, detection, and segmentation, and includes data translation layers for many standard ground truth data formats. It also supports anchor box formats from several open source detection models, including Google Object Detection API.
The entire platform is optimized for speed, with nearly every operation pushed to the GPU. The platform is currently available for Tensorflow, with PyTorch support coming soon.
Masterful is built on top of Tensorflow and Keras (PyTorch support coming soon).
API that metalearns training and regularization policies (and some drop-in architectural choices). Built on Keras.
Keras / Pytorch Lightning
API that simplifies model architecture via deep neural network primitives like convolutions, rather than Tensorflow’s scientific computing primitives.
Tensorflow / PyTorch
API that simplifies the creation and compilation of vectorized scentific computing.
API that allows low level access to GPUs for scientific computing rather than computer graphics.
Underlying hardware to perform vectorized matrix math, useful for both computer graphics and neural networks.
Masterful provides a new API, built on top of Keras (PyTorch coming soon) to focus on an ML developer’s twin goals of training: maximum speed and maximum accuracy. This solves a common source of confusion working with deep learning frameworks: they are primarily designed to make it easy to build complex architectures. This was appropriate when advancements in architectures drove most of the state of the art improvements, but today data and training are far more relevant. For example, consider regularization. Using Keras directly, regularization might occur at the tf.data.Dataset object via map calls to image transforms; within the tf.keras.Model via dropout layers or kernel regularizers; or at the optimizer level via tfa.SGDW’s decoupled weight decay. By contrast, in the Masterful API, regularization is automatically metalearned as part of autofit.
The data prep and fundamental architecture design phases are inputs to Masterful. Masterful delivers a trained model, which is the input to the deployment and monitoring phases.
The rest of the documentation is organized into these sections:
Code examples to get started.
Code examples for advanced use cases.
The thinking behind Masterful.
- API Reference:
Documenting the classes, methods, and functions.
Frequently Asked Questions
- Release Notes:
Changes in each release.
- API Reference: Autofit
- API Reference: Spec
- API Reference: Advanced
- API Reference: Policies
- Frequently Asked Questions
- How does Masterful fit into my training workflow?
- Where do I run Masterful?
- What are the minimum system requirements to run Masterful?
- Are there versions of Masterful other than Python?
- What machine learning use cases does Masterful support?
- What machine learning frameworks does Masterful support?
- Do I use my own model, or do you pick an architecture for me?
- How can I see what Masterful is doing to my data and model?
- What data types does Masterful support?
- How long does Masterful’s analyze phase take to run?
- When do I use autofit, and when should I use advanced functions on their own?
- Does Masterful slow down my training loop?
- How much labeled data do I need to get started?
- How much unlabeled data do I need to get started?
- When should I use ensembling?
- When should I distill a model?
- Does my model need a minimum level of performance in order to see benefits from Masterful?
- How does Masterful relate to CUDA, Tensorflow, PyTorch, Keras, and AutoML?
- Frequently Asked Questions