VPItoolkit™ ML Framework - Overview

The VPItoolkit ML Framework is a versatile addition to the simulation tools within the VPIphotonics Design Suite, enabling the implementation and design of deep neural networks (DNNs), recurrent neural networks (RNNs), and machine learning (ML) clustering techniques for a wide range of applications. These include equalization and nonlinearity mitigation in optical transmission systems, characterization, evaluation, optimization, and inverse design of photonic devices, as well as monitoring and optimization of network performance.


The VPItoolkit ML Framework offers a powerful set of capabilities that empower users to easily deploy custom-made ML algorithms. In addition to this flexibility, the framework provides a ready-to-use, open-source, Python-based ML solution with an intuitive, easy-to-use interface. This allows users to manipulate model parameters and convergence constraints with ease. The framework seamlessly integrates JupyterLab, providing users with a Cosimulation interface. This enables a streamlined workflow for prototyping and experimentation, allowing users to develop and test their ML models directly within the VPIphotonics simulation environment.


The framework is designed to enable users to build predictive models that can operate effectively in the presence of uncertainty. This is achieved by leveraging known training data sets, which are used to train neural networks models or other custom-made supervised ML models. In addition to the neural network capabilities, the framework also supports ML clustering. Unsupervised learning allow users to identify patterns and groupings within their data, without the need for predefined labels or target variables. This can be particularly useful for tasks such as enhanced equalization of optical systems, network optimization or anomaly detection, where the underlying relationships in the data may not be fully known a priori.



Start an evaluation!

Seamless manipulation of digital, electrical and optical signals is feasible, using the framework's flexible Data Extractors and Model Loaders. By providing users with an easy-to-use interface to access and adjust the hyperparameters of the ML algorithms, it becomes possible to quickly optimize and enhance the performance of the models.


VPItoolkit ML Framework supports the storage of large, complex, heterogeneous data in an open-source file format (Hierarchical Data Format version 5, HDF5). It also includes the capability to leverage TensorBoard, a popular visualization tool, to monitor and analyze the training process of ML models. This allows users to gain deeper insights into the performance and behavior of their models during the training phase. Additionally, the toolkit provides automated, intuitive, and flexible tools for inspecting the contents of training data files. This simplifies the analysis and visualization of the data, allowing users to gain deeper insights and better understand the characteristics of their inputs.


VPItoolkit ML Framework
 

Applications

  • Enhanced DSP equalization

  • Fiber nonlinearity compensation

  • Design and characterization of optical filters

  • Component requirements definition

  • Optimization of system parameters

  • Optical performance monitoring

  • Polarization tracking or phase recovery in quantum communications

  • Quality of transmission estimation

Benefits

  • Easy collection of training data sets

  • Seamless manipulation of digital, electrical & optical signals

  • On-the-fly hybrid DSP / ML simulations

  • Easy access of DNN hyperparameters

  • Storage of large-size, complex data

Design Examples

DNN model to predict the behaviour of a two-stage EDFA with four inputs & example of training process monitoring using TensorBoard


VPItoolkit MLF - EDFA with TensorBoard


[1] I. Aldaya, E. Giacoumidis, A. Tsokanos, M. Jarajreh, Y. Wen, J. Wei, G. Campuzano, M. L. F. Abbade, and L. P. Barry "Compensation of nonlinear distortion in coherent optical OFDM systems using a MIMO deep neural network-based equalizer"", Opt. Lett, vol. 45, no. 20, pp. 5820-5823, 2020.
[2] F. da Ros, U. C. de Moura, and M. P. Yankov, "Machine learning-based EDFA Gain Model Generalizable to Multiple Physical Devices", in Proc. ECOC, Brussels, Belgium, 2020.

DNN vs. K-means clustering for enhanced equalization of a 40 GBaud 16QAM channel


VPItoolkit MLF - DNN Cluster


[1] E. Giacoumidis, Y. Lin, J. Wei, I. Aldaya, A. Tsokanos, and L. P. Barry, "Harnessing machine learning for fiber-induced nonlinearity mitigation in long-haul coherent optical OFDM", MDPI Future Internet, vol. 11, no. 1 (2), 2019.