Workflow Element Store

  1. Auto-Preprocessing libraries
  2. Feature Extraction from Images
  3. Dimensionality Reduction
  4. Domain-Specific Feature Engineering
  5. Textual Feature Extraction
  6. Dealing with Outliers
  7. Annotation
  8. Handling Imbalanced Classes
  9. Handling Missing Data
  10. Binning / Discretization
  11. Handling Time-Series Data
  12. Handling Categorical Data
  13. Polynomial Features
  14. Time-Based Features
  15. Interaction Features
  16. Feature Selection
  17. Augmentation
  18. Handling Noisy Data
  19. AutoEDA libraries
  20. Data Scaling and Normalization
  21. Data Transformations
  22. Data Partitioning - Train, Validation, & Test
  1. Model Comparison
  2. Cross-Validation
  3. Transfer Learning
  4. Binary Classification Techniques
  5. Clustering
  6. Weight Initialization
  7. Recommendation Engine
  8. Learning Rate Scheduling
  9. Batch Size Selection
  10. Model Interpretability
  11. Reinforcement Learning
  12. Early Stopping
  13. GridSearchCV, RandomisedSearchCV, BayesianSearchCV
  14. Association Rules
  15. Forecasting Techniques
  16. Word Embeddings
  17. Ensemble Techniques
  18. External Validation
  19. Transfer Learning
  20. Evaluation Metrics
  21. Regular Monitoring and Logging
  22. Natural Language Processing
  23. Regularization
  24. Cross-Validation
  25. Regularization Techniques
  26. Multiclass Classification Techniques
  27. Data Augmentation
  28. Network Analytics/ GeoSpatial Analytics
  29. Batch Normalization
  30. Hyperparameter Tuning
  31. Performance Visualization
  32. Blackbox - Neural Network Models
  33. AutoML
  34. Regression Analysis
  1. Databases
  2. Github Actions
  3. Data Preprocessing pipeline models
  4. code repository
  5. Github
  6. Apache Airflow
  7. Datawarehouse
  8. Evidently.ai
  9. Kafka Brokers
  10. model registry
ML Workflow - Architecture
  • Element belongs to model
  • Element not belongs to model
Validate Export

Data Sources

Streaming Data

Batch Data

Cloud Storage

Labeled Data

Feature Engineering Pipeline

Experimentation

ML Model

Repository

CI/CD component

Continuous integration/Continuous delivery

Continuous deployment

Artifact Store

Feature Store System

Orchestration Component

Artifact Store

CI/CD Component

Scheduler

Workflow orchestration component

Automation ML Workflow Pipeline

Monitoring Component

Model serving component

(Prediction on new batch or streaming data)