Workflow Element Store

  1. Feature Extraction from Images
  2. Domain-Specific Feature Engineering
  3. Auto-Preprocessing libraries
  4. Interaction Features
  5. Time-Based Features
  6. Feature Selection
  7. Handling Time-Series Data
  8. Polynomial Features
  9. AutoEDA libraries
  10. Dimensionality Reduction
  11. Handling Missing Data
  12. Data Partitioning - Train, Validation, & Test
  13. Data Transformations
  14. Data Scaling and Normalization
  15. Handling Categorical Data
  16. Handling Imbalanced Classes
  17. Binning / Discretization
  18. Annotation
  19. Textual Feature Extraction
  20. Augmentation
  21. Dealing with Outliers
  22. Handling Noisy Data
  1. Model Comparison
  2. Network Analytics/ GeoSpatial Analytics
  3. Forecasting Techniques
  4. Transfer Learning
  5. Word Embeddings
  6. Weight Initialization
  7. GridSearchCV, RandomisedSearchCV, BayesianSearchCV
  8. AutoML
  9. Batch Size Selection
  10. Reinforcement Learning
  11. Evaluation Metrics
  12. Model Interpretability
  13. Regularization Techniques
  14. Regularization
  15. Binary Classification Techniques
  16. Blackbox - Neural Network Models
  17. Hyperparameter Tuning
  18. Batch Normalization
  19. External Validation
  20. Cross-Validation
  21. Clustering
  22. Regular Monitoring and Logging
  23. Early Stopping
  24. Regression Analysis
  25. Cross-Validation
  26. Transfer Learning
  27. Multiclass Classification Techniques
  28. Recommendation Engine
  29. Learning Rate Scheduling
  30. Data Augmentation
  31. Natural Language Processing
  32. Performance Visualization
  33. Association Rules
  34. Ensemble Techniques
  1. Github Actions
  2. Datawarehouse
  3. code repository
  4. Github
  5. Evidently.ai
  6. model registry
  7. Apache Airflow
  8. Data Preprocessing pipeline models
  9. Databases
  10. Kafka Brokers
ML Workflow Advanced - Architecture
  • Element belongs to model
  • Element not belongs to model
Data Sources

Data Sources

Streaming Data

Streaming Data

Batch Data

Batch Data

Cloud Storage

Cloud Storage

Labeled Data

Labeled Data

Feature Engineering Pipeline

Feature Engineering Pipeline

Experimentation

Experimentation

ML Model

ML Model

Repository

Repository

CI/CD component

Continuous integration/Continuous delivery

Continuous deployment

Artifact Store

Feature Store System

Orchestration Component

Artifact Store

CI/CD Component

Scheduler

Workflow orchestration component

Automation ML Workflow Pipeline

Automation ML Workflow Pipeline

Monitoring Component

Monitoring Component

Model serving component

(Prediction on new batch or streaming data)