Workflow Element Store

  1. Handling Noisy Data
  2. Interaction Features
  3. Auto-Preprocessing libraries
  4. Annotation
  5. Textual Feature Extraction
  6. Data Transformations
  7. Feature Extraction from Images
  8. Handling Categorical Data
  9. Binning / Discretization
  10. Dealing with Outliers
  11. Domain-Specific Feature Engineering
  12. Data Scaling and Normalization
  13. Time-Based Features
  14. Augmentation
  15. Polynomial Features
  16. Data Partitioning - Train, Validation, & Test
  17. Feature Selection
  18. Handling Imbalanced Classes
  19. AutoEDA libraries
  20. Handling Time-Series Data
  21. Dimensionality Reduction
  22. Handling Missing Data
  1. Weight Initialization
  2. Recommendation Engine
  3. Model Comparison
  4. Data Augmentation
  5. Forecasting Techniques
  6. Network Analytics/ GeoSpatial Analytics
  7. AutoML
  8. Clustering
  9. Regularization
  10. Reinforcement Learning
  11. Ensemble Techniques
  12. Hyperparameter Tuning
  13. Learning Rate Scheduling
  14. Association Rules
  15. Model Interpretability
  16. External Validation
  17. Transfer Learning
  18. Batch Normalization
  19. Regularization Techniques
  20. Cross-Validation
  21. Transfer Learning
  22. Performance Visualization
  23. Multiclass Classification Techniques
  24. Early Stopping
  25. Regression Analysis
  26. Word Embeddings
  27. Regular Monitoring and Logging
  28. Evaluation Metrics
  29. Cross-Validation
  30. Blackbox - Neural Network Models
  31. GridSearchCV, RandomisedSearchCV, BayesianSearchCV
  32. Binary Classification Techniques
  33. Batch Size Selection
  34. Natural Language Processing
  1. Github Actions
  2. Databases
  3. code repository
  4. Kafka Brokers
  5. Datawarehouse
  6. Evidently.ai
  7. Github
  8. model registry
  9. Data Preprocessing pipeline models
  10. Apache Airflow
ML Workflow - Architecture
  • Element belongs to model
  • Element not belongs to model

Data Sources

Streaming Data

Batch Data

Cloud Storage

Labeled Data

Feature Engineering Pipeline

Experimentation

ML Model

Repository

CI/CD component

Continuous integration/Continuous delivery

Continuous deployment

Artifact Store

Feature Store System

Orchestration Component

Artifact Store

CI/CD Component

Scheduler

Workflow orchestration component

Automation ML Workflow Pipeline

Monitoring Component

Model serving component

(Prediction on new batch or streaming data)