Workflow Element Store

  1. APIs and Data Feeds
  2. Crowdsourcing
  3. Mobile Applications or IoT Applications
  4. Unstructured data (Images / Videos)
  5. WebScraping
  6. Data Logging
  7. Surveys and Questionnaires
  8. Data Generation
  9. Public Datasets
  10. Data Collaboration and Partnerships
  11. Data Pre-existing
  12. Structured Data (Tabular)
  13. Unstructured data (Audio)
  1. GCP BigQuery
  2. AWS Redshift
  3. MySQL
  4. Azure blob storage
  5. NoSQL DB
  6. GCS
  7. Azure Data Warehouse
  8. Informatica
  9. Oracle DB
  10. PostgreSQL
  11. MS SQL server
  12. RDBMS
  13. S3
  1. Interaction Features
  2. Handling Imbalanced Classes
  3. Time-Based Features
  4. Feature Extraction from Images
  5. Polynomial Features
  6. Handling Categorical Data
  7. Encoding Categorical Variables
  8. Textual Feature Extraction
  9. Handling Time-Series Data
  10. Feature Selection
  11. Dimensionality Reduction
  12. Data Scaling and Normalization
  13. Binning
  14. Handling Missing Data
  15. Data Scaling and Normalization
  16. Handling Noisy Data
  17. Logarithmic Transform
  18. Domain-Specific Feature Engineering
  19. Dimensionality Reduction
  20. AutoEDA libraries
  21. Auto-Preprocessing libraries
  22. Dealing with Outliers
  1. Forecasting
  2. Ensemble Techniques
  3. Unsupervised Learning
  4. Supervised Learning-binary classification
  5. Time Series Anaysis
  6. Data Partitioning
  7. Train-Test Split
  8. Supervised Learning-Regression
  9. Blackbox Techniques
  10. Supervised Learning-multiclass classification
  1. Ensemble Methods
  2. Regular Monitoring and Logging
  3. Batch Normalization
  4. Cross-Validation
  5. Data Partition-sequential
  6. Data Augmentation
  7. Transfer Learning
  8. Batch Size Selection
  9. Gradient Clipping
  10. Train-Test Split
  11. Early Stopping
  12. Learning Rate Scheduling
  13. Regularization
  14. Hyperparameter Tuning
  15. Weight Initialization
  1. Evaluation Metrics
  2. Cross-Validation
  3. Model Interpretability
  4. External Validation
  5. Hyperparameter Tuning
  6. Train-Test Split
  7. Regularization Techniques
  8. Model Comparison
  9. Data Partitioning
  10. Performance Visualization
  1. Model Registry
  2. Model Monitoring and Maintenance
  3. A/B Testing
  4. Documentation and Reporting
  5. Bias and Fairness Assessment
  6. Edge Deployment
  7. Cloud Deployment
  8. Streamlit
  9. Model Drift
  10. Web APIs - Flask, FastAPI, etc.
  11. Security Considerations
  12. Model Health Monitoring
  13. Error Analysis
  14. Prediction Logging
  15. Alerting and Notification
  16. Concept Drift Detection
  17. Continuous Integration and Deployment (CI/CD)
  18. Serverless Computing
  19. Documentation and API Documentation
  20. Data Drift Monitoring
  21. Performance Metrics
  22. Model Versioning
  23. Feedback Collection
  24. Model Serialization
  25. Containerization
  26. Monitoring and Logging
  27. Model Retraining and Updating
  1. End User Machine
  2. Mobile
ML Workflow Beginner - Architecture
  • Element belongs to model
  • Element not belongs to model
Feature Store

Feature Store
(Online / Offline)

Data Sources

Data Sources

Data Warehouse

Data Warehouse/ Data Lake

Data Pre Processing & Feature Engineering

EDA, Data Pre Processing & Feature Engineering

Model Selection

Model Selection

Model Training & Hyper Parameter Tuning

Model Training & Hyper Parameter Tuning

Model Evaluation

Model Evaluation

Model Deployment

Model Deployment

End User Device

End User Device

Model Registry

Model Registry