Call Us

Home / Blog / Data Science Digital Book / Data Quality Analysis

Data Quality Analysis

  • July 15, 2023
  • 3205
  • 28
Author Images

Meet the Author : Mr. Bharani Kumar

Bharani Kumar Depuru is a well known IT personality from Hyderabad. He is the Founder and Director of AiSPRY and 360DigiTMG. Bharani Kumar is an IIT and ISB alumni with more than 18+ years of experience, he held prominent positions in the IT elites like HSBC, ITC Infotech, Infosys, and Deloitte. He is a prevalent IT consultant specializing in Industrial Revolution 4.0 implementation, Data Analytics practice setup, Artificial Intelligence, Big Data Analytics, Industrial IoT, Business Intelligence and Business Management. Bharani Kumar is also the chief trainer at 360DigiTMG with more than Ten years of experience and has been making the IT transition journey easy for his students. 360DigiTMG is at the forefront of delivering quality education, thereby bridging the gap between academia and industry.

Read More >

The goal of this stage is to locate any potential data mistakes, flaws, or problems.

data quality analysis data quality analysis Data mistakes (human or automated) leading to incorrect information -Gauge or AAA R & R

 Attribute Agreement Analysis, or AAA
Gage R and R stands for Gage Repeatability & Reproducibility


Four errors to be avoided during Data Collection

  • Random Errors - Thermometer malfunction or incorrect measurement by the user. Resulting in False Positives

  • Systematic Errors - Social desirability bias of Trump on Twitter. Wearable devices data is of wealthy customers

  • Errors in choosing what to measure - Instead of picking a candidate from a prestigious university for a position, perhaps we could consider their social network, which helped them navigate a sequence of circumstances that led to their enrollment in the exclusive institution. High SAT scores depend on having access to quality instructors and buying quality study materials in addition to having a high IQ. Although someone may have enjoyed a topic and obtained a good GPA, can we ensure that they will succeed in other areas?

  • Errors of exclusion - Not capturing women data pertaining to cardiovascular diseases. An election in the US, not having data of coloured women candidates. Chief Diversity Officer in big firms is a solution!


Data Integration

When there are several datasets that need to be combined or integrated and have the same features or columns, data integration is called for.

employing a common property to combine several datasets with diverse properties.

Appending

Multiple datasets with the same attributes/columns.

data integration

Merging

Multiple datasets having different attributes using a common attribute.

data integration

Click here to learn Data Science Course, Data Science Course in Hyderabad, Data Science Course in Bangalore

Data Science Placement Success Story

Data Science Training Institutes in Other Locations

Navigate to Address

360DigiTMG - Data Science, IR 4.0, AI, Machine Learning Training in Malaysia

Level 16, 1 Sentral, Jalan Stesen Sentral 5, Kuala Lumpur Sentral, 50470 Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, Malaysia

+60 19-383 1378

Get Direction: Data Science Course

Read
Success Stories
Make an Enquiry