Assume you are giving a dataset that is based on user surveys. You notice that many surveys have missing fields. You also notice that some surveys have fields on a scale of 1 to 5 while others are on scale of 1 to 10. The survey has mixed information using metric measurements and the imperial system. There are some different fields depending on the country, but they all relate to the location of the participant. You also notice that some values just don't make sense. What analysis would you do on the data set to come up with a data cleaning plan? What are some normalization and cleaning tasks you could do based on the information provided in this description?

Assume you are giving a dataset that is based on user surveys. You notice that many surveys have missing fields. You also notice that some surveys have fields on a scale of 1 to 5 while others are on scale of 1 to 10. The survey has mixed information using metric measurements and the imperial system. There are some different fields depending on the country, but they all relate to the location of the participant. You also notice that some values just don't make sense. What analysis would you do on the data set to come up with a data cleaning plan? What are some normalization and cleaning tasks you could do based on the information provided in this description?

Database System Concepts

7th Edition

ISBN:9780078022159

Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Chapter1: Introduction

Section: Chapter Questions

Problem 1PE

See similar textbooks

Related questions

Q: You didn't join the employee database to get the employee number, last name or first name. Your…

A: Structured Query Language is a common programming language for relational database management. With…

Q: Is there anything more that can be done besides these techniques to ensure the validity of field…

A: Data management must take in data legalization to assurance that the in order gather, Processed, and…

Q: No external sources may establish a direct link to the database. It's a consideration for any data…

A: Introduction: Data security is a critical aspect of any organization's operations, and protecting…

Q: Which phase takes the longest to complete in the data science process?

A: Introduction: A typical data science project might take anything from 2 weeks to 6 months to finish.…

Q: Why is it important to separate the data into two sets for training and validation? What will the…

A: Introduction Validation is the process of confirming that something is true or correct. The…

Q: The definition of a variable is required to contain, in addition to the variable's name, the…

A: A variable is a information storage ability used in indoctrination. linked with a figurative name…

Q: We would appreciate it if you could provide us an overview of the fundamentals that underpi…

A: Answer to the above question is given below

Q: ience project vary in their number of steps and functions, but in the end, the objectives and…

A: Q. The processes used to complete a data science project vary in their number of steps and…

Q: Provide an overview of the essential ideas behind the development of data input fields. Are there…

A: Fundamental concepts: A notion is a mental classification system for the universe. The hierarchical…

Q: Assume you are giving a dataset that is based on user surveys. You notice that many surveys have…

A: Data cleaning sometimes also known as "Data Scrubbing" or "Data cleansing" is important part for…

Q: Why should the data be partitioned into training and validation sets? What will the training set be…

A: Actually, validation is used for confirmation of something true or correct.

Q: python to solve this. Task: Handling missing data (Replacing missing data with the mean value or…

A: It is defined as an interpreted, object-oriented, high-level programming language with dynamic…

Q: In the past, we would place enormous volumes of ungrouped data into periods based on broad rules…

A: We have seen that , in the past, we would place enormous volumes of ungrouped data into periods…

Q: It should follow an essay format, which means you must add an introduction, analysis and…

A: The Okun's Law is an empirical relationship that highlights the trade-off between unemployment and…

Q: We used to put large amounts of ungrouped data into intervals that we chose as a general rule. We…

A: Yes, working in a team has advantages and disadvantages compared to working alone.

Q: To begin with, why is it necessary to divide the data into training and validation sets? What is the…

A: In general the Data set refers to the collections of the data which are related, which are discrete…

Question

Assume you are giving a dataset that is based on user surveys. You notice that many surveys have
missing fields. You also notice that some surveys have fields on a scale of 1 to 5 while others are on a
scale of 1 to 10. The survey has mixed information using metric measurements and the imperial
system. There are some different fields depending on the country, but they all relate to the location
of the participant.
You also notice that some values just don't make sense.
What analysis would you do on the data set to come up with a data cleaning plan?
What are some normalization and cleaning tasks you could do based on the information provided in
this description?
Edit View Insert Format Tools Table
12pt v Paragraph BIU Αν
2 T² :
PAYTO
THE
MARCELLA M. SERRANO
PEDRO GOMEZ
3610 COUNTRY TRAILS PH. 619 S
BONITA, CA 91902
91902
Ale
2512 12759
Eraser
ser made in
ape g
GRIP
12
31
Super Polymer Lead
Pentel

Expert Solution

This question has been solved!

Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.

SEE SOLUTION Check out a sample Q&A here

Step 1

Step 2

Step 3

Step 4

Step by step

Solved in 4 steps

SEE SOLUTION Check out a sample Q&A here

Knowledge Booster

Learn more about

Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, computer-science and related others by exploring similar questions and additional content below.

Similar questions

PLEASE ANSWER USING SAS.
Large volumes of ungrouped data were often organized into intervals of our choice in the past. We are faced with colossal and formidable difficulties, just as in the real world. Do the advantages and disadvantages of working in a group outweigh working alone?
Please use excel or matlab Simulate 100 random normal variables with mean 1.5 and standard deviation and create a histogram which shows the data in the range between −4 and 10, with class intervals of length 0.5 Make sure that your name and current date are also included in the histogram title on this and all the other histograms you generate for this exercise.
Your task is to develop a database, in order to keep information on all sales at a motorcycle dealership. The database will include information on motorcycles, salespeople, sales, and customers. We assume for simplicity that the dealership sells only new motorcycles and that all motorcycles are produced by the same manufacturer. Each kind of motorcycle is called a model, and it has a unique model number. For each model, you want to store also its name, engine size in cubic centimeters (cc) which is an integer number, and the date when this particular model was introduced. For each salesperson, you want to store their employee ID number, first name, middle initial, last name, and the date when the employee was hired. For each customer, you want to store a customer ID number, first name, middle initial, last name, address information (city, state, and zipcode), phone number (given in standard US format), and e‐mail address. Assume that you do not have a zip code table available. Each…
Help us understand the basics of effective data input fields, if you would. Perhaps there will be times when it is necessary to break these rules, but under what circumstances?
Data Definition Language definitions are implemented in what way? Is there another way? How can I help?
Use MySQL Workbench to create an EER diagram for a database named school_db that stores information about professors, students, and their courses. A table for professors that includes name, department, and birth date. A table for students that includes name, start date, and major. A table for classes that includes course name, course code, professor, start date, and end date. Pick smart data types for all of the required fields. Don’t forget about primary keys. You will need a fourth table for joining purposes. You need to figure out what gets joined with this fourth table. All four tables must show the correct relationships (i.e the primary keys and foreign keys need to match up) Screen capture (or Export an image) of your diagram and paste the image below.
To be more specific, what do you mean when you say "interpolation of characteristics"?
Do an analysis of a real data set and also mention where did you find the data set. Please do analysis completely in R studio. A basic requirement for the data set is that it includes one response variable and at least two predictor variables.The main objectives of this question are• to identify a suitable data set,• to come up with meaningful research questions based on the data,• to experience some of the problems encountered when analyzing real data,Also mention:• Where I find the data set?• Why the problem is of interest?• Which method or model is appropriate to this problem?• How do I apply the method to analysis the data set?• What is my conclusion?
A variable cannot be sufficiently described by the word "type." Or to put it another way, every variable has some kind of attributes and data types. What is the best approach to describe any variable's characteristics using the notion that makes this possible?
To what extent does the analytical process depend on data modeling? Is there a way to figure out how much data we'll need for our model?
To begin with, why is it necessary to divide the data into training and validation sets? What is the training set going to be utilized for? The function of the validation set is still a mystery.