# Missing Value imputation – advanced way

Missing value or junk value imputation with mean/median/mode is the very basic part of data cleaning [ Read This ], as these processes will give the accuracy up to a certain level. Also if mean/median/mode are applicable when our data is in some traditional format, but in most of the practical scenario it is not.[…]

# Missing Value imputation – basic way

Data cleaning is the most important part of data analysis and if we have missing values in our dataset, our task is going to be more tedious.  If number of observations with missing values is <=5% we can simply delete those observations, but what if the number of observations are a lot? then we can’t[…]

# Logistic Regression – Basics

Logistic Regression can be binary or multi-nomial depends on the no of levels hold by response variable. Here we will discuss Binary Logistic Regression but same things are applied for multi-nomial as well. What is Binary Logistic Regression? Binary Logistic regression means response variable will have two values (either 1 or 0). It is a special[…]

Java, Pig , R those are all programming language, but what if you are not comfortable with those regular programming language, what if you only know SQL. There is still a way out for you in Hadoop, it’s called Hive. It is old SQL in different packet called HQL (Hadoop Query Language). As an elementary[…]

# Relation between Correlation and Linear Regression

As these two terms looks similar Correlation and linear regression  but actually they are not. They both defines the relationship between two variables. Lets see how they are different: Linear regression finds the model (best fitted line) that can best predict the value of Y using value of X. Measure for fit for regression model[…]

# Linear Regression

What is Linear Regression? It is a predictive analysis technique. With this technique we can predict a variable called as response variable (or dependent variable) using one or more explanatory variables (or independent or predictor variables). When there is only one predictor variable, then method is called as simple regression otherwise multiple regression. Linear regression consists[…]

# First Program in Pig – Hadoop

We have run our first program in Hadoop called “WordCount” using JAVA. But apart from Java there are many application or programming languages are already present in Hadoop, like Pig, Hive etc. Let’s first see what is PIG? Like other languages like java, C, R, Pig is a high level scripting language that is used[…]