Skip to main content

The Unsupervised Learner!

Search This Blog

Machine Learning Cheatsheet

on Monday, February 03, 2020

Get link
Facebook
X
Pinterest
Email
Other Apps

When you advertise, it's artificial intelligence. When you hire ...

The Google Sheet explains all the important aspects of the most common machine learning models: https://docs.google.com/spreadsheets/d/1DjB2BF8JDY9C7RkzP5wUPvY0gqPhfUUh3lr5gumYnYc/edit#gid=0

Data Modelling energy forecasting Linear. Regression machine learning R Statistical Analysis time-series

Get link
Facebook
X
Pinterest
Email
Other Apps

Comments

Post a Comment

Popular Posts

Top Interview Questions for Data Science Professionals | Part 1

Q1. What are some ways to check the normality of a data? Way 1: Visualize it! If you plot a histogram of all the data points available, it should look similar to following curve (All the curves are normally distributed, they just have different means and standard deviations). This curve is called a Bell Shaped Curve, meaning: 68% of the values are found within 1 Standard Deviation away from the mean 95% of the values are found within 2 Standard Deviations away from the mean 99.7% of the values are found within 3 Standard Deviations away from the mean Way 2: Test it with a statistical test. One of the most common test is Anderson Darling test for normality. The test assumes the following hypothesis: Ho = The data is normally distributed Ha = The data is not normally distributed In python you can use this test with following piece of code: scipy.stats.anderson(x, dist='norm') The result may look something like: AndersonResult ( statistic = 1.383562257554786 , cri...

Statistical Tests | What, when, how?

Inferential Statistics This term is nothing but a set of statistical tests that the researchers and data scientists use to make some inferences about the data that they are working on. The tests give them a certain level of confidence about whether the observed pattern in the data is due to the intervention of just by chance! Now, what type to test can be used in a certain situation depends a lot on the distribution of the data, the type of variable under the test, and the overall research design. There are a lot of statistical tests out there, but I'll focus on those that I've learned and implemented in my professional and academic journey. Please feel free to add more in comments if you'd like. In broad terms, the statistical tests are divided into 2 categories: Parametric tests Non-parametric tests Parametric Tests : They are most commonly used when the distribution of your data looks normal. Non-parametric Tests : They are used when the data is not really normal. Before...

Time Series Forecasting from a Layman's Perspective | Just Kidding, A Little Tech Too! | Part 1

Time Series Forecasting Techniques in Python This one's gonna be a bit long, but I hope to explain Time Series Analysis in a way that you'll remember it for a long time. I will begin by telling you about what we're gonna cover in this article: Table of Contents What is Time-Series and why is it important? How do we load and visualize Time-Series data in Python? What are the important components of a Time-Series? How do we test for stationarity in a Time-Series? What are different ways to remove trend and seasonality in a Time-Series? What are different Time-Series forecasting models that you might end up using? What is ACF and PACF? How to forecast a Time-Series? Finally, how do we evaluate the accuracy of a Time-Series? 1. What is a Time Series? Now you all know what time-series is, but I'll explain it anyway. A time-series data is one where you collect the data with a timestamp. For example: Collecting energy production data of a power plant . Now you can collect data...

Time Series Forecasting from a Layman's Perspective | Just Kidding, A Little Tech Too! | Part 2

So let's go ahead and understand how to remove trend and seasonality from a time series. Those who ended up directly on this part, please use this link to read Part 1 and come back to this. 5. Removing trend and seasonality One of the easiest ways to REDUCE, not REMOVE trend from the time series is to transform it so that the higher values are penalised more than the smaller values. There are many ways to do it, log transformation, square root, cube root transformation etc. You can try them on your time series to see what makes the most sense. In our case, though, there don't seem to be a visible overall trend. But we will still do ahead and try to do these transformations and see what happens: Doesn't change much except the scale, does it? Let's keep the original then. We can use some techniques to estimate or model the trend from the time series and then remove it. The most common one is called 'SMOOTHING'. Smoothing is nothing but taking rolling estimates (l...

Things we need to know about Linear Regression in R | Part A - Assumptions

While I was working on the final project for the course ' Statistics with R ' at The University of Connecticut, I learned a lot of things about Regression Analysis. Since we had a lot of data coming from the solar systems installed by our customers in India, I decided to try Linear Regression on one of the solar PV systems in Bihar. For those who landed directly on this part of the article, you can visit: PART B to learn how to fit different variations of the Linear Model. PART C to learn how to evaluate multiple models to find the best one Data Preparation Since the data we receive is time-series, I converted it into a non-time-series dataset. I used about 1 year of data where the target variable was 'Energy Production in a Day' and the predictor variables were 'Average Solar Irradiation', 'Average Ambient Temperature' and 'Average Wind Speed' in a day. Modeling Prerequisites Linear Model assumes the following: The target variable is normally ...

Powered by Blogger