Skip to content

reveriezhu/Python-Big-Data-Large-Scale-Computing

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Python-Big-Data-Large-Scale-Computing

Utilizing PySpark for Machine Learning

The rate and amount of data being generated in today's world by both humans and machines are unprecedented. Being able to store, manage, and analyze large-scale data has critical impact on business intelligence, scientific discovery, social and environmental challenges.

The goal of this course is to equip students with the understanding, knowledge, and practical skills to develop big data / machine learning solutions with the state-of-the-art tools, particularly those in the Spark environment, with a focus on programming models in MLlib, GraphX, and SparkSQL.

Homework 1: pySpark and RDDs

Homework 2: Regression in Spark

Homework 3: Classification in Spark

Homework 4: Data Analysis with PCA in Spark

Homework 5: Hands-on with ML-lib and SparkSQL

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors