Apache Hadoop was a pioneer in the world of big data technologies, and it continues to be a leader in enterprise big data storage. Apache Spark is the top big data processing engine and provides an impressive array of features and capabilities. When used together, the Hadoop Distributed File System (HDFS) and Spark can provide a truly scalable big data analytics setup. In this course, learn how to leverage these two technologies to build scalable and optimized data analytics pipelines. Instructor Kumaran Ponnambalam explores ways to optimize data modeling and storage on HDFS; discusses scalable data ingestion and extraction using Spark; and provides tips for optimizing data processing in Spark. Plus, he provides a use case project that allows you to practice your new techniques.
Learn More- Events
- Career Fairs
- Resources
- Alumni Mentoring Program
- Internships and Jobs
- Skills Employers Are Looking For
- Career Podcasts
- Working Virtually
- Resumes and Cover Letters
- Interviewing and Thank Yous
- Researching Companies, Networking, & Career Fairs
- Hiring Statistics and Salary Information
- BA297, BA395A, and Bootcamps
- Build Skills with LinkedIn Learning
- International Students
- People We Serve
- Featured Jobs
- Change of Campus Students
- Careers in Your Major
- Employers
- About