📎 Referral Code: —
🎁 Referral Earnings ₹0 →
📊 Dashboard Sign In
🎁 ₹0
Your Referral Earnings → Tap to view
Buy
🛒
Buy Course
🎬
Reels
📚
Buy Book
Personal Training
🎬
Live Classes
🎯
My 1:1 Dashboard
🗺️
Course Roadmap
🎤
Mock Interview
🧑‍💼
HR Discussion
📅
My Booked Slots
Courses & Booking
🐍
Our Course — AWS Data Engineering
▶️
Animated Roadmap — Learn with Animations
🎓
Course Marketplace — Other Trainers
🗓️
Slot Booking
Passive Income
🎁
Refer & Earn — ₹1,000 per referral
🤝
Browse Job Support
💰
Become a Supporter
🔗
Browse Referrals
📢
Post a Referral
🧑‍🏫
Teach a Course
📊
My Courses & Earnings
AI Tools
🌐
Project Explanation Agent
👤
My Profile
🏢
Recruiter Board
🛟
Support Works

PySpark

The same work, on data too big for one machine.

No reviews yet 71 parts

₹4,999this stage, Telugu Buy this stage or every stage for ₹15,000

Topics

22 topics, in the order to take them

Language తెలుగు (Telugu)Englishहिन्दी (Hindi)தமிழ் (Tamil)
Show All topics 22Mandatory 22Optional 0Free samples 1

  1. Why Learn Spark?MandatoryStart hereFree sample

    Videos
    1. VideoFree
    Content
    1. Why SparkFree
    2. EffortFree
    3. RoadMapFree
    4. Where to runFree
    Assignments
    1. Practice
    Interview questions
    1. QuizFree
    Try free

  2. Data FiltersMandatory

    Content
    1. Filters
    Locked

  3. Realtime ETL ProjectMandatory

    Content
    1. Project
    Locked

  4. With Spark & Without SparkMandatory

    Videos
    1. Video
    Content
    1. Without Spark
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  5. Spark ArchitectureMandatory

    Videos
    1. Video
    Content
    1. Spark architecture
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  6. The problems of processing data on many machinesMandatory

    Videos
    1. Video
    Content
    1. Problems to face
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  7. Inside one EC2 machineMandatory

    Videos
    1. Single Machine Details
    2. How Python Code Runs on Spark Engine
    3. How spark reads and distributes the data
    Content
    1. Single EC2 machine
    2. How Python Code Runs
    3. How Data Splits?
    4. Single vs 500GB
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  8. Why 128 MB partitions in Spark?Mandatory

    Videos
    1. Video
    Content
    1. Why 128 MB partitions in Spark?
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  9. Number of EC2 Machines CalculatorMandatory

    Videos
    1. EC2 machines Calculator
    Content
    1. Simulator
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  10. Predicate pushdown, column pruning, partition pruning: read less from S3Mandatory

    Videos
    1. Video
    Content
    1. Predicate pushdown, column pruning, partition pruning
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  11. Narrow vs Wide transformations in SparkMandatory

    Videos
    1. Video
    Content
    1. Narrow vs Wide transformations
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  12. Transformations vs Actions in SparkMandatory

    Videos
    1. Video
    Content
    1. Transformations vs Actions
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  13. Broadcast join vs Sort-merge joinMandatory

    Videos
    1. Video
    Content
    1. Broadcast join vs Sort-merge join
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  14. Handling data skew in SparkMandatory

    Videos
    1. Video
    Content
    1. Handling data skew in Spark
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  15. How many output files does Spark writeMandatory

    Videos
    1. Video
    Content
    1. Outputs
    Assignments
    1. Practice
    Interview questions
    1. Quiz
    Locked

  16. From code to tasks: DAG, DAG Scheduler, Task Scheduler, jobs, stages, tasks and execution plansMandatory

    Videos
    1. Video
    Content
    1. From code to tasks
    Locked

  17. PySpark Installation Steps In Local MachineMandatory

    Content
    1. Installations
    Locked

  18. Dataframe CreationMandatory

    Content
    1. DataFrame
    2. Dataframe Creation
    Locked

  19. Data SelectionMandatory

    Content
    1. Select Required Data
    Locked

  20. Data Mathematical OperationsMandatory

    Content
    1. Calculations
    Locked

  21. Data TransformationsMandatory

    Content
    1. Transformations
    Locked

  22. Dataframe JoinsMandatory

    Content
    1. Joins
    Locked

Reviews of PySpark

Written by students who took this stage

No reviews yet. Students who take this stage can write the first one.

When students review this stage, their reviews appear here.

Write a review

Only students who have this stage can review it, so every review here comes from someone who took it.

Buy this stage for ₹4,999 or get full access to every stage Already a student? Sign in