Рет қаралды 7,372
PySpark Interview Questions & Answers | PySpark Interview Questions
PySpark Interview Questions and Answers video includes all the frequently asked Interview questions that give you an idea to crack your PySpark interview smartly. These Interview questions are curated by experts and will help you to brush up your knowledge in PySpark. This video session is designed for both beginners and professionals who want to prepare for a PySpark Interview.
Want more similar videos- hit like, comment, share and subscribe
❤️Do Like, Share and Comment ❤️
❤️ Like Aim 5000 likes! ❤️
➖➖➖➖➖➖➖➖➖➖➖➖➖
Please like & share the video
➖➖➖➖➖➖➖➖➖➖➖➖➖
script
question 1
data1= [(1,"manish","data engineer"),(2,"rani","data analyst"),(3,"manju","data science")]
column1 =["id","name","department"]
data2= [(3,"harish"),(4,"monish"),(5,"priti")]
column2 =["id","name"]
question 2
from pyspark.sql import SparkSession
Create SparkSession
spark = SparkSession.builder.appName('SparkByExamples.com') \
.getOrCreate()
Prepare data
data = [('James','Java'),
('James','Python'),
('James','Python'),
('Anna','PHP'),
('Anna','Javascript'),
('Maria','Java'),
('Maria','C++'),
('James','Scala'),
('Anna','PHP'),
('Anna','HTML')
]
Create DataFrame
df = spark.createDataFrame(data,schema=["name","languages"])
df.printSchema()
df.show()
➖➖➖➖➖➖➖➖➖➖➖➖➖
AWS DATA ENGINEER : • AWS Data Engineer Basic
Azure data engineer playlist : • Azure Data Engineer
SQL PLAYLIST : • SQL playlist
PYSPARK PLAYLIST -
• Pyspark Tutorial
➖➖➖➖➖➖➖➖➖➖➖➖➖
📣Want to connect with me? Check out these links:📣
Join telegram to discuss t.me/+Cb98j1_fnZs3OTA1
➖➖➖➖➖➖➖➖➖➖➖➖➖
what we have covered in this video:
➖➖➖➖➖➖➖➖➖➖➖➖➖
Hope you liked this video and learned something new :)
See you in next video, until then Bye-Bye!
➖➖➖➖➖➖➖➖➖➖➖➖➖
#sqlserver #sqlinterviewquestions #sqlinterviewquestionsandanswers #sqlinterview