Answers for "pyspark read json to dataframe"

pyspark dataframe json string

newJson = '{"Name":"something","Url":"https://stackoverflow.com","Author":"jangcy","BlogEntries":100,"Caller":"jangcy"}'
df = spark.read.json(sc.parallelize([newJson]))
df.show(truncate=False)

Read JSON files with automatic schema inference

# Read JSON files with automatic schema inference

df = spark.read.json("logs.json")
df.where("age > 21").select("name.first").show()