Skip to content Skip to sidebar Skip to footer
Showing posts with the label Scala
Is There A Scala Equivalent Of The Python List Unpack (a.k.a. "*") Operator?

Is There A Scala Equivalent Of The Python List Unpack (a.k.a. "*") Operator?

Post a Comment
In Python, we have the star (or '*' or 'unpack') operator, that allows us to unpack… Read more Is There A Scala Equivalent Of The Python List Unpack (a.k.a. "*") Operator?
Start Hivethriftserver Programmatically In Python

Start Hivethriftserver Programmatically In Python

Post a Comment
In the spark-shell (scala), we import, org.apache.spark.sql.hive.thriftserver._ for starting Hive T… Read more Start Hivethriftserver Programmatically In Python
Why Is This Simple Spark Program Not Utlizing Multiple Cores?

Why Is This Simple Spark Program Not Utlizing Multiple Cores?

Post a Comment
So, I'm running this simple program on a 16 core multicore system. I run it by issuing the foll… Read more Why Is This Simple Spark Program Not Utlizing Multiple Cores?
How Does The Collectasmap() Function Work For Spark Api

How Does The Collectasmap() Function Work For Spark Api

Post a Comment
I am trying to understand as to what happens when we run the collectAsMap() function in spark. As p… Read more How Does The Collectasmap() Function Work For Spark Api
How To Run Multi Threaded Jobs In Apache Spark Using Scala Or Python?

How To Run Multi Threaded Jobs In Apache Spark Using Scala Or Python?

Post a Comment
I am facing a problem related to concurrency in spark which is stopping me from using it in product… Read more How To Run Multi Threaded Jobs In Apache Spark Using Scala Or Python?
Generate Data By Using Existing Dataset As The Base Dataset

Generate Data By Using Existing Dataset As The Base Dataset

Post a Comment
I have a dataset consisting of 100k unique data records, to benchmark the code, I need to test on d… Read more Generate Data By Using Existing Dataset As The Base Dataset