Skip to content Skip to sidebar Skip to footer
Showing posts with the label Amazon Emr

Passing Nested Dictionary To Emr Via Add_job_flow_steps

I create a python dictionary called my_dict with some metadata. I convert my_dict to a string via j… Read more Passing Nested Dictionary To Emr Via Add_job_flow_steps

Install Com.databricks.spark.xml On Emr Cluster

Does anyone knows how do I do to install the com.databricks.spark.xml package on EMR cluster. I suc… Read more Install Com.databricks.spark.xml On Emr Cluster

Converting Spark Dataframe To Pandas Dataframe - Importerror: Pandas >= 0.19.2 Must Be Installed

I am trying to convert spark DataFrame to pandas DataFrame. I am trying to in Jupyter notebook on E… Read more Converting Spark Dataframe To Pandas Dataframe - Importerror: Pandas >= 0.19.2 Must Be Installed