#how to set pyspark_python
Explore tagged Tumblr posts
Visit Tumblr Blog
Explore Tumblr blogs with no restrictions, modern design and the best experience.
Last Seen Tumblr Blogs
Fun Fact
Tumblr has been banned in Indonesia for providing people with access to pornographic content.
Text
How to change the python version in PySpark ?
How to change the python version in PySpark ?
To switch the python version in pyspark, set the following environment variables. I was working in an environment with Python2 and Python3. I had to use Python3 in pyspark where the spark was using Python 2 by default.
Python 2 was pointing to –> /usr/bin/python
Python 3 was pointing to –> /usr/bin/python3
To configure pyspark to use python 3, set the following environment variables.
View On WordPress
#how to set pyspark_python#how to set python path in pyspark#how to set python version for pyspark#how to update python in pyspark#pyspark#pyspark change python version#pyspark driver python#pyspark executor pythonpath#pyspark python#pyspark python path#switch python in pyspark
0 notes