How To Check Python Version In Databricks

To check the Python version in Databricks, you can use the following methods:

1. Using sys.version:

   python

   import sys
print(sys.version)


   This will display the full Python version information1.

2. Using shell command:

   text

   %sh python --version


   This command will show the Python version installed on the cluster1.

3. Checking cluster configuration:
   Navigate to Cluster –> SparkUI –> Environment to see the cluster’s Python version1.

It’s important to note that the Python version displayed in the cluster configuration might not always reflect the version used in your notebooks. The version used in notebooks is typically determined by the PYSPARK_PYTHON environment variable1.

Version Information

• For recent Databricks Runtime versions:

  • Databricks Runtime 16.0 and above uses Python 3.1224

  • Databricks Runtime 15.0 to 15.4 LTS uses Python 3.1124

  • Databricks Runtime 13.3 LTS to 14.3 LTS uses Python 3.1024

• For older Databricks Runtime versions:

  • Databricks Runtime 12.2 LTS uses Python 3.9

  • Databricks Runtime 11.3 LTS uses Python 3.9

  • Databricks Runtime 10.4 LTS uses Python 3.8

  • Databricks Runtime 9.1 LTS uses Python 3.8

  • Databricks Runtime 7.3 LTS uses Python 3.75

It’s crucial to ensure that your local Python version matches the version used in your Databricks environment, especially when using features like Databricks Connect or working with user-defined functions (UDFs)24.