add VHD ID/name to release notes: allow users to match release infos with actual Runtime #5
Description
Hi @SparkVHDReleaseManagementTeam ,
Since we started using Synapse we noticed that Microsoft regularly changes the Spark Runtimes (package updates, version updates) without communicating this to the customers.
Because of that I implemented a notebook that runs every day an logs several spark configruations, JAR files and Python modules.
So, if ne notice a change in behavior (e.g. Spark Notebooks that ran successfully in the past suddenly fail with no meaningful error message) we first consult my version history to determine of the change might be due to a (uncommunicated) version update.
Looking at my collected information from the recent past, I can tell that Microsoft rolled out a new version of Synapse Spark Runtime 3.4 (in Azure West EU) on 2024-09-19 as well as on 2024-10-02:
| 2024-09-18 | 2024-09-19 | 2024-10-02 | |
|---|---|---|---|
| Spark Version | 3.4.3.5.3.20240722.5 | 3.4.3.5.3.20240828.1 | 3.4.3.5.3.20240904.5 |
| spark.synapse.vhd.id | 9546d251-39fe-4d5e-ac39-4681344b59d8 | 51371cb0-0b04-4038-b644-767402a2799c | 8b35e0be-1c99-43d5-aaca-7ba7d4a2ea69 |
| spark.synapse.vhd.name | 7fa779394e76a8.vhd | eae248376d7ac2.vhd | 8d192621b53f95.vhd |
Looking at the runtime descriptions in this repo, it is hard for me to match it with the information that I oberserved.
- Official-Spark3.4-Rel-2024-08-29.2-rc.1.md: does it correspond to VHD ID
51371cb0-0b04-4038-b644-767402a2799c? - Official-Spark3.4-Rel-2024-09-18.0-rc.1.md: does it correspond to VHD ID
8b35e0be-1c99-43d5-aaca-7ba7d4a2ea69?
Can you please incorporporate VHD ID or name into the release notes?