[BUG] Magic functions no longer being executed in Interactive Window.

[cyaris]

Describe the bug
Magic functions are no longer being executed in the VS Code Interactive Window.
Running a cell using # MAGIC %md will be treated as a Python comment. The same is true for # MAGIC %run.

To Reproduce
Steps to reproduce the behavior:

1. Create a Databricks notebook source Python file.
2. Run a command in the notebook using a MAGIC function.
3. See that the MAGIC function commands are not run, and instead are rendered as comments.

Screenshots

System information:

• macOS Version 14.4.1 (23E224)
• Databricks CLI v0.216.0
• Python 3.11.0
• VS Code 1.88.1
• Jupyter v2024.3.1 (Jupyter Extension)
• Databricks v1.3.0 (Databricks Extension)
• Databricks Cluster
  • Databricks Connect Enabled
  • Databricks Runtime 13.3x

Additional context
The issue began a month or so ago.
I tried changing versions for the Jupyter and Databricks extensions but that didn't help.

[kartikgupta-db]

Hi @cyaris. Thanks for reporting this issue. It might be that there is some issue actually running our init script that sets up parsing for this magic.

• Can you try running command "Databricks: Verify Databricks notebook init scripts".
• Are you also using synapse extension by any chance? It is known to conflict with our notebooks init script.

[cyaris]

Hi @kartikgupta-db, I am not using synapse. How should the command be run?

If I run it as a string I see this...

If I run it not as a string I see this...

Thanks!

[kartikgupta-db]

I meant, running a vscode command.
On mac

• cmd + shift + p > "Databricks: Verify Databricks notebook init scripts" > enter

[cyaris]

I meant, running a vscode command. On mac

• cmd + shift + p > "Databricks: Verify Databricks notebook init scripts" > enter

Verified...