Code block highlighting is not as expected

[Flrande]

For the following code, the code block highlighting is not as expected.

const a = html`
  <span class="affine-latex" data-selected=${this.selected}
      ><span class="latex-container"></span
      ><v-text .str=${ZERO_WIDTH_NON_JOINER}></v-text
  ></span>
`;

The possible reason is that now each delta in the code block is parsed separately. We need to parse them together while maintaining lazy loading for syntax highlighting.

blocksuite/packages/blocks/src/code-block/affine-code-line.ts

Lines 50 to 54 in 55a4720

	tokens = highlighter.codeToTokensBase(this.delta.insert, {
	lang,
	theme: mode === 'dark' ? DARK_THEME : LIGHT_THEME,
	})[0];
	highlightCache.set(cacheKey, tokens);

[golok727]

Hey @Flrande, I believe storing the ruleStack in a state and passing it to the tokenizer could be a viable solution within our current setup. However, it appears that Shiki doesn't currently support that functionality.

PS: Apologies for the premature closure; my phone glitched.