### Bug description

Hi,
I have this "hello world" qmd file: https://gist.github.com/aborruso/a9a95b902b35e77b0042e66dd7714a8f
It reads a CSV and an image. 
In [this zipped file](https://github.com/quarto-dev/quarto-cli/files/11311360/files.zip), the qmd file, the CSV, the image and the HTML output.

The problem I have is that the column margin text is not aligned correctly, it is moved further down.
I removed other output blocks from this example: in the original, the further I scroll down, the more this shift increases.
And the column-margin content is no longer aligned to its reference section, but to the next one.

If I remove the charts generated with altairs, everything realigns. What am I doing wrong?

I'm using Debian 11 and  quarto 1.3.253.

Thank you very much

![image](https://user-images.githubusercontent.com/30607/234024537-93166bca-f5c1-4eca-81f7-378e537db703.png)




### Checklist

- [X] Please include a minimal, fully reproducible example in a single .qmd file? Please provide the whole file rather than the snippet you believe is causing the issue.
- [X] Please [format your issue](https://quarto.org/bug-reports.html#formatting-make-githubs-markdown-work-for-us) so it is easier for us to read the bug report.
- [X] Please document the RStudio IDE version you're running (if applicable), by providing the value displayed in the "About RStudio" main menu dialog?
- [X] Please document the operating system you're running. If on Linux, please provide the specific distribution.
- [X] Please provide the output of `quarto check` so we know which version of quarto and its dependencies you're running.
dragonstyle
2023-04-24T14:24:53Z
aborruso
bug websites
v1.4
closed
column-margin, wrong positioned
https://github.com/quarto-dev/quarto-cli/issues/5289