Panes misalign when handling combining characters in directory names

[JustForFun88]

What system are you running Yazi on?

Windows

What terminal are you running Yazi in?

wezterm 20240203-110809-5046fc22

yazi --debug output

Yazi
    Version: 0.4.3 (2770e02 2024-12-27)
    Debug  : false
    Triple : x86_64-pc-windows-msvc (windows-x86_64)
    Rustc  : 1.83.0 (90b35a62 2024-11-26)

Ya
    Version: 0.4.3 (2770e02 2024-12-27)

Emulator
    Brand.from_env      : Some(WezTerm)
    Emulator.detect     : Emulator { kind: Left(WezTerm), light: false, cell_size: None }
    Emulator.detect_full: Ok(Emulator { kind: Right(Unknown { kgp: false, sixel: false }), light: false, cell_size: None })

Adapter
    Adapter.matches: Iip

Desktop
    XDG_SESSION_TYPE           : None
    WAYLAND_DISPLAY            : None
    DISPLAY                    : None
    SWAYSOCK                   : None
    HYPRLAND_INSTANCE_SIGNATURE: None
    WAYFIRE_SOCKET             : None

SSH
    shared.in_ssh_connection: false

WSL
    WSL: false

NVIM
    NVIM          : false
    Neovim version: program not found

Variables
    SHELL           : None
    EDITOR          : None
    VISUAL          : None
    YAZI_FILE_ONE   : Some("C:\\Program Files\\Git\\usr\\bin\\file.exe")
    YAZI_CONFIG_HOME: None
    YAZI_ZOXIDE_OPTS: None
    FZF_DEFAULT_OPTS: None

Text Opener
    default     : Some(Opener { run: "hx %*", block: true, orphan: false, desc: "helix", for_: None, spread: true })
    block-create: Some(Opener { run: "hx %*", block: true, orphan: false, desc: "helix", for_: None, spread: true })
    block-rename: Some(Opener { run: "hx %*", block: true, orphan: false, desc: "helix", for_: None, spread: true })

Multiplexers
    TMUX               : 0
    tmux version       : program not found
    tmux build flags   : enable-sixel=Unknown
    ZELLIJ_SESSION_NAME: None
    Zellij version     : program not found

Dependencies
    file          : 5.45
    ueberzugpp    : program not found
    ffmpeg/ffprobe: 7.1 / 7.1
    pdftoppm      : 24.08.0
    magick        : 7.1.1-43
    fzf           : 0.57.0
    fd/fdfind     : 10.2.0 / program not found
    rg            : 14.1.1
    chafa         : program not found
    zoxide        : 0.9.6
    7z/7zz        : 23.01 / program not found
    jq            : 1.7.1

Clipboard
    wl-copy/paste: program not found / program not found
    xclip        : program not found
    xsel         : program not found

Describe the bug

The bug occurs when a directory name contains combining characters (e.g., COMBINING BREVE (U+0306), COMBINING ACUTE ACCENT (U+0301) and so on). This causes the panes in yazi to render incorrectly after navigating to or past such directories.

The bug manifests as follows:

• Panes misalign vertically and shift to the left, breaking the expected visual boundaries of the interface.
• The first pane (showing the previous directory) overflows its left boundary, leaving residual artifacts outside its designated area.
• Panes overlap each other, leading to a distorted view where their layout breaks down.

The effect resembles "refraction" when crossing boundaries, with panels "breaking" at the boundary between two mediums. This results in a distorted layout, overlapping panes, and persistent rendering artifacts.

This behavior is observed with directory names containing Unicode combining characters, such as:

• Голицынский (й = U+0438 + U+0306)
• examplé (é = U+0065 + U+0301)
• resumé (é = U+0065 + U+0301)

Minimal reproducer

1. Create a directory with a name that includes combining characters. Examples:
   • Голицынский Ю.Б. (й = U+0438 + U+0306)
   • examplé (é = U+0065 + U+0301)
2. Navigate to the parent directory of the created directory. Open yazi in the parent directory
3. Navigate into and out of the problematic directory or pass the folder that contains problematic directory. Observe how the panes render.

For example, here I created a directory with the name of the book: stacked̀̂ (à̂ = U+0061 + U+0300 + U+0302, COMBINING GRAVE ACCENT + COMBINING CIRCUMFLEX ACCENT). But it is not necessary to have exactly two symbols. Let's say Голицынский Ю.Б. is also enough.

Screen.Recording.2024-12-29.143637.mp4

Anything else?

No response

Checklist

• I tried the latest nightly build, and the issue is still reproducible
• I updated the debug information (yazi --debug) input box to the nightly that I tried
• I can reproduce it after disabling all custom configs/plugins (mv ~/.config/yazi ~/.config/yazi-backup)

[sxyazi]

My knowledge of Unicode is quite limited, and I've never used these characters myself, so it's hard to say how to fix this.

I'll add the "help wanted" tag and count on the community to help with this.

[sxyazi]

Note that Yazi doesn't handle text rendering itself, but relies on the underlying TUI framework ratatui. So this issue may need to be fixed upstream rather than in Yazi.

It might be related to or a duplicate of #1714

[ViktorKarpilov]

Looks like it's problem with wezterm - not reproducible in powershell or gitbash or terminal with powershell inside, in wezterm reproduce every time

[sxyazi]

Thanks for the information @ViktorKarpilov !

Hey @JustForFun88 , could you verify if this is a WezTerm-specific issue? Does it reproduce in other terminals, like the latest MS Terminal Preview?

[JustForFun88]

Thanks for the information @ViktorKarpilov !

Hey @JustForFun88 , could you verify if this is a WezTerm-specific issue? Does it reproduce in other terminals, like the latest MS Terminal Preview?

Hmm... Maybe it really is because of the terminal emulator. I can reproduce this bug in Windows Terminal Version: 1.21.3231.0, but I can't in Windows Terminal (preview) Version: 1.22.3232.0. Apparently this bug in Windows Terminal was fixed

[sxyazi]

It's likely that the older versions of WezTerm and MS Terminal were using an old ConPTY implementation, while the latest MS Terminal preview is using the updated ConPTY.

The new ConPTY properly supports this feature. In this case, I believe that with future updates to WezTerm, using the new ConPTY will resolve the issue.

Since this involves ConPTY, I guess it's a Windows-specific problem, and it might not exist on other systems like Linux or macOS.

[sxyazi]

I’m going to close this for now because it really looks like a terminal problem. Since Yazi itself doesn't handle text rendering, I'm not sure how to fix it within Yazi. Plus, I've never used these characters myself, which makes it not doable for me.

Feel free to reopen it or create a new issue if anyone figures out how to solve this. Thanks!

[github-actions]

I'm going to lock this issue because it has been closed for 30 days. ⏳
This helps our maintainers find and focus on the active issues. If you have found a problem that seems similar to this, please file a new issue and complete the issue template so we can capture all the details necessary to investigate further.