[BUG] text wrapping treats U+00A0 NO-WRAP SPACE as a regular space

[mgedmin]

• I've checked docs and closed issues for possible solutions.
• I can't find my issue in the FAQ.

Describe the bug

Here's a contrived example that demonstrates the issue:

from rich.console import Console
from rich.panel import Panel

console = Console()
text = 'A quick brown\N{NO-BREAK SPACE}fox jumps over the lazy dog.'
console.print(Panel(text, width=20))

It prints

╭──────────────────╮
│ A quick brown    │
│ fox jumps over   │
│ the lazy dog.    │
╰──────────────────╯

Observe how there's a line break between 'brown' and 'fox', despite the U+0020 NO-BREAK SPACE character. Apparently rich treats it like any other whitespace.

This is what I wanted to see:

╭──────────────────╮
│ A quick          │
│ brown fox jumps  │
│ over the lazy    │
│ dog.             │
╰──────────────────╯

Platform

Click to expand

What platform (Win/Linux/Mac) are you running on?

Ubuntu 24.10

What terminal software are you using?

GNOME Terminal 3.54.0 using VTE 0.78.0 +BIDI +GNUTLS +ICU +SYSTEMD

$ python -m rich.diagnose
╭───────────────────────── <class 'rich.console.Console'> ─────────────────────────╮
│ A high level console interface.                                                  │
│                                                                                  │
│ ╭──────────────────────────────────────────────────────────────────────────────╮ │
│ │ <console width=190 ColorSystem.TRUECOLOR>                                    │ │
│ ╰──────────────────────────────────────────────────────────────────────────────╯ │
│                                                                                  │
│     color_system = 'truecolor'                                                   │
│         encoding = 'utf-8'                                                       │
│             file = <_io.TextIOWrapper name='<stdout>' mode='w' encoding='utf-8'> │
│           height = 43                                                            │
│    is_alt_screen = False                                                         │
│ is_dumb_terminal = False                                                         │
│   is_interactive = True                                                          │
│       is_jupyter = False                                                         │
│      is_terminal = True                                                          │
│   legacy_windows = False                                                         │
│         no_color = False                                                         │
│          options = ConsoleOptions(                                               │
│                        size=ConsoleDimensions(width=190, height=43),             │
│                        legacy_windows=False,                                     │
│                        min_width=1,                                              │
│                        max_width=190,                                            │
│                        is_terminal=True,                                         │
│                        encoding='utf-8',                                         │
│                        max_height=43,                                            │
│                        justify=None,                                             │
│                        overflow=None,                                            │
│                        no_wrap=False,                                            │
│                        highlight=None,                                           │
│                        markup=None,                                              │
│                        height=None                                               │
│                    )                                                             │
│            quiet = False                                                         │
│           record = False                                                         │
│         safe_box = True                                                          │
│             size = ConsoleDimensions(width=190, height=43)                       │
│        soft_wrap = False                                                         │
│           stderr = False                                                         │
│            style = None                                                          │
│         tab_size = 8                                                             │
│            width = 190                                                           │
╰──────────────────────────────────────────────────────────────────────────────────╯
╭─── <class 'rich._windows.WindowsConsoleFeatures'> ────╮
│ Windows features available.                           │
│                                                       │
│ ╭───────────────────────────────────────────────────╮ │
│ │ WindowsConsoleFeatures(vt=False, truecolor=False) │ │
│ ╰───────────────────────────────────────────────────╯ │
│                                                       │
│ truecolor = False                                     │
│        vt = False                                     │
╰───────────────────────────────────────────────────────╯
╭────── Environment Variables ───────╮
│ {                                  │
│     'TERM': 'xterm-256color',      │
│     'COLORTERM': 'truecolor',      │
│     'CLICOLOR': None,              │
│     'NO_COLOR': None,              │
│     'TERM_PROGRAM': None,          │
│     'COLUMNS': None,               │
│     'LINES': None,                 │
│     'JUPYTER_COLUMNS': None,       │
│     'JUPYTER_LINES': None,         │
│     'JPY_PARENT_PID': None,        │
│     'VSCODE_VERBOSE_LOGGING': None │
│ }                                  │
╰────────────────────────────────────╯
platform="Linux"

$ uv tree | grep rich
├── rich v13.8.1

[github-actions]

Thank you for your issue. Give us a little time to review it.

PS. You might want to check the FAQ if you haven't done so already.

This is an automated reply, generated by FAQtory

[oir]

Apologies if this is unrelated but I have come across something similar when using tables and justification:

from rich.console import Console
from rich.table import Table, Column

table = Table(Column(justify="right"), show_header=False)
table.add_row("hello\N{NO-BREAK SPACE}")
table.add_row("world")

console = Console()
console.print(table)

which prints

┌────────┐
│  hello │
│  world │
└────────┘

whereas I was expecting something like:

┌────────┐
│ hello  │
│  world │
└────────┘

Curiously, left justification works as I expected

from rich.console import Console
from rich.table import Table, Column

table = Table(Column(justify="left"), show_header=False)
table.add_row("\N{NO-BREAK SPACE}hello")
table.add_row("world")

console = Console()
console.print(table)

┌────────┐
│  hello │
│ world  │
└────────┘

[mgedmin]

@oir: it's a related, but different issue. Both issues stem from the fact that Python considers U+00A0 to be a space character, and so it gets matched by \s in regular expressions and also stripped by str.rstrip() (which is what Table layout uses).

I've monkey-patched both bugs out in my current project with this:

import re

from rich.text import Text


_re_whitespace = re.compile("[^\\S\N{NO-BREAK SPACE}]+$")


def monkeypatch_rich_word_wrapping_bug() -> None:
    # Workaround for https://github.com/Textualize/rich/issues/3545
    import rich._wrap
    import rich.text
    rich._wrap.re_word = re.compile("\\s*[\\S\N{NO-BREAK SPACE}]+\\s*")
    rich.text._re_whitespace = _re_whitespace

    def rstrip(self: Text) -> None:
        self.plain = _re_whitespace.sub('', self.plain)
    Text.rstrip = rstrip  # type: ignore[method-assign]

while waiting for feedback on #3571.