This is how the character renders in my Firefox ESR 91 on Debian:
The backspace character clearly visible in the edit box, but not in the preview. However, if I select the text in the preview, copy and paste it, the backspace character is present. It just isn’t visible on the page.
Given how inconsistently it renders in various circumstances, perhaps it is better to avoid inputting it directly anyway. In this case, I think it is best to replace it by ‘�’, with a note below; this is what I ended up doing to the original question. In other circumstances, ‘␈’ might be a better replacement.