TL;DR: It depends. Clean up, but only where neccessarynecessary.
The key point where I have to disagree is that comparing VB.NET and C# is completely different from comparing Java and C#. Converting WinformsWindows Forms code from VB.NET to C# or vice versa can be done by an online converter. But you surely can't easily translate from Java Swing to WinformsWindows Forms. Or WPF. The same goes for Clipboardclipboard handling, Reflectionreflection, etc. The questions that are not specific for VB.NET or C# are not worth the effort and reduce helpful visibility.
Questions with both tags about language features, like operators, keywords, etc. should be cleaned up. I hope though that this should be a small subset of the questions taggestagged with both C# and VB.NET.