Guys ! I fixed it totally !
Now starts up great with a crisp picture, perfectly centred. (pictures probably coming soon).
Besides replacing U2B, I removed C67, which as marked as optional, but which I had populated. Also, I did plug the floppy drive, but that was not causing the issue. The Mac now starts with or without the drive.
I would recommend to never populate C67. Which is weird, as it is present on schematics, but on none of the SE boards I have.
Reading schematics and probing components is the way to go.