Yes, my honourable Mr Small

The French has a lot of weird family names. They could sound so normal to a French, but totally bizzare to a foreigner like me. Imagine you are seeing a small guy and he is called Mr Big. You could be facing a thin guy and he is called Mr Fat. You have to call the most unhelpful and unfriendly civil servant Mr Niceguy. Imagine you are meeting your director and he is called Mr Small. What would happen if a judge is called Mr Small? Do you still say:"Yes, my honourable Mr Small"?