Can my installer control my smart home products remotely without my consent ?

No, he will not be able to operate them remotely.