Is your HDMI-CEC turned on in your settings? I have a Samsung too and their CEC option on settings is called Anynet+. Having Anynet+ turned on actually did not work with the HDMI switch. Some people have success with Rocketfish switch, but in my case it would only work intermittently with my Samsung products, which was a deal-breaker for me. I tried two of them and kept having the same problem.