Dismissing Notification Preview triggers notification sound

I have enabled notification summary for my apps. Whenever I close the summary modal from the close button at the bottom, it triggers notification received sound. This should not be the case earlier, it's happening from few months now.