In my experience, there will be a temporary drop for several days/weeks. Then everything will be back to normal or even better in some cases ;)
Make sure you set up https change properly.
Read this tutorial for more:
https://www.keycdn.com/blog/http-to-https/