I'd think this one would be obvious.
Outside the window was another small enclosed space, containing a fan. The fan was blowing SO HARD that it broke the window and knocked the glass of water over. Alice and Bob were unfortunate victims of fan death. When in doubt... Fan death.
Alternative answer to the question "How did Alice and Bob die?":
Mysteriously.