For ovarian cysts that cause pain, medications such as acetaminophen, ibuprofen, or another non-steroidal anti-inflammatory (NSAID) drug can help, Baldonieri says. So can applying a heat or ice ...