The main purpose of this study is to determine the safety, tolerability (how the body reacts to the drug\[s\]) and effectiveness (ability to treat the cancer) of REGN5678 (Nezastomig) alone, or in combination with cemiplimab. The study has 2 parts. The goal of Part 1 (dose escalation) is to determine a safe dose(s) of REGN5678 when it is given alone or in combination with cemiplimab. The goal of Part 2 (dose expansion) is to use the REGN5678 drug dose(s) found in Part 1 to see how well REGN5678 alone or in combination with cemiplimab works to shrink tumors. This study is looking at several other research questions, including: 1. Side effects that may be experienced by taking REGN5678 alone or in combination with cemiplimab 2. How REGN5678 alone or in combination with cemiplimab works in the body 3. How much REGN5678 and/or cemiplimab are present in the blood 4. To see if REGN5678 alone or in combination with cemiplimab works to reduce the size of the tumor by helping the immune system destroy the tumor