A 72-year-old man with Merkel cell carcinoma on pembrolizumab presented with two weeks of mental status changes, hallucinations, weakness, and appetite loss. Diagnosed with autoimmune encephalitis, he was treated with high-dose IV methylprednisolone, improving his mental status. He later developed bilateral vision loss and was diagnosed with paraneoplastic autoimmune retinopathy, subsequently being treated with monthly IVIG for 6 months. After treatment cessation, severe photophobia persisted, prompting neuro-ophthalmologic referral. Neuro-ophthalmology exam showcased severe bilateral visual acuity decline with a significantly constricted visual field, disc edema/hyperemia, pan uveitis, and retinal pigment epithelium loss. Retinal vasculitis was noted on Fluorescein angiogram, peripapillary photoreceptor loss on OCT retina, and electroretinography demonstrating generalized photoreceptor dysfunction. Lumbar puncture revealed elevated protein and lymphocytosis. Further investigation revealed mild gliosis with scattered perivascular lymphocytes infiltration on right dural biopsy and a positive CRMP-5 antibody. This led to treatment with oral steroids and rituximab, with improvement of optic neuropathy and retinal vasculitis.