A term male presented at two weeks of age with fever and focal left hemibody motor seizures. Initial cerebrospinal fluid (CSF) testing was positive for HSV-2 and his magnetic resonance imaging (MRI) showed diffuse right hemisphere involvement. He received six months of acyclovir with clinical improvement, although he continued to have left hemibody seizures and left hemibody weakness and spasticity. Despite no clinical deterioration, his repeat MRI over one year later revealed radiological deterioration throughout the previously unaffected left cerebral hemisphere, raising concern for HSV relapse; however, a thorough work-up including CSF was negative. This raises critical questions regarding the type of treatment required in HSV and the need for regular MRI to track evolution in patients who receive standard of care therapy.