Typical symptoms of an allergic reaction include hives and vomiting. If you think your baby is having an allergic reaction, the first step is to discontinue feeding your baby the allergenic foods and contact your pediatrician to discuss the symptoms.