No. There are people who are allergic to milk and dairy foods. But the symptoms of a dairy allergy are often different from those of lactose intolerance. In the case of an allergy, the body reacts to the protein in milk, rather than to the sugar. Plus, allergies involve the body's infection-fighting system, called the immune system whereas Lactose intolerance does not.