Average IQ was significantly lower for adults who were born with either a very low birth weight or born very prematurely, a new study reports.