A building or structure containing more dwelling units than are permitted by the use regulations of this Ordinance shall be nonconforming by use. A building or structure containing a permitted number of dwelling units by the use regulations of this Zoning Ordinance, but not meeting the lot area per dwelling unit regulations, shall be nonconforming by dimension.