It seems that the first few seasons attracted large audiences as it gained popularity among the people. However, American Idol seemed to have its best season with the largest crowd watching in season five. About season 8 is when the show stopped attracting large audiences. It isn’t unusual for the show to stop attracting audiences over time. However, it seems that the first season would naturally be strong because it is new.
Over time, people get tired of watching the same type of show over and over again. Therefore, it stops attracting audiences. It seems to me that by the seventh and eighth seasons, that is a long time for the audiences to decrease. I believe that it would have been around seasons three and four, but the audiences lasted a long time.