I have ants coming out of the return holes of a toilet. It is a modular type building. no other place.?

No ants anyplace else. They were floating in the water and when I flush, about 8 more came out. I waited about an hour and flushed again while trying to watch under the rim. Sure enough about 5 more came out. How do they get in there?!