Blood worms, small grubs/meal worms/waxworms or crickets on the dry land or floating island. They eat basically anything that's small enough to fit in their mouth.
You can use a filter, but make sure it's submersible. Frogs are very sensitive to vibrations in the water.