However, you should make sure you rinse the feeder well since sometimes the soap may leave very harmful residues in the feeder. You can also consider adding dry ice to the hummingbird feeder if your feeder is very dirty. Moreover, you can put small amount of rice in the feeder to act as an abrasive to help you clean the hard to reach areas.