I have it set up so that any comments with links in them have to be approved by me. This way spam comments get filtered out. Also, certain words trigger the moderation thing. This helps filter out trolls.
If you post a legitimate comment and I never approve it, it's because I'm oppressing your free speech. The SWAT team is already on their way to your home to arrest you and throw you into thought prison.