@blindcoder
Have a look at
/etc/spamassassin/local.cf
whitelist_from *@anymail.com

If spamassassin works with amavis you will find more settings in
/etc/amavis/conf.d/20-debian_defaults

Search for $whitelist_sender or @whitelist_sender_maps. These entries are self-explanatory.

In the same file search for
ENVELOPE SENDER SOFT-WHITELISTING / SOFT-BLACKLISTING

This allows you to control the scoring. (NOTE: positive: black, negative: white)

Go to the array definition an add something like the following to the whitelist part:

'.foo.example.com' => -6.0,
'[email protected]' => -3.0,

Then restart your services like #amavis, #spamassassin, #postfix, #dovecot ...