$ dig -t AXFR @$SERVER $ZONE
The @ is important because it tells dig which dns server to ask. If you don't put the @ sign, then dig does TWO lookups, using the dns server defined in /etc/resolv.conf for both. First it tries to lookup $SERVER, then it tries to lookup $ZONE.(Thanks Todd.)