I'm not sure he was referring to the country

I think he may have been referring to his administration in general:

Perhaps President Bush has been paying attention to all the bad press his climate policies have received.  Before leaving the G8 this week, The Independent reports Bush "told his fellow leaders:  'Goodbye from the world's biggest polluter.'"

what a moron.