To Transfer or Not to Transfer