It's because when we speak of Asia, we typically speak of India within Britain. Pakistani immigrants are what we consider to be Asia. What were the Pakistanis? Muslims. They became synonyms for each other. This differs from America which got more oriental immigration.