Khan was born on 25 September 1939 in Bangalore, India to a Pathan[3] Afghan immigrant father belonging to the tanoli tribe of Ghazni, while his mother was of Iranian background.
Khan was educated in Bishop Cotton Boys' School, Bangalore and St. Germain High School, Bangalore. His brothers are Sanjay Khan (Abbas Khan), Shahrukh Shah Ali Khan, Sameer Khan and Akbar Khan (director). He has a sister Dilshad Bibi. After his schooling in Bangalore, he travelled to Mumbai where he made his debut as second lead in Didi in 1960.