Pre-ISA
Carmi Gillon was born in 1950 to a well known family of lawyers from Jerusalem.
He began his army service in the armored corps and was later transferred to the artillery corps. He was injured during the 1956 Sinai Campaign, but returned to complete his army service. He was released from the army in 1971 and began studying political science and public administration in the Hebrew University of Jerusalem. He joined the ISA during his studies.

In the ISA
1972 - recruited to the ISA and worked as a bodyguard in the field as well as in senior headquarter positions.
1982 – served as head of the Jewish Department in the ISA
1987 - left his position in order to begin studies in the National Security College. He served in a number of senior positions during study for an MA in political science and public administration.
1989 - served as head of the Training Division
1990 - served as head of the Northern Command in the ISA, a position in which he was responsible for ISA activity in Lebanon.
1993 - appointed head of the Administrative Division, and was responsible for HR, finances and logistics.
1994 -appointed proxy ISA Director during the four months of Yaakov Peri’s academic leave.
1995 - appointed ISA Director.

On November 4, 1995 Prime Minister Yitzhak Rabin was assassinated. Immediately following the assassination, Gillon appointed an internal committee, which submitted preliminary findings and conclusions three days later. When he presented the report to the proxy prime minister, Shimon Peres, Carmi Gillon also submitted his resignation.
In February 1996, after a short period of parallel service with Ami Ayalon, Carmi Gillon resigned from the ISA.