Agam was the son of a Russian rabbi. He grew up in an early Jewish settlement and did not begin his formal schooling until age 13. Having learned to draw at an early age, he studied art in Jerusalem (1947–48), Zürich (1949–51), and Paris (1951) and had his first one-man exhibition in 1953 in Paris, where he settled. Eventually his body of work grew to include vibrating and tactile elements, and he began to create manipulable sculptures as well.

Agam's relief paintings, with their shifting, merging geometric forms, demonstrate his concern with time, movement, and viewer involvement. The viewer becomes a participant in the transformation—in a sense, the creation—of Agam's works by moving in front of them, by rotating the work, or by manipulating various elements of the works. Examples of Agam's works include “Three Times Three Interplay” (1970–71) and “The Thousand Gates” (1972) in the gardens of Israel's presidential palace in Jerusalem. He also designed an enormous musical fountain situated in the Quartier de la Défense, Paris (1975).