We consider an infinite horizon zero-sum differential game where the dynamics of each player and the running costs depend on the evolution of some discrete (switching) variables. In particular, such switching variables evolve according to the switching law of a so-called thermostatic delayed relay, applied to the players' states. We first address the problem of the continuity of both lower and upper value function. Then, by a suitable representation of the problem as a coupling of several exit-time differential games, we characterize those value functions as, respectively, the unique solution of a coupling of several Dirichlet problems for Hamilton-Jacobi-Isaacs equations. The concept of viscosity solutions and a suitable definition of boundary conditions in the viscosity sense are used in the paper.
