1.Fully versus partially observablez
-perception action cycle
Agent, State
(sensors, actuators)
2.Deterministic versus stochastic
3.Discrete versus continuous
4.Benign(no objective) versus adversarial(such as chess, games)
for example:
robot car -> partially observable, stochastic, continuous, adverial