Consider the following controlled (autonomous) dynamical system [1]
where is the state trajectory,
is the control input history,
is the set of admissible control inputs, and
is a (known) vector field.
If we know the control input for all
, then we can integrate the ODE above with initial condition
and obtain the state trajectory
, as follows
which can be represented pictorially by a single streamline in
I am (quite explicitly) alluding to fluid flow. Just like a cork on the ocean will follow a certain path depending on the velocity field (i.e., “ocean currents”), a point in state space will flow along a certain streamline.
__________
Let us fix the control input, i.e., for all
, and define
For the sake of simplicity, let us consider . Since
can only take two values, we have two vector fields,
and
. Integrating the following ODEs
for various initial conditions, we obtain two families of streamlines, as depicted below
For each fixed control input and collection of initial conditions, we will have a family of streamlines in state space.
Imagine that we have the following control input history
where we toggle the control input at time , thus interrupting the flow along a “blue” streamline and initiating the flow along a “pink” streamline. Pictorially, we have
If the control input is fixed, say, , then given an initial condition
, we will flow along the “blue” streamline that passes through
. This streamline is
-dimensional and does not allow us to “explore” the
-dimensional state space. However, if we switch between
and
, then we are able to “travel” to other regions of the state space. Allowing the control input to take values in
would give us even more freedom.
Lastly, we arrive at a most childish idea: in some cases, controller design can be viewed as shaping the streamlines differently in different parts of the state space. This is childish because it is purely conceptual. One obviously cannot design optimal controllers by doodling with crayons.
__________
References
[1] Hassan K. Khalil, Nonlinear Systems, 3rd edition, Prentice Hall.


