Skip to content

Commit

Permalink
Fix typos
Browse files Browse the repository at this point in the history
  • Loading branch information
moschmdt authored and garfieldnate committed Aug 7, 2024
1 parent c7df550 commit 4cc1afc
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions docs/soar_manual/05_ReinforcementLearning.md
Original file line number Diff line number Diff line change
Expand Up @@ -299,7 +299,7 @@ An example walkthrough of a Sarsa update with $\alpha = 0.3$ and $\gamma = 0.9$
The previous description had assumed that RL operators were selected in both
decision cycles $t$ and $t+1$. If the operator selected in $t+1$ is not an RL operator,
then $Q(s_{t+1},a_{t+1})$ would not be defined, and an update for the RL operator
then $Q(s_{t+1}, a_{t+1})$ would not be defined, and an update for the RL operator
selected at time $t$ will be undefined. We will call a sequence of one or more
decision cycles in which RL operators are not selected between two decision
cycles in which RL operators are selected a gap. Conceptually, it is desirable
Expand Down Expand Up @@ -332,7 +332,7 @@ RL operator.
Gap propagation can be disabled by setting the **temporal-extension** parameter
of the [`rl` command](../reference/cli/cmd_rl.md) to off. When gap propagation
is disabled, the RL rules preceding a gap are updated using $Q(s_{t+1},a_{t+1})
is disabled, the RL rules preceding a gap are updated using $Q(s_{t+1}, a_{t+1})
= 0$. The rl setting of the [`watch`](../reference/cli/cmd_trace.md) command is
useful in identifying gaps.
Expand Down
2 changes: 1 addition & 1 deletion docs/tutorials/soar_tutorial/06.md
Original file line number Diff line number Diff line change
Expand Up @@ -221,7 +221,7 @@ the *Agents* directory.

### RL Rules

Rules that are recognized as updateable by the RL mechanism must abide
Rules that are recognized as updatable by the RL mechanism must abide
by a specific syntax:

```Soar
Expand Down

0 comments on commit 4cc1afc

Please sign in to comment.