Unfortunately, banzaimonkey, your original code has a devious typographical error, as well as another possible problem. The typographical error is the semi-colon at the end of the foreach loop's conditional. The other problem is that you are attempting to use the post-increment operator, so your loop (even when fixed) is actually a no-op.
If your intention is to add 1 to each element of the array using a foreach loop, then you should write:
$array = array(1, 2, 3, 4);
foreach ($array as $key => $value)
{
$array[$key] = $value + 1;
}
There is another interesting option: use [man]array_walk/man with [man]create_function/man
array_walk($array, create_function('&$value', '$value++;'));