Well, I for one, feel a little silly that I couldn't figure that one out myself.
Once V@no got me on the right track, I tweaked it a bit, because my thumbnails were too big. Here is the code I have now:
<table width="100%" border="0" cellspacing="0" cellpadding="1">
<tr>
<td class="bordercolor">
<table width="100%" border="0" cellspacing="0" cellpadding="3">
<tr valign="bottom">
{if prev_image_name}
<td class="row2" width="45"><a href="{prev_image_url}"><img src="{prev_thumb_file}" border="1" width="40" height="40"></a></td>
<td class="row2"> {lang_prev_image}<br>
<b><a href="{prev_image_url}">{prev_image_name}</a></b>
</td>
{endif prev_image_name}
{if next_image_name}
<td align="right" class="row2">{lang_next_image}<br>
<b><a href="{next_image_url}">{next_image_name}</a></b>
</td>
<td align="right" class="row2" width="45"><a href="{next_image_url}"><img src="{next_thumb_file}" border="1" width="40" height="40"></a></td>
{endif next_image_name}
</tr>
</table>
</td>
</tr>
</table>
To see it in action, visit
http://www.jenrichardsphotography.com