It depends what you client and server are called.
From the Linux box if you type ping client the Linux machine will look for a machine called client. If it can't find one it will return an error.
You can set names in the /etc/sysconfig/network file (i think) someone may know better but you can definately tell the Linix machine to reference clients by name but you have to specify those names alongside a valid ip address so that the machines can talk.
On the Win side there is a "hosts" file which can be used, i think it is in /win32/system somewhere
something like this
and then when you type ping ziggy the windows box will know to ping 192.168.1.21
Hope this helps...
What distro are you using as the hosts information file probably differs. I'm sure you can set these hosts up in Linux through a gui in kde, basically you are simply giving names to ipaddresses not much different from dns in a way..
Hope this helps