Yes, sure you can set the permission creating various groups.
use this commands to do so. lets go for an one example for upload.
# groupadd "groupname"
# mkdir "directoryname" (create directory in home directory for security purpose)
# chmod 770 /home/"directoryname"/ (set to upload files in the directory)
# chown root:"groupname" /home/"directoryname"/ ( to set group permission )
# useradd -g "groupname" -d /home/"directoryname" "username"
That's it. now you can enjoy your ftp login for upload the files from outside.
NOTE :- FTP is not recommended to add and delete files it is plain text service.