If only setup for Casual Avy is desired, then directly run the command casual-avy-init, either manually with extended-execute-command (M-x) or by adding it to your Emacs initialization file.
(casual-avy-init)
Note that this will only work if Casual Avy is installed via package-install.