You can apply an ACL to the vty ports:
access-list 150 permit 10.1.1.0 0.0.0.255 any eq telnet
line vty 0 4
access-class 150 in
This will permit only telnet connections from the 10.1.1.0 subnet. I had problems using the actual router address in the destination field in the access list, so used the any keyword.
Another useful command to apply to the vty ports, transport input telnet, this limits what protocols can be used.