Your head is certainly in the right place and it is best to get a foreign country that speaks English on almost an impeccable level.
For cost effectiveness and volume I would personally look no further than the Philippines. You can find several candidates (Man or Women) who are hungry and will do whatever it takes to "make the gravy brown".
You are looking at around $200 to $300 a month in terms of cost but be sure to consider sweetening the deal with incentives as Filipinos are some of the best working people in the World. I have had the pleasure to work with hundreds of them and I must say when you find the rights ones, they are solid collegues and friends.
Your vetting process is key in the beginning as you want to find an individual who has solid family values and does their job with a purpose. More than likely that purpose is to simply properly provide for their families which can be the strongest motivation known to man.
Treat them accordingly and give them incentives or even show them how to make money themselves online (as long as it doesn't effect you). This is probably the best incentive and provides a future potential multilevel downsteam of income for you and your business. This could be in the form of business development and or human resource outsourcing.
Regarding giving access to your online resources, there is plenty of security software and workflow platforms to keep your mind at ease.
Here's a couple of links to online Philippines head hunting sites but personally, Facebook is the way to go as you have the advantage of being able to investigate and vet properly. Look for Filipino Facebook Groups and Pages with the skills you are looking for..
A few links:
Onlinejobs dot PH
JobSteet Dot Com Dot PH
Outsourced Dot PH
Most important advice when considering a Filipino is try not to hire one who lives in Manila or around other big cities, if possible. Best to get one who intends living in their own province. Check out a map and orient yourself on the lay of the land.
On a side note, Filipinas are very horny creatures, try not to get yourself in trouble.... much
Good luck on whatever you decide!