When a currency pair is Long, the first currency is bought while the second currency is sold. To "go long" means you are buying in anticipation that the price will rise.
A Short position occurs when the first currency is sold while the second currency is bought. "Going short" on a currency means you are selling it and hoping the market price will decline.