Heat the oil in a 10-inch skillet over medium-high heat. Add the chicken and cook for 10 minutes or until well browned on both sides.
Stir the soup, milk, lemon juice, black pepper and olives in the skillet and heat to a boil. Top the chicken with the lemon slices. Reduce the heat to low. Cover and cook for 5 minutes or until the chicken is cooked through. Serve the chicken and sauce with the rice.