The electrostatic force is NOT medium dependent. The force between two unit charges at a given distance is always the same, irrespective of the surroundings, and is given by the Coulomb's law (with constant ϵ0ϵ0). When you put charges inside a medium like water/oil, the medium around gets polarized, and the new field created due to this acts on the charges inside it. That's why it looks as if there was an "apparent" change in force between charges as compared to when they were in the vacuum.
its the medium which gets polarized cancels a part of the overall field, and the force is a measure of the net field. therefore it depends on the medium.