The probability that it will be impossible if you swap stickers will never drop below $11/12$. The reason for this is actually rather mathematically simple.
First, an interchange of $N$ stickers is equivalent to some sequence of interchanges of two stickers. Thus, the problem you're asking about is exactly the same as asking if an equivalent sequence of 2-sticker swaps puts the cube in a solvable state. By solving the 2-sticker-swap problem, we'll solve the problem for any number of sticker swaps.
Suppose the cube, after some number of sticker swaps, is in a state $P$, and suppose $P$ is not solvable cube. Therefore, there must be at least two stickers out of place. In order to reach any solvable state $S$, a sequence of moves must be executed such that, at some point, exactly two stickers must be swapped to reach an $S$.
This is an important fact. At the point where $P\mapsto S$ requires only one swap ($n=1$), the probability of making the correct swap is exactly equal to the probability of selecting the two correct stickers. As there are 54 stickers on the cube, the probability of selecting the first correct stickers is $1/54$. The probability of the second is $1/45$, because selecting a sticker of the same color wouldn't change the cube state. Therefore, the probability for $n=1$ is: $$p_{n=1}=\frac 1 {54*45}$$
There's one edge case where this doesn't hold true. When both needed stickers are on different edges, there are actually two ways to swap pieces into a solved state. This is because swapping two edges on a Rubik's cube is legal. However, this is the only such situation, since the same symmetry doesn't apply to corners or centers. Thus, in this case: $$p_{n=1,edge}=\frac 2{54*45}$$
If $P\mapsto S$ requires more than one swap ($n>1$), then there is no single swap that will put the cube in a solvable state, so the probability of entering a solvable state is $$p_{n>1}=0$$
By basic probability, the probability that the cube will enter an unsolvable state is $1-p$, which is:
$$\begin{align}
1-p_{n=1}&=1-\frac{1}{54*53}&=\frac{2429}{2430}\\
1-p_{n=1,edge}&=1-\frac{2}{54*53}&=\frac{2428}{2430}\\
1-p_{n>1}&=1-0&=1
\end{align}$$
In other words, if you need more than one swap to put the cube in a solvable state, then no matter what you do, a single swap won't make the cube solvable. If you need only one swap to make the cube solvable, then there's a good chance you won't pick the right one. Because we know that: $$1>\frac{2429}{2430}>\frac{2428}{2430}>\frac{11}{12}$$
the probability that the cube will be solvable after swapping two stickers will never fall below $11/12$.