I think I finally found the problem with my ipsec/l2tp timeout with my iPhone \o/
But there is a side effect from the fix :(I sort of mitigate it but it's a bit dirty.