In this long tutorial we cover various decompositions techniques for stochastic optimization: