"Of all kinds" is closer to "different types of" but suggests that the types are representative of all of the available kinds possible (which is to say if there were "surprising kinds" of water sports [and the extract doesn't suggest there is or isn't] then one should reasonably expect some representative selection of these to be included in something described as "all kinds").
It is tends to mean closer to a "myriad of" or "different types of" though because no one actually expects a mathematical rigour of the speaker and instead some amount of hyperbole in the usage is to be expected. Thus "all kinds of" most literally means "many kinds of" or to use a real equivalent phrase "all manner of" (note though that this features an uncommon usage of "manner").