You need to create a module for each language and actually set the language field to that language.
Page is set to all languages
Module one set to Engilsh
Module two set to German
Module three set to French
Depending on my language I will see either the English, German or French module.