After searching, recompiling all libraries, etc for two hours someone on #kivy pointed me to ~/.kivy/config.ini which has a show_cursor = 0/1. In my case it was 0. I never touched it (just freshly installed Kivy) and the default is 1, however, it was 0 and thus my cursor did not show.