I actually use my German ID card to communicate with the Elster service of the German tax offices. My old USB signing stick would need to be replaced next year, but using my ID card was the cheaper option.
You can also generate a certificate. Registering it requires receiving a letter by snail mail and it expires every X years (5 maybe?), but otherwise it's just like your certificate for your server you use to SSH in.
