Heinrich Bullinger (1504-1575) was an influential Swiss Reformer, whose comprehensive letter collection is being made available via an electronic online edition to historians and the general public alike. Automatic handwriting recognition is needed to make contents of the letters searchable and browsable. In this project, we develop novel methods for handwriting recognition in historical documents to improve recognition accuracy, especially for the challenging case of non-frequent writers with only few letters in the dataset.