Jump label

Service navigation

Main navigation

You are here:

Main content

Pattern Recognition in Embedded Systems Group

The general goal of pattern recognition is to reproduce or mimic human perceptual capabilities in technical systems, making machines "see" or "hear". Generally, pattern recognition enables machines to "sense" their surroundings with a range of sensors, analyze the sensory data and react intelligently and appropriately to certain events occurring in these surroundings. Relevant events are associated with reappearing patterns in the sensory data streams. Thus, the task is to find, model (or "learn") and classify those patterns, distinguishing relevant from irrelevant events.

Research in the Pattern Recognition Group aims both at advancing the principled pattern recognition methods behind Intelligent Systems and at developing application-oriented solutions for real-world problems. The term Intelligent Systems comprises a wide range of artifacts and devices augmented with advanced computational capabilities.  Good examples are robotic assistants, smart homes, or decision support systems. All these have in common that they react intelligently when interacting with humans and draw "intelligent" inferences in automated decision processes. In order to realize such seamingly intelligent behavior advanced techniques of pattern recognition and machine learning are developed and applied.

Currently, the main research topics addressed come from the fields of computer vision, acoustic signal processing, and document image analysis. In these areas techniques for the natural and robust interaction between technical systems - like, for example, smart spaces - and human users are developed. The solutions are primarily based on the application of advanced methods from the field of statistical pattern recognition. These all share the important property of being able to automatically learn computational models from examples, which is also a fundamental capability of human perceptual systems.

The group closely collaborates with several research groups from academia and a number of industrial partners.

For motivated students, we always offer a wide variety of topics for student work and Bachelor/Master/Diploma Theses in the fields of pattern recognition methods and applications.


ICFHR 2020 goes to Dortmund

By tradition, the location of the International Conference on Frontiers in Handwriting Recognition (ICFHR) is decided by the conference participants four years in advance of the respective event. The basis for the voting are bids for hosting submitted by tentative organization teams. For ICFHR 2020 two teams presented hosting proposals at this year's ICFHR 2016 in Shenzhen, China, namely for Vienna and Dortmund as possible locations of the venue. In a crucial vote, the Dortmund team headed by Professor Gernot A. Fink prevailed against the competitors from Vienna. Therefore, ICFHR will come to Germany for the first time in its history and will be hosted by TU Dortmund University in September 2020.

ICFHR 2020, September 8-10, Dortmund, Germany 

Pattern Recognition Group wins best paper award at iWOAR 2017

Ubiquitous systems are becoming an integral part of our everyday lives. Functionality and user experience of these systems often depends on accurate, sensor-based activity recognition and interaction. The objective of the International Workshop on Sensor-based Activity Recognition and Interaction (iWOAR) is to discuss challenges and possible solutions in this field.

Every year the workshop awards the best paper. This year 2017's iWOAR best paper award was earned by René Grzeszick, Jan Marius Lenk, Fernando Moya Rueda and Gernot A. Fink from the Pattern Recognition in Embedded Systems Group in collaboration with their colleagues Sascha Feldhorst and Michael ten Hompel from the Fraunhofer IML/the chair of Materials Handling and Warehousing, Faculty of Mechanical Engineering, TU Dortmund. They were awarded for their work entitled: Deep Neural Network based Human Activity Recognition for the Order Picking Process.

The paper discusses a novel approach to recognizing human activities in industrial settings using a deep neural network. The approach has evaluated using data from multiple warehouses.


Pattern Recognition Group wins best paper award and word spotting competition track at ICFHR 2016

This years International Conference on Frontiers in Handwriting Recognition (ICFHR) proved to be full of awards for the Pattern Recognition in Embedded Systems Group. First, Sebastian Sudholt, Leonard Rothacker and Gernot A. Fink won the Query-by-String track in the Handwritten Key Word Spotting Competition. Furthermore, Sebastian Sudholt and Gernot A. Fink earned best paper honors for their work entitled PHOCNet: A Deep Convolutional Neural Network for Word Spotting in Handwritten Documents.

In this paper a Deep Learning approach for word spotting was presented which achieves state-of-the-start results across a number of challenging word spotting tasks thereby outperforming previous methods by a large margin. The same method was also used in the groups contribution to the word spotting competition.

Award Certificates
Sebastian Sudholt and Gernot A. Fink presenting the awards


Pattern Recognition Group wins in the ICDAR 2015 Key Word Spotting Competition

The Pattern Recognition in Embedded Systems Group has won the training-free track of the 2015 Key Word Spotting Competition held during the 13th International Conference on Document Analysis and Recognition. The method presented by Leonard Rothacker, Sebastian Sudholt and Gernot A. Fink was able to largely outperform their opponent's approaches in a segmentation-free and a segmentation-based scenario.

Key Word Spotting is the problem of retrieving word images from a document image collection relevant to a specific query. In the training-free track of the 2015 Key Word Spotting Competition word images were used as queries which is commonly referred to as Query-by-Example. The track was further subdivided into two assignments: for the first assignment a perfect segmentation for each word image in the document image collection was given while for the second task entire document pages where presented with no segmentation whatsoever. In both assignments, the Pattern Recognition in Embedded Systems Group achieved the highest score and consecutively claimed first place in the training-free track. A complete evaluation of the competition can be found here while the method presented is described in detail here.

The award winning team
The award winning team from left to right: Leonard Rothacker, Sebastian Sudholt, Gernot A. Fink


P5 Projectgroup award 2013

Winner of the p5 award 2013 is PG 568: "TabScript - Handwriting recognition on Android based tablets". The award is sponsored by the Alumni Computer Science Dortmund and given to student projects with a high practical relevance. In a very close voting between five interesting projects the TabScript group was able to convince the audience of the DAT2013 (Day of the Alumni Computer Science Dortmund) by the brave presentation of a live demo.

Over the last year the students developed a notepad application for Android tablets that supports handwritten input instead of the softkeyboard. Using Hidden-Markov-Models the handwritten text is recognized and translated into machine readable text. The ESMERALDA toolkit is used for implementing the Hidden-Markov-Model. A character model is trained on data from Unipen database that is publicly available for research purposes. In addition, different dictionaries with about 2500 words are used in order to recognize complete handwritten words. Dictionaries containing the most common words in German and English were included in the application. In case studies the trained models showed a word recognition rate of around 79%.  

Students: Sulejman Begovic, Rebecca Doherty, Shinazi Faruki, Daria Filatova, Nina Hesse, Dennis Kesper, Julian Kürby, Niclas Raabe, Johann Straßburg, Christian Wieprecht

p5 Award ceremony
p5 projectgroup award


Best Poster Award on the International Conference on Frontiers in Handwriting Recognition 2012, Italy

Ifran Ahmad, M. Sc., has been awarded with the "IAPR Best Poster Award" for the joint publication "KHATT: Arabic Offline Handwritten Text Database". In collaboration between King Fahd University of Petroleum and Minerals, Dhahran, Saudi Arabia, the Pattern Recognition in Embedded Systems group and TU Braunschweig, Germany, a large Arabic handwriting database was created.

Best Poster Award Ceremony (from left to right: Masaki Nakagawa, Bidyut Baran Chaudhuri, Volker Märgner, Irfan Ahmad, Gernot A. Fink, Sebastiano Impedovo)
Best Poster Award Ceremony
(from left to right: Masaki Nakagawa, Bidyut Baran Chaudhuri, Volker Märgner, Irfan Ahmad, Gernot A. Fink, Sebastiano Impedovo)


Robot becomes supporting actor in the new Tatort Dortmund

On April 11, 2012 the movie shooting for the new Tatort Dortmund started in the TEC Center Colani in Lünen. It was the first shooting outside the studio. The Tatort is a famous German TV detective-series that first aired in 1970. The Tatort Dortmund theme, its filming locations and the references to next generation technologies are reflecting the structural change in the Ruhr-Area. Being formerly known for its mining and steel facilities, it has become important in the high-tech sector.

The service robot of the Pattern Recognition Group (Department of Computer Science 12) was participating as a supporting actor. It's task was to welcome the detectives in a fictional high-tech-company.

Tatort shooting at TEC Center Colani
Tatort shooting at TEC Center Colani

A short TV report about the shooting can be found in the WDR Mediathek (German):


Best Paper Award for Akmal Junaidi

Akmal Junaidi, M. Sc., has been awarded with the "Best MOCR Student Paper Award" on the "Joint Workshop on Multilingual OCR and Analytics for Noisy Unstructured Text Data" in Bejing, China. The workshop was held in conjunction with the renowned "International Conference on Document Analysis and Recognition" (ICDAR). Mr. Junaidi is conducting his PhD research at LS XII of the Faculty of Computer Science in the field of automatic analysis and recognition of handwritten documents in Indonesian Lampung script, and is supported by a grant from the Indonesian government. The award-winning work is entitled "Lampung - a New Handwritten Character Benchmark: Database, Labeling and Recognition".

Photograph of Akmal Junaidi with co-authors
Prize winner Akmal Junaidi (middle) with his co-authors Szilárd Vajda (left) and Gernot A. Fink.

Sub content

Postal Address

Technische Universität Dortmund
Fakultät für Informatik
LS XII AG Mustererkennung
Otto-Hahn-Str. 16, Einfahrt 37
44227 Dortmund

Travel Information 

For detailed travel information and maps, please refer to the

contact page.