Perception, Language, Action
The research theme “Perception, Language, Action” brings together researchers in the research specialisation areas of Computer Vision, Imaging, Natural Language Processing, Embedded Robotics, and Cognitive Science.
While the individual research areas focus on, to some extent, specific theoretical questions and related applications, the areas of computer vision and imaging science have always been closely related by sharing techniques, methodology and tools related to capturing data (in the form of images, videos, 3D, multimodal and multispectral data), modelling and analysing visual information.
The aim of Natural Language Processing is to develop computational models for analysing and generating human language. While NLP and CV/imaging have traditionally been separate research fields with quite specific theoretical and methodological underpinnings, in the era of machine learning, big data and large language/vision models, some parts of the methodology and tools have started to converge. This also coincides with synergistic effects exploited in multimodal datasets/models leveraging semantics from the language models to facilitate image and video data understanding.
Research in Robotics encompasses fundamental challenges in developing systems that can interact with the environments either through manipulation and/or navigation. While some research problems can be quite specific, in a more general setting of Cognitive robotics/systems, vision and language need to be brought together with robotics to enable perception-action cycle.
Overall, organising the researchers around the theme “Perception, Language, Action” can prove beneficial in terms of organising lectures/events that would be of interest to all involved, exchanging the experiences and sharing the common tools (especially related to large generative models, compute/Baskerville, etc.) and potentially developing larger join projects that require expertise that goes beyond the narrow domains.
The group could also become an important player in AI-driven multidisciplinary initiatives across the university, as most of such projects require AI/ML techniques that involve perception, language and/or action.
Theme Lead
Professor of Medical Imaging
School of Computer Science
Professor Hamid Dehghani is Professor of Medical Imaging at the School of Computer Science and the Healthcare Technologies Institute (HTI). His research focusses on non-invasive imaging and measurement of physiological information from biological tissue.
As a part of his interdisciplinary work, Hamid is involved with the following University-wide activities:
- Telephone
- +44 (0) 121 414 8728
- Email
- h.dehghani@cs.bham.ac.uk
Theme Members
Assistant Professor
School of Computer Science
Dr Ruchit Agrawal is an Assistant Professor and Head of CS Outreach at the University of Birmingham Dubai. Prior to this, he was a postdoctoral research scientist at the University of Oxford, where he worked on Artificial Intelligence for Healthcare. He received his PhD in Computer Science under the prestigious Marie-Curie scholarship from the Queen Mary University of London. Dr Agrawal is an ...
- Email
- r.r.agrawal@bham.ac.uk
Assistant Professor (Education)
School of Computer Science
Mubashir Ali is an Assistant Professor (Education) in the School of Computer Science at the University of Birmingham. His research interest includes machine learning, data science, big data analytics, smart services for smart cities, smart energy management, natural language processing, resource development for low resource languages, social media analysis, sentiment analysis, and software ...
- Email
- m.ali.16@bham.ac.uk
Associate Professor
Head of External Partnerships of Computer Science
School of Computer Science
Dr Hyung Jin Chang is an associate professor in the School of Computer Science at the University of Birmingham. He received a PhD in machine learning and computer vision at Perception and Intelligence Lab, Seoul National University, in 2013. As a post-doctoral researcher, he worked at Imperial College London and was involved in several EU projects (EU FP7 GRANT 612139 and EU H2020 GRANT 643783) ...
- Email
- h.j.chang@bham.ac.uk
Assistant Professor of Artificial Intelligence
School of Computer Science
Dr Yue Feng is an Assistant Professor in the School of Computer Science at the University of Birmingham. Her research interests lie in natural language processing and information retrieval, especially on large language model powered AI agents, multimodal foundation models, trustworthy AI.
She is always looking for highly motivated PhD students and research assistant. Please feel free to get in ...
- Email
- y.feng.6@bham.ac.uk
Senior Lecturer of Computer Science
School of Computer Science
Dr Shan He is a Senior Lecturer in Computational Biology in the School of Computer Science, at the University of Birmingham. For more information, please see Shan's homepage.
- Email
- s.he@cs.bham.ac.uk
Assistant Professor in Computer Science
School of Computer Science
- Email
- j.jiao@bham.ac.uk
Professor of Artificial Intelligence
School of Computer Science
Professor Mark Lee is a professor of artificial intelligence in the School of Computer Science. His research interests are focussed on Natural Language Processing. He is specifically interested in Sentiment Analysis of text, the automatic identification and understanding of metaphor and the effects of pragmatic inference in dialogue processing. More recently he has been investigating the ...
- Email
- m.g.lee@bham.ac.uk
Senior Lecturer
School of Computer Science
Dr Max Little is a world-leading expert in signal processing and machine learning. His research in machine learning for digital health is highly influential and is the basis of advances in basic and applied research into quantifying neurological disorders such as Parkinson's disease. He has published over 60 articles in the scientific literature on the topic, two patents, and a textbook. He is an ...
- Email
- littlemz@bham.ac.uk
Associate Professor
School of Computer Science
Dr Jian Liu received his Ph.D. in mathematics from UCLA. He is currently an Associate Professor at the School of Computer Science, University of Birmingham. His research interests include fundamental questions of neural computation, computational neuroscience, and brain-inspired computation for artificial intelligence, as well as applications to robotics, medicine, and brain-machine interface.
Fo ...
- Email
- j.liu.22@bham.ac.uk
Assistant Professor
School of Computer Science
Dr Qingjie Meng is an Assistant Professor in machine learning and AI in healthcare. She received a PhD in BioMedIA group, Department of Computing, Imperial College London. After PhD, she worked as a post-doctoral research associate at Department of Computing, Imperial College London.
Her research stands at the interface between AI, machine learning and medical image analysis. She has worked on ...
- Email
- m.qingjie@bham.ac.uk
Associate Professor
School of Computer Science
Rickson Mesquita is an Associate Professor of Medical Imaging at the School of Computer Science. His research focuses on developing and combining computational methods, biophysical modelling, and instrumentation for measuring brain function. He is particularly interested in diffuse optical techniques, such as functional near-infrared spectroscopy (fNIRS) and diffuse correlation ...
- Email
- r.c.mesquita@bham.ac.uk
Senior Lecturer in Computer Science
School of Computer Science
Dr. Felipe Orihuela-Espina is a Senior Lecturer in the School of Computer Science.
He obtained his PhD in Computer Science from the University of Birmingham (UK) in 2005. Afterwards, he moved to Mexico where he was appointed lecturer at the Universidad Autonoma del Estado de Mexico (UAEMex). He joined Imperial College as a research associate in 2007 and later in 2011 became postdoctoral ...
- Email
- f.orihuela-espina@bham.ac.uk
Deputy Head of School of Computer Science (for Dubai)
Professor of Medical AI
Dubai Campus
Kashif Rajpoot is Deputy Head of School of Computer Science (for Dubai) and a Professor of Medical AI.
His research focuses on developing solutions for problems in medical image analysis, cardiac electrophysiology, computational pathology, artificial intelligence, and data science. He has published over 60 research papers in leading journals and conferences of his domain.
- Email
- k.m.rajpoot@bham.ac.uk
Associate Professor
School of Computer Science
Phillip Smith is an associate professor and the Head of Student Development and Support in the School of Computer Science at the University of Birmingham.
Phillip is interested in natural language processing, in particular, sentiment analysis. Phillip is investigating how discourse function affects supervised machine learning classifiers trained to tackle this problem.
Please follow the link ...
- Email
- p.smith.7@cs.bham.ac.uk
Assistant Professor (Education)
School of Computer Science
Jizheng is an Assistant Professor in the School of Computer Science at the University of Birmingham. His research is mainly about using ML/DL for Ontology Learning and other NLP-related tasks. Before joining Birmingham, he spent the last 13 years working in the IT department in various Universities – managing the Research IT team/function to support various research projects across the ...
- Email
- j.wan.1@bham.ac.uk
School of Computer Science
Birmingham Fellow
Turing Fellow
Institute of Microbiology and Infection
Dr Wheeler’s work focuses on the development of computational screening tools for identifying DNA from emerging biological threats, establishing genomic pathogen surveillance in resource-limited settings, One Health surveillance of antimicrobial resistance, and the ethical development of artificial intelligence (AI) for health applications.
- Email
- n.wheeler@bham.ac.uk