The Centre for Electronics Frontiers (CEF) led by Regius Chair of Engineering Prof Prodromakis, brings together diverse and interdisciplinary expertise for transforming modern society through technology. Our ambition is to push the frontiers of electronics through emerging technologies, disrupting current ways of thinking by innovating advanced nano/biosensors, safe and efficient energy storage solutions and novel hardware for AI. We are offering prospective PhD students the opportunity to join our team, interested in devoting their passion for addressing some of the challenges we have identified.
The project aims at exploring the potential benefits of employing software optimization techniques for modelling and training Large Language Models (LLMs), with a specific focus on Transformers, targeting various unconventional hardware architectures and computing domains (Binary, Analog, Bitstream). The project targets developing Python-based libraries for training and inference that are friendly to unconventional computing domains. These libraries should be eventually integrated with PyTorch and/or TensorFlow to facilitate modelling and quantization-aware training for different AI hardware architectures.
The required skills are as follows:
- Excellent programming skills using Python (mandatory).
- ML/AI modelling using PyTorch or TensorFlow (mandatory).
- DNN quantization and pruning techniques.
- TCL and Makefile scripting.
- Basics of computer architecture.
Further Information:
Group website: https://cef.eng.ed.ac.uk/
The University of Edinburgh is committed to equality of opportunity for all its staff and students, and promotes a culture of inclusivity. Please see details here: https://www.ed.ac.uk/equality-diversity
Closing Date:
Principal Supervisor:
Assistant Supervisor:
Eligibility:
Minimum entry qualification - an Honours degree at 2:1 or above (or International equivalent) in a relevant science or engineering discipline, possibly supported by an MSc Degree. Further information on English language requirements for EU/Overseas applicants.
Funding:
Tuition fees + stipend are available for applicants who qualify as Home applicants.
To qualify as a Home student, you must fulfil one of the following criteria:
• You are a UK student
• You are an EU student with settled/pre-settled status who also has 3 years residency in the UK/EEA/Gibraltar/Switzerland immediately before the start of your Programme. (International students not eligible.)
