Self-Supervised Learning for Complex Visual Understanding
Program start date | Application deadline |
2024-07-01 | - |
2024-10-01 | - |
2025-01-01 | - |
Program Overview
This PhD program focuses on advancing computer vision through self-supervised learning (SSL), a technique that enables models to learn from unlabeled data. The program aims to develop SSL methods for complex visual understanding tasks, such as autonomous navigation and medical image analysis. The successful candidate will have access to state-of-the-art facilities and work with a team of experienced researchers in AI and machine learning.
Program Outline
Other:
- This PhD project aims to advance the state-of-the-art in computer vision through the development and application of self-supervised learning (SSL) techniques.
- The focus will be on achieving complex visual understanding tasks without relying on extensive labelled datasets.
- Traditional supervised learning requires human experts to provide labelled examples and explicit instructions to train AI models. However, obtaining large labelled datasets can be expensive and time-consuming. Most importantly, SL seriously restricts the machine's capability to generalise and learn new unseen scenarios.
- Inspired by human learning, SSL leverages the intrinsic structure within unlabelled data to train models effectively.
- Self-supervised learning is a machine learning paradigm where a model learns from the data without explicit external labels, creating a surrogate task that the model can learn to solve without the need for external annotations.
- Example Research Components:
- Contrastive Learning: The model is trained to differentiate between positive pairs (similar samples) and negative pairs (dissimilar samples).
- Representation Learning: learn rich and meaningful representations from visual data without explicit supervision. The goal is to enable the model to automatically discover relevant features and hierarchical representations.
- Predictive Learning: The model is trained to predict certain parts of the input data. e.g. predicting the next word in a sentence, filling in missing parts of an image.
- Generative Models: Training a model to generate a part of the input data or the entire input from some part of it, e.g. generative adversarial networks (GANs). This can involve developing cross-modal self-supervised learning techniques.
- Temporal Learning: Learning representations based on the temporal order of data
- Transfer Learning and Generalization: Evaluate the transferability of learned representations across different domains and tasks.
- Real-world Applications and contribution: Apply the developed self-supervised learning techniques to real-world problems, such as autonomous navigation, scene understanding, or medical image analysis. The project will evaluate the approach and model/algorithm performance on benchmark datasets and its application potential in collaboration with industry partners.
- Loughborough University and Department of Computer Science: Loughborough University has been awarded gold for student experience, gold for student outcomes and gold overall in the 2023 Teaching Excellence Framework- Triple Gold in TEF 2023. The Department of Computer Science has an excellent research record in AI, machine learning, robotics, computer vision and data science.
- The successful candidate will have access to robotics and AI laboratories, high-spec computing facilities (e.g., A100 GPUs), HPC, and £5.8M DigLabs, complementing a £9m investment in research and teaching.
- You will have regular supervision meetings and work with a strong AI research team including over 30 PhDs/PDRAs/academic staff in the department.
- You will take part in various outreach and impact generation activities, and develop your career profile throughout your PhD study.
UK fee: £4,712 Full-time degree per annum International fee: £26,000 Full-time degree per annum University fees and charges can be paid in advance and there are several methods of payment, including online payments and payment by instalment. Fees are reviewed annually and are likely to increase to take into account inflationary pressures.
Loughborough University
Overview:
Loughborough University is a public research university located in Loughborough, Leicestershire, England. It is renowned for its strong academic programs, particularly in sports science, engineering, and business. The university boasts a vibrant campus life and a strong focus on research and innovation.
Student Life and Campus Experience:
Loughborough University offers a diverse and engaging campus experience. Students can participate in a wide range of extracurricular activities, including sports, societies, and volunteering opportunities. The university has a strong sporting heritage and is home to world-class facilities. Students can also enjoy a vibrant social scene with numerous bars, restaurants, and events happening on campus.
Key Reasons to Study There:
World-class facilities:
Loughborough University boasts state-of-the-art facilities, including a dedicated sports village, a modern library, and cutting-edge research labs.Strong academic reputation:
The university is consistently ranked among the top universities in the UK for its academic excellence.Vibrant campus life:
Students can enjoy a lively and diverse campus community with numerous opportunities for social interaction and personal development.Focus on research and innovation:
Loughborough University is a leading research institution, with a strong focus on tackling real-world challenges.Excellent career prospects:
Graduates from Loughborough University are highly sought after by employers, with strong career prospects in various fields.Academic Programs:
Loughborough University offers a wide range of undergraduate and postgraduate programs across various disciplines, including:
Engineering:
Aerospace, Chemical, Civil, Electrical, Mechanical, and more.Business and Economics:
Accounting, Finance, Management, Marketing, and more.Sport Science:
Exercise Science, Sports Coaching, Sports Management, and more.Humanities and Social Sciences:
Psychology, Sociology, History, and more.Science and Technology:
Chemistry, Physics, Computer Science, and more.Other:
Loughborough University has a strong commitment to sustainability and social responsibility. The university is actively working towards achieving net-zero carbon emissions and promoting inclusivity and diversity within its community.
Entry Requirements:
UK Applicants:
- Applicants should have, or expect to achieve, at least a 2:1 Honours degree in computer science or a related science and engineering subject.
- A relevant Master’s degree, experience in machine learning, deep learning and computer vision, strong programming skills, and passion in interdisciplinary research and innovation will be advantages.
International Applicants:
- Applicants should have, or expect to achieve, the equivalent of a UK 2:1 Honours degree in computer science or a related science and engineering subject.
- A relevant Master’s degree, experience in machine learning, deep learning and computer vision, strong programming skills, and passion in interdisciplinary research and innovation will be advantages.
Language Proficiency Requirements:
- Applicants whose first language is not English are required to demonstrate proficiency in English at a recognized qualification such as IELTS.
- Students from affiliated colleges in China may be considered under special arrangements.
- Students who do not meet the above requirements may occasionally be considered if they have a relevant degree, can show good grades in relevant subjects, and/or have substantial relevant work experience.