Machine Learning Hyper-parameter Optimisation using Evolutionary Algorithms

Description

The accuracy and generalisability of a machine learning model is determined by the right choice of hyper-parameters.  All models have hyper-parameters (even non-parametric models) and the wrong choice will result in a poor fit to the data, and useless predictions.  Finding the optimal set of hyper-parameter for any model is always the most time consuming part of machine learning, and is usually done by extensive (and sometimes exhaustive) grid searches, or highly variable random selection.  An alternative is to use evolutionary algorithms which apply search principles analogous to those of natural evolution in a variety of different problem domains.  In this project you will implement a genetic algorithm and differential evolution algorithm for hyper-parameter optimization of machine learning models in python, test the performance of different conditions (mutations and generations), and compare the result (accuracy and computational efficiency) to random and grid searching methods. Data sets will be provided.

Goals

To produce a python module for a library for general use by machine learning researchers, and a scientific publication.

Requirements

Python programming and an interest in data science and machine learning is essential.

Keywords

machine learning, data science, chemistry, materials, nanomaterials, nanotechnology, artificial intelligence

Updated:  1 June 2019/Responsible Officer:  Dean, CECS/Page Contact:  CECS Marketing