Dr Zhenchang Xing, from the ANU Research School of Computer Science will present this seminar.
Graphical User Interface (GUI) is an important means for users to interact with the virtual world.
The GUI design, implementation and testing consume significant resources and budgets in software development process. The fact that GUI development involves much repetitive work indicates a good opportunity to boost the productivity of GUI development through AI technologies.
In this talk, I will discuss the two computer-vision based techniques I have recently developed to "see" what components a GUI is composed of and to "understand" the visual effects of GUI animations.
I will also place these two pieces of work in my vision of AI-boosted software development in which I am actively investigate Human-Computer Interaction behavior analytics, knowledge graph methods, and recommendation systems for software engineering.