The CSSA have lined up a Tech Talk and Q&A Session with a former ANU Student - Matt Duggan - and Indeed Tokyo Engineering Manager to give you an opportunity to find out who they are, what they do, and how they solve big data problems at scale. It promises to be a very interesting talk!

Title

RAD - How To Replicate Terabytes of Data Around the World Every Day

Abstract

At Indeed, we use massive amounts of data to build our products and services. At first, we relied on rsync to distribute these data to our servers. This rsync system lasted for ten years before we started to encounter scaling challenges. So we built a new system on top of BitTorrent to improve latency, reliability, and throughput. Today, terabytes of data flow around the world every day between our servers. In this talk, I'll describe what we needed, what we created, and the lessons we learned building a system at this scale.

Speaker

Matthew Duggan - Engineering Manager
"I'm an Engineering graduate from ANU now at Indeed, the world's largest job site, helping people around the world get jobs.  My team uses Natural Language Processing and Machine Learning to extract salary data from millions of jobs every day.  We deliver the data to job seekers on indeed.com, and aggregate it into company pages to help people make career decisions".

Date: Thursday 11th August, 2016 

Time: 1pm start

Location: Engineering Lecture Theatre (Building # 32)

Registration: Not Required