We believe that data should be at the heart of every decision at Skyscanner, so it’s important that our engineers have the tools to seamlessly log the data that will help them with those decisions. In this talk, we discuss the approach we’ve taken to enable this and reflect on some of the challenges and lessons learnt. We’ll briefly look at some of the technology underpinning this, including Kafka, Logstash, Elasticsearch, Secor, AWS (S3, lambda), Samza, Protocol Buffers and others, and look at the custom tooling built in Skyscanner.
Supported by
