Skip Main Navigation
Page Content

Save This Event

Event Saved

YOW! DepthFirst Workshop 2018 - Sydney- Dean Wampler, Hands-on Kafka Streaming Microservices - May 16

YOW! Australia - Conferences & Workshops

Wednesday, 16 May 2018 from 8:30 am to 2:00 pm (AEST)

YOW! DepthFirst Workshop 2018 - Sydney- Dean Wampler,...

Ticket Information

Ticket Type Sales End Price * Fee Quantity
Hands-on Kafka Streaming Microservices with Dean Wampler 15/05/2018 $499.00 $0.00
* Prices include GST

Share YOW! DepthFirst Workshop 2018 - Sydney- Dean Wampler, Hands-on Kafka Streaming Microservices - May 16

Event Details

YOW! Sydney Workshop


Hands-on Kafka Streaming Microservices

with Akka Streams and Kafka Streams

with Dean Wampler


If you're building streaming data apps, your first inclination might be to reach for Spark Streaming, Flink, Apex, or similar tools, which run as services to which you submit jobs for execution. But sometimes, writing conventional microservices, with embedded stream processing, is a better fit for your needs.

In this hands-on tutorial, we start with the premise that Kafka is the ideal backplane for reliable capture and organization of data streams for downstream consumption. Then, we build several applications using Akka Streams and Kafka Streams on top of Kafka. The goal is to understand the relative strengths and weaknesses of these toolkits for building Kafka-based streaming applications. We'll also compare and contrast them to systems like Spark Streaming and Flink, to understand when those tools are better choices. Briefly, Akka Streams and Kafka Streams are best for data-centric microservices, where maximum flexibility is required for running the applications and interoperating with other systems, while systems like Spark Streaming and Flink are best for richer analytics over large streams where horizontal scalability through "automatic" partitioning of the data is required.

Each engine has particular strengths that we'll demonstrate:

  • Kafka Streams is purpose built for reading data from Kafka topics, processing it, and writing the results to new topics. With powerful stream and table abstractions, and an "exactly-once" capability, it supports a variety of common scenarios involving transformation, filtering, and aggregation.
  • Akka Streams emerged as a dataflow-centric abstraction for the general-purpose Akka Actors model, designed for general-purpose microservices, especially when _per-event_ low-latency is important, such as for complex event processing, where each event requires individual handling. In contrast, many other systems are efficient at scale, when the overhead is amortized over sets of records or when processing "in bulk". Also because of its general-purpose nature, Akka Streams supports a wider class of application problems and third-party integrations, but it's less focused on Kafka-specific capabilities. 

Kafka Streams and Akka Streams are both libraries that you integrate into your microservices, which means you must manage their lifecycles yourself, but you also get lots of flexibility to do this as you see fit.

In contrast, Spark Streaming and Flink run their own services. You write "jobs" or use interactive shells that tell these services what computations to do over data sources and where to send results. Spark and Flink then determine what processes to run in your cluster to implement the dataflows. Hence, there is less of a DevOps burden to bear, but also less flexibility when you might need it. Both systems are also more focused on data analytics problems, with various levels of support for SQL over streams, machine learning model training and scoring, etc.

For the tutorial, you'll be given an execution environment and the code examples in a GitHub repo. We'll experiment with the examples together, interspersed with short presentations, to understand their strengths, weaknesses, performance characteristics, and lifecycle management requirements.

Before the tutorial, please clone this GitHub repo and follow the setup instructions in the README:


Workshop Requirements

  • Laptop with wifi-internet access. 
  • An internet connection



Workshop Schedule

8:30 – 9:00 am Registration and arrival tea/coffee 
9:00am  Workshop begins
10:30 - 10:55 am Morning Tea (included)
1:00 pm Workshop ends
1:00 - 2:00 pm Lunch (included)

 Please note times may vary at the workshop facilitator's discretion.


About the Speaker: Dean Wampler

Dean WamplerDean Wampler, Ph.D., is VP of Fast Data Engineering at Lightbend, where he leads the development of their Fast Data Platform for streaming data and microservice applications using Spark, Flink, Kafka, Akka, and other tools. Dean is the author or co-author of three O’Reilly books on Scala, Functional Programming, and Hive. He contributes to several open source projects and he co-organizes and speaks at many technology conferences and Chicago-based user groups.



YOW! Data returns to Sydney for the third conference this May! The two day conference focuses on exploring data driven technology and applications. Call for presentations open until 18 March 2018

YOW! Lambda Jam is heading to Sydney in May 2018! The event aims at expanding the skills of functional programmers. The conference focuses on applied functional programming in languages such as Clojure, Scala, Haskell, Erlang and F#. Call for presentations open until 18 March 2018



Taking place in Melbourne, Brisbane and Sydney, this is YOW!'s signature and biggest event of the year. Last year over 2,000 Developers and IT Professionals attended the conference and workshop. 

Sydney 29-30 Nov | Brisbane 3-4 Dec | Melbourne 6-7 Dec


Group tickets and Sponsorship 

Please email if you'd like to purchase group tickets. 
Contact the sponsorship team to request a copy of our sponsorship package or for more details on how we can tailor a specific package for your needs.


Transfer, Cancellation and Refunds 

In the event that you have booked for the conference or workshops and are unable to attend, you may send another person to attend in your place provided you inform YOW! organisers of the change not less than 72 hours prior to the conference or workshops. Please see our full terms and conditions.  

For more information, visit or contact

Have questions about YOW! DepthFirst Workshop 2018 - Sydney- Dean Wampler, Hands-on Kafka Streaming Microservices - May 16? Contact YOW! Australia - Conferences & Workshops

Save This Event

Event Saved

When & Where

Cliftons Sydney
60 Margaret Street
Sydney, NSW 2000

Wednesday, 16 May 2018 from 8:30 am to 2:00 pm (AEST)

  Add to my calendar
YOW! DepthFirst Workshop 2018 - Sydney- Dean Wampler, Hands-on Kafka Streaming Microservices - May 16
Things to do in Sydney Conference Science & Tech

Please log in or sign up

In order to purchase these tickets in installments, you'll need an Eventbrite account. Log in or sign up for a free account to continue.