Back to Talks
Making my Apache Spark™ talk more interesting using AI

Making my Apache Spark™ talk more interesting using AI

Celeste Horgan

Date
Tuesday, April 14, 2026
Time
2:30 PM - 3:00 PM
Room
Platinum [2nd Floor]
Talk PyData: Data Handling & Data Engineering
Transcription

In this talk, we'll walk through a basic Apache Spark data pipeline which reads in an image dataset, processes it, and detects raccoons. That said, sponsored talks are always boring: let's see what we can do to spice things up using AI! We'll use Snowflake's Cortex Code CLI coding agent together to improve the talk live, taking suggestions from the audience as we go!

Attendees to the talk can expect to learn the following: - What Apache Spark is, what it excels at, and how to set up a basic cluster - How to use HuggingFace ViT (vision transformer) to run a basic computer vision setup - A little bit about Snowflake's new coding agent, Cortex Code CLI (the part where we advertise at you, but I promise it will be fun) - Building a basic Streamlit app - .. and whatever other fun we get up to together!

Join for a session full of fun experimentation with interesting tools – and learn a bit about data pipelines too! This session is suitable for beginner to intermediates!coding agent, live!