Video Resources

Join Tim Berglund as he breaks down the intricacies of anomaly detection, emphasizing the pitfalls of traditional methods.

Learn practical examples for implementing automated monitoring and anomaly using StarTree ThirdEye.

StarTree's ThirdEye, an automated anomaly detection system that operates seamlessly with Apache Pinot, transforms your e-commerce operations by identifying and flagging potential fraudulent activities in real-time.

Sovrn is leveraging Tiered Storage to manage data storage, which allows them to save money on cloud storage and keep their customers' data for when they need it.

Tim and Neha explain the need for a system that combines the speed of tightly-coupled systems and the cost-efficiency of decoupled systems.

See how the concept of Tiered Storage in StarTree Cloud compares to the wizarding world of Harry Potter in this lightboard video.

Discover the world of Apache Pinot, a real-time OLAP database, through this introduction module.

Tim explains how tables in Apache Pinot are designed for scalability, handling massive amounts of data with ease.

Learn about the crucial roles of servers in hosting segments and handling query processing.

Learn the pivotal role of the controller in managing the cluster, including node failure recovery, segment replication, and assignment.

Discover how minions handle offload tasks such as segment creation, merging, and purging for offline tables.

Explore the intricacies of Apache Pinot's indexing mechanisms in this module, where Tim delves into nine key indexes.

Understand the process of batch ingestion in Apache Pinot, including two primary methods: batch (offline) and streaming (real-time).

Explore the dynamic process of streaming data ingestion into Apache Pinot, which is essential for handling real-time data scenarios.

Learn the advanced aspects of Apache Pinot's architecture, including its design for executing low-latency queries with high concurrency.

Discover the advanced functionality of upserts and deletes in Pinot, designed to handle mutable entities and rapidly changing data.

Will Gan (Software Engineer, DoorDash) focuses on two use cases at DoorDash: Mx Portal Ads Campaign Reporting and Risk Platform Dashboarding.

Why Beaconstac moved from ElasticSearch to Apache Pinot for their Analytics Needs

StarTree CEO, Kishore Gopalakrishna, discusses Apache Pinot and performance comparisons with Apache Druid at Crunch Data Conference 2018 in Budapest.

Journey through 45,000 years of history with Tim Berglund and Rachel Pedreschi

Examine agriculture, the steam engine, the machine power of factories, the evolution of print, and the advent of the telegraph.

Mark Needham is back with another StarTree Recipe, this time about using JSON indexes in Apache Pinot. He first demonstrates how to ingest semi-structured data Apache Kafka using the kcat command line tool, before showing how to configure Apache Pinot to ingest the data from Kafka. He further illustrates querying the Pinot table, using the JSON match function and details handling of arrays, nested data, and exclusion of fields. The tutorial underscores the improved efficiency and flexibility of using JSON indexes introduced in Pinot 0.12.

In this StarTree Recipe, Mark Needham explains how to merge segments in real-time tables in Apache Pinot, which we want to do as small segments can lead to higher query latency. He demonstrates how to use the kcat tool to setup the Pinot schema, followed by the table config, which includes the MergeRollupTask. After checking data ingestion through the Pinot UI, Mark shows how to manually run the MergeRollupTask, and what it looks like when the segments are merged successfully. This process, when done properly, can improve query performance significantly.

Mark is back with another recipe where he explains the process of rolling up segments in real-time tables in Apache Pinot. This process aims to reduce the amount of space that data occupies by aggregating it up to the nearest minute, hour, or even day. He uses an example involving product purchases streamed in Kafka, which are aggregated according to parameters such as minimum stock, sum of quantity, maximum price, and sum of sales amount. Needham also demonstrates how these rollups are configured in Apache Pinot, and visualized via the Pinot UI, while explaining the concept of task types, ingestion configuration, segment names, and the influence of time intervals on aggregation.

Join Mark Needham from Startree as we delve into filtering data streams during ingestion in Apache Pinot! With help from a flight-related dataset, we'll learn how to filter events on their way into Apache Pinot without needing to use a stream processor. Whether you're a beginner or experienced with Apache Pinot, this tutorial is packed with hands-on insights to elevate your streaming data game.

Dive deep into the world of full upserts in Apache Pinot with Mark Needham. This tutorial unveils the process of modifying and updating records, emphasizing real-time data streaming. Utilizing a NASDAQ stock prices simulator and Apache Kafka, Mark illustrates the distinction between full and partial upserts, the role of Redpanda Keeper in topic management, and the importance of consistency in partition keys and Pinot configurations.

Mark Needham explains multi volume support in Apache Pinot, with help of an example showing how to store hot and cold data on

In this video we'll do a deep dive into Apache Pinot's Geospatial index, learning when it gets used, as well as what happens when the query engines are querying a geoindexe

Join Mark Needham as he unravels the intricacies of partial upserts in Apache Pinot. In this comprehensive guide, Mark demonstrates the process using a simulated data generator mimicking motor traffic at imaginary junctions. You’ll be walked through the creation of a Kafka topic with Redpanda Keeper, and witness real-time data streaming using JQ and K cat. Discover the significance of the junction ID as a key and delve deep into the configuration and optimization of Pinot schema for efficient data handling. Watch as he navigates through table configs, ensuring optimal settings for partial upsert functionality. Witness data transformation and understand the dynamics of min/max speeds and vehicle counts. Lastly, explore the Pinot UI and query execution, offering insights into real-time data evolution.

This video is all about the segment threshold in Apache Pinot. Mark Needham explains what it is, why we should care, and how to go about configuring it.

In this video we explore the types of geospatial objects that can be stored in Apache Pinot. We also learn about the geospatial index and use it to write a super fast query to find the points within 50km of the centre of San Francisco.

Dive deep into data serialization and ingestion with Mark Needham in this informative session on ingesting Avro encoded data into Apache Pinot. Learn to generate data in Avro format using the Confluent Kafka library, create topics with Redpanda Keeper, and navigate real-time data streaming. This walkthrough covers transforming Avro to Pinot schema and explores telemetry data and streaming configurations. Perfect for those looking to master real-time data handling and processing.