<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>kafka &#8211; Noise</title>
	<atom:link href="https://noise.getoto.net/tag/kafka/feed/" rel="self" type="application/rss+xml" />
	<link>https://noise.getoto.net</link>
	<description>The collective thoughts of the interwebz</description>
	<lastBuildDate>Wed, 26 Nov 2025 00:00:10 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=6.8.2</generator>
	<item>
		<title>Real-time data quality monitoring: Kafka stream contracts with syntactic and semantic test</title>
		<link>https://noise.getoto.net/2025/11/26/real-time-data-quality-monitoring-kafka-stream-contracts-with-syntactic-and-semantic-test/</link>
		
		<dc:creator><![CDATA[Grab Tech]]></dc:creator>
		<pubDate>Wed, 26 Nov 2025 00:00:10 +0000</pubDate>
				<category><![CDATA[data]]></category>
		<category><![CDATA[Data processing]]></category>
		<category><![CDATA[Data Science]]></category>
		<category><![CDATA[Engineering]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Performance]]></category>
		<category><![CDATA[Real-time streaming]]></category>
		<guid isPermaLink="false">https://engineering.grab.com/real-time-data-quality-monitoring</guid>

					<description><![CDATA[Introduction

In today’s data-driven landscape, monitoring data quality has become a critical need for ensuring reliable and efficient data usage across domains. High-quality data is the backbone of AI innovation, driving efficiency and unlocking new o...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Netflix Tudum Architecture: from CQRS with Kafka to CQRS with RAW Hollow</title>
		<link>https://noise.getoto.net/2025/07/10/netflix-tudum-architecture-from-cqrs-with-kafka-to-cqrs-with-raw-hollow/</link>
		
		<dc:creator><![CDATA[Netflix Technology Blog]]></dc:creator>
		<pubDate>Thu, 10 Jul 2025 19:31:06 +0000</pubDate>
				<category><![CDATA[cqrs]]></category>
		<category><![CDATA[data architecture]]></category>
		<category><![CDATA[hollow]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[tudum]]></category>
		<guid isPermaLink="false">https://medium.com/p/86d141b72e52</guid>

					<description><![CDATA[By Eugene Yemelyanau, Jake GriceIntroductionTudum.com is Netflix’s official fan destination, enabling fans to dive deeper into their favorite Netflix shows and movies. Tudum offers exclusive first-looks, behind-the-scenes content, talent interviews, li...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Building serverless event streaming applications with Amazon MSK and AWS Lambda</title>
		<link>https://noise.getoto.net/2025/06/26/building-serverless-event-streaming-applications-with-amazon-msk-and-aws-lambda/</link>
		
		<dc:creator><![CDATA[Tarun Rai Madan]]></dc:creator>
		<pubDate>Thu, 26 Jun 2025 17:48:50 +0000</pubDate>
				<category><![CDATA[Amazon Managed Streaming for Apache Kafka (Amazon MSK)]]></category>
		<category><![CDATA[Amazon MSK]]></category>
		<category><![CDATA[Analytics]]></category>
		<category><![CDATA[AWS Lambda]]></category>
		<category><![CDATA[Best practices]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[serverless]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=321b36bedc7724560440f82d8170e2b1</guid>

					<description><![CDATA[In this post, we describe how you can simplify your event-driven application architecture using AWS Lambda with Amazon MSK. We demonstrate how to configure Lambda as a consumer for Kafka topics, including a cross-account setup and how to optimize price and performance for these applications.]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Migrating billions of records: moving our active DNS database while it’s in use</title>
		<link>https://noise.getoto.net/2024/10/29/migrating-billions-of-records-moving-our-active-dns-database-while-its-in-use/</link>
		
		<dc:creator><![CDATA[Alex Fattouche]]></dc:creator>
		<pubDate>Tue, 29 Oct 2024 14:00:00 +0000</pubDate>
				<category><![CDATA[database]]></category>
		<category><![CDATA[DNS]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[postgres]]></category>
		<category><![CDATA[Quicksilver]]></category>
		<category><![CDATA[tracing]]></category>
		<category><![CDATA[апи]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=c75c1352e8bc0aa9c8baba69bc56bcaf</guid>

					<description><![CDATA[DNS records have moved to a new database, bringing improved performance and reliability to all customers.]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Making zone management more efficient with batch DNS record updates</title>
		<link>https://noise.getoto.net/2024/09/23/making-zone-management-more-efficient-with-batch-dns-record-updates/</link>
		
		<dc:creator><![CDATA[Alex Fattouche]]></dc:creator>
		<pubDate>Mon, 23 Sep 2024 13:00:00 +0000</pubDate>
				<category><![CDATA[Birthday Week]]></category>
		<category><![CDATA[database]]></category>
		<category><![CDATA[DNS]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[апи]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=e5d9949af3183c84522058960506c569</guid>

					<description><![CDATA[In response to customer demand, we now support the ability to DELETE, PATCH, PUT and POST multiple DNS records in a single API call, enabling more efficient and reliable zone management.]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Building a scalable streaming data platform that enables real-time and batch analytics of electric vehicles on AWS</title>
		<link>https://noise.getoto.net/2024/07/17/building-a-scalable-streaming-data-platform-that-enables-real-time-and-batch-analytics-of-electric-vehicles-on-aws/</link>
		
		<dc:creator><![CDATA[Ayush Agrawal]]></dc:creator>
		<pubDate>Wed, 17 Jul 2024 16:53:05 +0000</pubDate>
				<category><![CDATA[Amazon Managed Streaming for Apache Kafka]]></category>
		<category><![CDATA[Amazon Managed Streaming for Apache Kafka (Amazon MSK)]]></category>
		<category><![CDATA[Amazon OpenSearch]]></category>
		<category><![CDATA[Amazon OpenSearch Service]]></category>
		<category><![CDATA[Amazon QuickSight]]></category>
		<category><![CDATA[Analytics]]></category>
		<category><![CDATA[Best practices]]></category>
		<category><![CDATA[Big Data]]></category>
		<category><![CDATA[Internet of Things]]></category>
		<category><![CDATA[kafka]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=0443fcefa879a8753d6533c3f7f87beb</guid>

					<description><![CDATA[The automobile industry has undergone a remarkable transformation because of the increasing adoption of electric vehicles (EVs). EVs, known for their sustainability and eco-friendliness, are paving the way for a new era in transportation. As environmental concerns and the push for greener technologies have gained momentum, the adoption of EVs has surged, promising to reshape […]]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Enabling near real-time data analytics on the data lake</title>
		<link>https://noise.getoto.net/2024/02/23/enabling-near-real-time-data-analytics-on-the-data-lake/</link>
		
		<dc:creator><![CDATA[Grab Tech]]></dc:creator>
		<pubDate>Fri, 23 Feb 2024 00:22:10 +0000</pubDate>
				<category><![CDATA[Data Analytics]]></category>
		<category><![CDATA[Data Science]]></category>
		<category><![CDATA[Engineering]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Real-time]]></category>
		<category><![CDATA[stream-processing]]></category>
		<guid isPermaLink="false">https://engineering.grab.com/enabling-near-realtime-data-analytics</guid>

					<description><![CDATA[Introduction

In the domain of data processing, data analysts run their ad hoc queries on the data lake. The lake serves as an interface between our analytics and production environment, preventing downstream queries from impacting upstream data ingest...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Rethinking Stream Processing: Data Exploration</title>
		<link>https://noise.getoto.net/2024/01/31/rethinking-stream-processing-data-exploration/</link>
		
		<dc:creator><![CDATA[Grab Tech]]></dc:creator>
		<pubDate>Wed, 31 Jan 2024 00:10:10 +0000</pubDate>
				<category><![CDATA[data streaming]]></category>
		<category><![CDATA[Deployments]]></category>
		<category><![CDATA[Engineering]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Kubernetes]]></category>
		<category><![CDATA[Streaming applications]]></category>
		<guid isPermaLink="false">https://engineering.grab.com/rethinking-streaming-processing-data-exploration</guid>

					<description><![CDATA[Introduction

In this digital age, companies collect multitudes of data that enable the tracking of business metrics and performance. Over the years, data analytics tools for data storage and processing have evolved from the days of Excel sheets and ma...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Kafka on Kubernetes: Reloaded for fault tolerance</title>
		<link>https://noise.getoto.net/2023/12/26/kafka-on-kubernetes-reloaded-for-fault-tolerance/</link>
		
		<dc:creator><![CDATA[Grab Tech]]></dc:creator>
		<pubDate>Tue, 26 Dec 2023 00:10:10 +0000</pubDate>
				<category><![CDATA[AWS]]></category>
		<category><![CDATA[Data Science]]></category>
		<category><![CDATA[data streaming]]></category>
		<category><![CDATA[Engineering]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Kubernetes]]></category>
		<guid isPermaLink="false">https://engineering.grab.com/kafka-on-kubernetes</guid>

					<description><![CDATA[Introduction

Coban - Grab’s real-time data streaming platform - has been operating Kafka on Kubernetes with Strimzi in 
production for about two years. In a previous article (Zero trust with Kafka), we explained how we leveraged Strimzi to enhance the...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Cloudflare Workers database integration with Upstash</title>
		<link>https://noise.getoto.net/2023/08/02/cloudflare-workers-database-integration-with-upstash/</link>
		
		<dc:creator><![CDATA[Joaquin Gimenez]]></dc:creator>
		<pubDate>Wed, 02 Aug 2023 13:00:22 +0000</pubDate>
				<category><![CDATA[Cloudflare Workers]]></category>
		<category><![CDATA[database]]></category>
		<category><![CDATA[Developers]]></category>
		<category><![CDATA[integration]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Upstash]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=4c2e8e6dc2dcf4bceb89f5234fd684e7</guid>

					<description><![CDATA[Announcing the new Upstash database integrations for Workers. Now it is easier to use Upstash Redis, Kafka and QStash inside your Worker]]></description>
		
		
		<enclosure url="http://blog.cloudflare.com/content/images/2023/07/1-1.png" length="0" type="" />

			</item>
		<item>
		<title>Zero traffic cost for Kafka consumers</title>
		<link>https://noise.getoto.net/2023/07/07/zero-traffic-cost-for-kafka-consumers/</link>
		
		<dc:creator><![CDATA[Grab Tech]]></dc:creator>
		<pubDate>Fri, 07 Jul 2023 00:23:05 +0000</pubDate>
				<category><![CDATA[Access Control]]></category>
		<category><![CDATA[Engineering]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Performance]]></category>
		<category><![CDATA[security]]></category>
		<guid isPermaLink="false">https://engineering.grab.com/zero-traffic-cost</guid>

					<description><![CDATA[Introduction

Coban, Grab’s real-time data streaming platform team, has been building an ecosystem around Kafka, serving all Grab verticals. Along with stability and performance, one of our priorities is also cost efficiency.

In this article, we expla...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Let’s Architect! Open-source technologies on AWS</title>
		<link>https://noise.getoto.net/2023/06/22/lets-architect-open-source-technologies-on-aws/</link>
		
		<dc:creator><![CDATA[Vittorio Denti]]></dc:creator>
		<pubDate>Wed, 21 Jun 2023 21:13:56 +0000</pubDate>
				<category><![CDATA[Amazon Managed Streaming for Apache Kafka (Amazon MSK)]]></category>
		<category><![CDATA[Architecture]]></category>
		<category><![CDATA[AWS Cloud Development Kit]]></category>
		<category><![CDATA[AWS Lambda]]></category>
		<category><![CDATA[devops engineer]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[lambda]]></category>
		<category><![CDATA[Let's Architect]]></category>
		<category><![CDATA[open source]]></category>
		<category><![CDATA[Thought Leadership]]></category>
		<category><![CDATA[well architected]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=b9edce5bb053892af56abfb9863d6bc9</guid>

					<description><![CDATA[We brought you a Let’s Architect! blog post about open-source on AWS that covered some technologies with development led by AWS/Amazon, as well as well-known solutions available on managed AWS services. Today, we’re following the same approach to share more insights about the process itself for developing open-source. That’s why the first topic we discuss […]]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Best practices for running production workloads using Amazon MSK tiered storage</title>
		<link>https://noise.getoto.net/2023/06/14/best-practices-for-running-production-workloads-using-amazon-msk-tiered-storage/</link>
		
		<dc:creator><![CDATA[Nagarjuna Koduru]]></dc:creator>
		<pubDate>Wed, 14 Jun 2023 17:07:09 +0000</pubDate>
				<category><![CDATA[Amazon Managed Streaming for Apache Kafka]]></category>
		<category><![CDATA[Amazon Managed Streaming for Apache Kafka (Amazon MSK)]]></category>
		<category><![CDATA[Analytics]]></category>
		<category><![CDATA[Best practices]]></category>
		<category><![CDATA[Expert (400)]]></category>
		<category><![CDATA[kafka]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=f5af22655f2cc6d49a0f7b4937e361a1</guid>

					<description><![CDATA[In the second post of the series, we discussed some core concepts of the Amazon Managed Streaming for Apache Kafka (Amazon MSK) tiered storage feature and explained how read and write operations work in a tiered storage enabled cluster. This post focuses on how to properly size your MSK tiered storage cluster, which metrics to […]]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Data Reprocessing Pipeline in Asset Management Platform @Netflix</title>
		<link>https://noise.getoto.net/2023/03/11/data-reprocessing-pipeline-in-asset-management-platform-netflix/</link>
		
		<dc:creator><![CDATA[Netflix Technology Blog]]></dc:creator>
		<pubDate>Fri, 10 Mar 2023 22:58:47 +0000</pubDate>
				<category><![CDATA[Asset management]]></category>
		<category><![CDATA[cassandra]]></category>
		<category><![CDATA[Data processing]]></category>
		<category><![CDATA[Elasticsearch]]></category>
		<category><![CDATA[kafka]]></category>
		<guid isPermaLink="false">https://medium.com/p/46fe225c35c9</guid>

					<description><![CDATA[By Meenakshi JindalOverviewAt Netflix, we built the asset management platform (AMP) as a centralized service to organize, store and discover the digital media assets created during the movie production. Studio applications use this service to store the...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>NTS: Reliable Device Testing at Scale</title>
		<link>https://noise.getoto.net/2023/03/09/nts-reliable-device-testing-at-scale/</link>
		
		<dc:creator><![CDATA[Netflix Technology Blog]]></dc:creator>
		<pubDate>Thu, 09 Mar 2023 17:38:02 +0000</pubDate>
				<category><![CDATA[distributed-systems]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[testing]]></category>
		<guid isPermaLink="false">https://medium.com/p/43139ae05382</guid>

					<description><![CDATA[By Benson Ma, ZZ ZimmermanWith contributions from Alok Ahuja, Shravan Heroor, Michael Krasnow, Todor Minchev, Inder SinghIntroductionAt Netflix, we test hundreds of different device types every day, ranging from streaming sticks to smart TVs, to ensure...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Intelligent, automatic restarts for unhealthy Kafka consumers</title>
		<link>https://noise.getoto.net/2023/01/24/intelligent-automatic-restarts-for-unhealthy-kafka-consumers/</link>
		
		<dc:creator><![CDATA[Chris Shepherd]]></dc:creator>
		<pubDate>Tue, 24 Jan 2023 14:00:00 +0000</pubDate>
				<category><![CDATA[Go]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Kubernetes]]></category>
		<category><![CDATA[observability]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=3b828184d9055fd0f187ccf79365eb3f</guid>

					<description><![CDATA[At Cloudflare, we take steps to ensure we are resilient against failure at all levels of our infrastructure. This includes Kafka, which we use for critical workflows such as sending time-sensitive emails and alerts.]]></description>
		
		
		<enclosure url="http://blog.cloudflare.com/content/images/2023/01/image3-8-1.png" length="0" type="" />

			</item>
		<item>
		<title>Zero trust with Kafka</title>
		<link>https://noise.getoto.net/2022/12/07/zero-trust-with-kafka/</link>
		
		<dc:creator><![CDATA[Grab Tech]]></dc:creator>
		<pubDate>Wed, 07 Dec 2022 00:23:05 +0000</pubDate>
				<category><![CDATA[Access Control]]></category>
		<category><![CDATA[Engineering]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Performance]]></category>
		<category><![CDATA[security]]></category>
		<category><![CDATA[Zero-Trust]]></category>
		<guid isPermaLink="false">https://engineering.grab.com/zero-trust-with-kafka</guid>

					<description><![CDATA[Introduction
Grab’s real-time data platform team, also known as Coban, has been operating large-scale Kafka clusters for all Grab verticals, with a strong focus on ensuring a best-in-class-performance and 99.99% availability.

Security has always been ...]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Use MSK Connect for managed MirrorMaker 2 deployment with IAM authentication</title>
		<link>https://noise.getoto.net/2022/10/20/use-msk-connect-for-managed-mirrormaker-2-deployment-with-iam-authentication/</link>
		
		<dc:creator><![CDATA[Tanner Pratt]]></dc:creator>
		<pubDate>Thu, 20 Oct 2022 20:32:59 +0000</pubDate>
				<category><![CDATA[Advanced (300)]]></category>
		<category><![CDATA[Amazon Managed Streaming for Apache Kafka (Amazon MSK)]]></category>
		<category><![CDATA[How-to]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Kafka Connect]]></category>
		<category><![CDATA[MirroMaker]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=fe3d303054bc529a75f25087b900ab44</guid>

					<description><![CDATA[In this post, we show how to use MSK Connect for MirrorMaker 2 deployment with AWS Identity and Access Management (IAM) authentication. We create an MSK Connect custom plugin and IAM role, and then replicate the data between two existing Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters. The goal is to have replication […]]]></description>
		
		
		<enclosure url="" length="0" type="" />

			</item>
		<item>
		<title>Using Apache Kafka to process 1 trillion messages</title>
		<link>https://noise.getoto.net/2022/07/19/using-apache-kafka-to-process-1-trillion-messages/</link>
		
		<dc:creator><![CDATA[Matt Boyle]]></dc:creator>
		<pubDate>Tue, 19 Jul 2022 13:00:00 +0000</pubDate>
				<category><![CDATA[Engineering]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[productivity]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=0ac29e4d7ea5583014847e6ba357ca07</guid>

					<description><![CDATA[We learnt a lot about Kafka on the way to 1 trillion messages, and built some interesting internal tools to ease adoption that will be explored in this blog post]]></description>
		
		
		<enclosure url="http://blog.cloudflare.com/content/images/2022/07/image3-7.png" length="0" type="" />

			</item>
		<item>
		<title>How we improved DNS record build speed by more than 4,000x</title>
		<link>https://noise.getoto.net/2022/05/25/how-we-improved-dns-record-build-speed-by-more-than-4000x/</link>
		
		<dc:creator><![CDATA[Alex Fattouche]]></dc:creator>
		<pubDate>Wed, 25 May 2022 12:59:04 +0000</pubDate>
				<category><![CDATA[DNS]]></category>
		<category><![CDATA[kafka]]></category>
		<category><![CDATA[Performance]]></category>
		<category><![CDATA[PGQ]]></category>
		<guid isPermaLink="false">http://noise.getoto.net/?guid=07104957163f0ca595dc28a3fd055995</guid>

					<description><![CDATA[How we redesigned our DNS pipeline to significantly improve DNS propagation speed across all zones.]]></description>
		
		
		<enclosure url="http://blog.cloudflare.com/content/images/2022/04/image8-8.png" length="0" type="" />

			</item>
	</channel>
</rss>

<!--
Performance optimized by W3 Total Cache. Learn more: https://www.boldgrid.com/w3-total-cache/

Object Caching 77/390 objects using Memcached
Page Caching using Disk: Enhanced 
Lazy Loading (feed)
Database Caching using Memcached

Served from: noise.getoto.net @ 2025-12-11 21:04:07 by W3 Total Cache
-->