Click any tag below to further narrow down your results
Links
Netflix engineers presented a centralized platform for managing data deletion across various storage systems while ensuring durability, availability, and correctness. The platform has successfully deleted 76.8 billion rows without data loss, addressing challenges like data resurrection and resource spikes during deletion. Key recommendations emphasize the importance of rigorous validation and centralized monitoring.
GDPR compliance with Apache Iceberg requires a thorough understanding of data deletion processes due to its immutable architecture, which complicates the removal of user-identifiable information. The guide outlines key challenges, strategies for compliance, and operational best practices for managing deletions and historical snapshots effectively. It also suggests using a managed solution like Ryft for simplified compliance management.